apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-05 05:42:49 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Cotran/hallucination integration (#115)

Browse source 
* fix fc integration

* fix integration

* remove file

* Update arch_fc.py

* create model server hallucination detection class
This commit is contained in:
Co Tran 2024-10-04 11:05:25 -07:00 • committed by GitHub
parent dc57f119a0
commit 7d38ef9719
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 35 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
model_server/openai_params.yaml
View file

@ -2,5 +2,5 @@ params:
temperature: 0.01
top_p : 0.5
top_k: 50
max_tokens: 512
max_tokens: 2024
stop_token_ids: [151645, 151643]