plano/model_server/openai_params.yaml at 7d38ef971941974d02a92c49476e2831e60e5990 - apunkt/plano - bitfreedom.net: free all bits, everywhere

apunkt/plano

mirror of https://github.com/katanemo/plano.git synced 2026-04-30 11:26:27 +02:00

Co Tran 7d38ef9719

Cotran/hallucination integration (#115 )

* fix fc integration

* fix integration

* remove file

* Update arch_fc.py

* create model server hallucination detection class

2024-10-04 11:05:25 -07:00

6 lines

108 B

YAML

Raw Blame History

 params:
   temperature: 0.01
   top_p : 0.5
   top_k: 50
   max_tokens: 2024
   stop_token_ids: [151645, 151643]