plano/model_server/openai_params.yaml
Co Tran ed50d29ccf
fix fc integration (#110)
* fix fc integration

* fix integration

* remove file

* Update arch_fc.py
2024-10-01 19:20:28 -07:00

7 lines
133 B
YAML

params:
temperature: 0.01
top_p : 0.5
repetition_penalty: 1.0
top_k: 50
max_tokens: 512
stop_token_ids: [151645, 151643]