plano/model_server/openai_params.yaml
Co Tran 17a643c410
ArchFC endpoint integration (#94)
* integration

* mopdify docker file

* add params and fix python lint

* fix empty context and tool calls

* address comments

* revert port

* fix bug merge

* fix environment

* fix bug

* fix compose

* fix merge
2024-10-01 12:47:26 -07:00

8 lines
174 B
YAML

params:
temperature: 0.0001
top_p : 0.5
repetition_penalty: 1.0
top_k: 50
max_tokens: 128
stop: ["<|im_start|>", "<|im_end|>"]
stop_token_ids: [151645, 151643]