mirror of
https://github.com/katanemo/plano.git
synced 2026-04-26 09:16:24 +02:00
b60ceb9168
* first commit to have model_server not be dependent on Docker * making changes to fix the docker-compose file for archgw to set DNS_V4 and minor fixes with the build * additional fixes for model server to be separated out in the build * additional fixes for model server to be separated out in the build * fix to get model_server to be built as a separate python process. TODO: fix the embeddings logs after cli completes * fixing init to pull tempfile using the tempfile python package --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
6 lines
108 B
YAML
6 lines
108 B
YAML
params:
|
|
temperature: 0.01
|
|
top_p : 0.5
|
|
top_k: 50
|
|
max_tokens: 2024
|
|
stop_token_ids: [151645, 151643]
|