plano/model_server/openai_params.yaml

params:
  temperature: 0.01
  top_p : 0.5
  repetition_penalty: 1.0
  top_k: 50
  max_tokens: 512
  stop_token_ids: [151645, 151643]
ArchFC endpoint integration (#94) * integration * mopdify docker file * add params and fix python lint * fix empty context and tool calls * address comments * revert port * fix bug merge * fix environment * fix bug * fix compose * fix merge 2024-10-01 12:47:26 -07:00			`params:`
fix fc integration (#110) * fix fc integration * fix integration * remove file * Update arch_fc.py 2024-10-01 19:20:28 -07:00			`temperature: 0.01`
ArchFC endpoint integration (#94) * integration * mopdify docker file * add params and fix python lint * fix empty context and tool calls * address comments * revert port * fix bug merge * fix environment * fix bug * fix compose * fix merge 2024-10-01 12:47:26 -07:00			`top_p : 0.5`
			`repetition_penalty: 1.0`
			`top_k: 50`
fix fc integration (#110) * fix fc integration * fix integration * remove file * Update arch_fc.py 2024-10-01 19:20:28 -07:00			`max_tokens: 512`
ArchFC endpoint integration (#94) * integration * mopdify docker file * add params and fix python lint * fix empty context and tool calls * address comments * revert port * fix bug merge * fix environment * fix bug * fix compose * fix merge 2024-10-01 12:47:26 -07:00			`stop_token_ids: [151645, 151643]`