update orchestrator model name

This commit is contained in:
Adil Hafeez 2026-03-11 16:46:03 -07:00
parent 48bf83fa0d
commit 680dee60a0
No known key found for this signature in database
GPG key ID: 9B18EF7691369645
3 changed files with 9 additions and 7 deletions

View file

@ -141,7 +141,7 @@ vllm serve katanemo/Plano-Orchestrator-4B \
--gpu-memory-utilization 0.3 \
--tokenizer katanemo/Plano-Orchestrator-4B \
--chat-template chat_template.jinja \
--served-model-name Plano-Orchestrator \
--served-model-name katanemo/Plano-Orchestrator-4B \
--enable-prefix-caching
```