use overrides for custom routing and orchestration model

This commit is contained in:
Adil Hafeez 2026-03-11 16:38:00 -07:00
parent 98038690b0
commit 6143b7ad54
No known key found for this signature in database
GPG key ID: 9B18EF7691369645
9 changed files with 93 additions and 114 deletions

View file

@ -401,13 +401,11 @@ Using vLLM
.. code-block:: yaml
orchestration:
model: Plano-Orchestrator
llm_provider: plano-orchestrator
overrides:
orchestrator_model: arch/Plano-Orchestrator
model_providers:
- name: plano-orchestrator
model: Plano-Orchestrator
- model: arch/Plano-Orchestrator
base_url: http://<your-server-ip>:8000
5. **Verify the server is running**