mirror of
https://github.com/katanemo/plano.git
synced 2026-04-30 11:26:27 +02:00
use overrides for custom routing and orchestration model
This commit is contained in:
parent
98038690b0
commit
6143b7ad54
9 changed files with 93 additions and 114 deletions
|
|
@ -401,13 +401,11 @@ Using vLLM
|
|||
|
||||
.. code-block:: yaml
|
||||
|
||||
orchestration:
|
||||
model: Plano-Orchestrator
|
||||
llm_provider: plano-orchestrator
|
||||
overrides:
|
||||
orchestrator_model: arch/Plano-Orchestrator
|
||||
|
||||
model_providers:
|
||||
- name: plano-orchestrator
|
||||
model: Plano-Orchestrator
|
||||
- model: arch/Plano-Orchestrator
|
||||
base_url: http://<your-server-ip>:8000
|
||||
|
||||
5. **Verify the server is running**
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue