apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-17 15:25:17 +02:00
Code Issues Projects Releases Packages Wiki Activity

fixing a bug where by we were writing the cluster_name for an upstream LLM more than once

Browse source
This commit is contained in:
Salman Paracha 2025-10-27 14:37:49 -07:00
parent 662546481a
commit cc46c42bfe
2 changed files with 12 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

5
demos/use_cases/model_alias_routing/arch_config_with_aliases.yaml
View file

@ -39,6 +39,11 @@ llm_providers:
access_key: $AWS_BEARER_TOKEN_BEDROCK
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
- model: amazon_bedrock/us.amazon.nova-pro-v1:0
access_key: $AWS_BEARER_TOKEN_BEDROCK
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
# Ollama Models
- model: ollama/llama3.1
base_url: http://host.docker.internal:11434