apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-05 05:42:49 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix llm_routing provider element (#382)

Browse source 
* Fix llm_routing provider element

We replaced provider with provider_interface to make it more clear to developers about provider api/backend being used. During that upgrade we removed support for mistral in provider to encourage developers to start using provider_interface. But this demo was not updated to use provider_interface as it was using mistral. This code change fixes it by replacing provider with provider_interface.

Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>

* fix the path

* move

* add more details

* fix

* Apply suggestions from code review

* fix

* fix

---------

Signed-off-by: Adil Hafeez <adil.hafeez@gmail.com>
This commit is contained in:
Adil Hafeez 2025-01-24 16:34:11 -08:00 • committed by GitHub
parent 84af476c75
commit 2c67fa3bc0
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
13 changed files with 60 additions and 21 deletions
Download patch file Download diff file Expand all files Collapse all files

8
demos/llm_routing/arch_config.yaml
View file

@ -9,23 +9,23 @@ listener:
llm_providers:
- name: gpt-4o-mini
access_key: $OPENAI_API_KEY
provider: openai
provider_interface: openai
model: gpt-4o-mini
default: true
- name: gpt-3.5-turbo-0125
access_key: $OPENAI_API_KEY
provider: openai
provider_interface: openai
model: gpt-3.5-turbo-0125
- name: gpt-4o
access_key: $OPENAI_API_KEY
provider: openai
provider_interface: openai
model: gpt-4o
- name: ministral-3b
access_key: $MISTRAL_API_KEY
provider: mistral
provider_interface: mistral
model: ministral-3b-latest
tracing: