plano/demos/use_cases/preference_based_routing
2025-05-23 00:51:53 -07:00
..
hurl_tests Add support for json based content types in Message (#480) 2025-05-23 00:51:53 -07:00
arch_config.yaml Add support for json based content types in Message (#480) 2025-05-23 00:51:53 -07:00
docker-compose.yaml Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00
README.md Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00
test_router_endpoint.rest Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00

Usage based LLM Routing

This demo shows how you can use user preferences to route user prompts to appropriate llm. See arch_config.yaml for details on how you can define user preferences.