plano/demos/use_cases/preference_based_routing
2025-05-23 00:29:27 -07:00
..
hurl_tests fix model name 2025-05-23 00:29:27 -07:00
arch_config.yaml update arch config 2025-05-23 00:00:47 -07:00
docker-compose.yaml Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00
README.md Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00
test_router_endpoint.rest Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00

Usage based LLM Routing

This demo shows how you can use user preferences to route user prompts to appropriate llm. See arch_config.yaml for details on how you can define user preferences.