plano/demos/use_cases/preference_based_routing
2025-05-30 17:40:46 -07:00
..
hurl_tests Add support for json based content types in Message (#480) 2025-05-23 00:51:53 -07:00
arch_config.yaml update code to use new json based system prompt for routing (#493) 2025-05-30 17:40:46 -07:00
docker-compose.yaml update code to use new json based system prompt for routing (#493) 2025-05-30 17:40:46 -07:00
README.md Introduce brightstaff a new terminal service for llm routing (#477) 2025-05-19 09:59:22 -07:00
test_router_endpoint.rest update code to use new json based system prompt for routing (#493) 2025-05-30 17:40:46 -07:00

Usage based LLM Routing

This demo shows how you can use user preferences to route user prompts to appropriate llm. See arch_config.yaml for details on how you can define user preferences.