Commit graph

3 commits

Author SHA1 Message Date
Adil Hafeez
0105897692 add session pinning to llm_chat handler and rewrite session pinning demo
- extend brightstaff llm_chat_inner to extract X-Session-Id, check the
  session cache before routing, and cache the result afterward — same
  pattern as routing_service.rs
- replace old urllib-based demo with a real FastAPI research agent that
  runs 3 independent tool-calling tasks with alternating intents so
  Plano routes to different models; demo.py is a pure httpx client that
  shows the routing trace side-by-side with and without session pinning
2026-03-26 16:44:05 -07:00
Adil Hafeez
b3c865330e improve demo output formatting 2026-03-25 23:15:00 -07:00
Adil Hafeez
190790a3d2 add session pinning demo with iterative research agent 2026-03-25 23:09:50 -07:00