apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-08 15:22:43 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

rename x-session-id to x-routing-session-id and fix routing config field name

Browse source
This commit is contained in:
Adil Hafeez 2026-04-08 12:31:57 -07:00
parent f699cfb059
commit 5789694d2f
11 changed files with 41 additions and 34 deletions
Download patch file Download diff file Expand all files Collapse all files

15
demos/llm_routing/session_pinning/agent.py
View file

@ -11,9 +11,10 @@ each with its own tool-calling loop. The tasks deliberately alternate between
code_generation and complex_reasoning intents so Plano's preference-based
router selects different models for each task.
If the client sends X-Session-Id, the agent forwards it on every outbound
call to Plano. The first task pins the model; all subsequent tasks skip the
router and reuse it — keeping the whole session on one consistent model.
If the client sends X-Routing-Session-Id, the agent forwards it on every
outbound call to Plano. The first task pins the model; all subsequent tasks
skip the router and reuse it — keeping the whole session on one consistent
model.
Run standalone:
uv run agent.py
@ -309,12 +310,12 @@ async def run_task(
Each task is an independent conversation so the router sees only
this task's intent — not the accumulated context of previous tasks.
Session pinning via X-Session-Id pins the model from the first task
onward, so all tasks stay on the same model.
Session pinning via X-Routing-Session-Id pins the model from the first
task onward, so all tasks stay on the same model.
Returns (answer, first_model_used).
"""
headers = {"X-Session-Id": session_id} if session_id else {}
headers = {"X-Routing-Session-Id": session_id} if session_id else {}
messages: list[ChatCompletionMessageParam] = [
{"role": "system", "content": SYSTEM_PROMPT},
{"role": "user", "content": prompt},
@ -391,7 +392,7 @@ app = FastAPI(title="Research Agent", version="1.0.0")
@app.post("/v1/chat/completions")
async def chat(request: Request) -> JSONResponse:
body = await request.json()
session_id: str | None = request.headers.get("x-session-id")
session_id: str | None = request.headers.get("x-routing-session-id")
log.info("request session_id=%s", session_id or "none")