apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-01 03:46:35 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

update .rest file to show how to call arch-router model

Browse source
This commit is contained in:
Adil Hafeez 2025-06-13 10:29:22 -07:00
parent 341b14c1be
commit 0d6e06dfec
No known key found for this signature in database
GPG key ID: 9B18EF7691369645
1 changed files with 7 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

10
demos/use_cases/preference_based_routing/test_router_endpoint.rest
View file

@ -20,6 +20,10 @@ Content-Type: application/json
{"model":"cotran2/llama-1b-4-26","messages":[{"role":"user","content":"\nYou are an advanced Routing Assistant designed to select the optimal route based on user requests. \nYour task is to analyze conversations and match them to the most appropriate predefined route.\nReview the available routes config:\n\n# ROUTES CONFIG START\n- name: gpt-4o\n description: simple requests, basic fact retrieval, easy to answer\n- name: o4-mini()\n description: complex reasoning problem, require multi step answer\n# ROUTES CONFIG END\n\nExamine the following conversation between a user and an assistant:\n\n# CONVERSATION START\n[{\"role\":\"user\",\"content\":\"What is the capital of France?\"}]\n# CONVERSATION END\n\nYour goal is to identify the most appropriate route that matches the user's LATEST intent. Follow these steps:\n\n1. Carefully read and analyze the provided conversation, focusing on the user's latest request and the conversation scenario.\n2. Check if the user's request and scenario matches any of the routes in the routing configuration (focus on the description).\n3. Find the route that best matches.\n4. Use context clues from the entire conversation to determine the best fit.\n5. Return the best match possible. You only response the name of the route that best matches the user's request, use the exact name in the routes config.\n6. If no route relatively close to matches the user's latest intent or user last message is thank you or greeting, return an empty route ''. \n\n# OUTPUT FORMAT\nYour final output must follow this JSON format:\n{\n \"route\": \"route_name\" # The matched route name, or empty string '' if no match\n}\n\nBased on your analysis, provide only the JSON object as your final output with no additional text, explanations, or whitespace.\n"}],"stream":false}
### get model list
# GET http://34.46.85.85:8000/v1/models HTTP/1.1
GET https://archfc.katanemo.dev/arch-router/v1/models HTTP/1.1
### get model list from arch-function
GET https://archfc.katanemo.dev/v1/models HTTP/1.1
model: arch-router
### get model list from arch-router (notice model header)
GET https://archfc.katanemo.dev/v1/models HTTP/1.1
model: arch-router