apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-26 17:26:26 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Introduce brightstaff a new terminal service for llm routing (#477)

Browse source
This commit is contained in:
Adil Hafeez 2025-05-19 09:59:22 -07:00 • committed by GitHub
parent 1f95fac4af
commit 27c0f2fdce
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
36 changed files with 2817 additions and 150 deletions
Download patch file Download diff file Expand all files Collapse all files

18
demos/use_cases/preference_based_routing/hurl_tests/simple.hurl Normal file
View file

@ -0,0 +1,18 @@
POST http://localhost:12000/v1/chat/completions
Content-Type: application/json
{
"messages": [
{
"role": "user",
"content": "I am running under debt, how should I keep a tab on my expenses?"
}
]
}
HTTP 200
[Asserts]
header "content-type" == "application/json"
jsonpath "$.model" matches /^o4-mini/
jsonpath "$.usage" != null
jsonpath "$.choices[0].message.content" != null
jsonpath "$.choices[0].message.role" == "assistant"

16
demos/use_cases/preference_based_routing/hurl_tests/simple_stream.hurl Normal file
View file

@ -0,0 +1,16 @@
POST http://localhost:12000/v1/chat/completions
Content-Type: application/json
{
"messages": [
{
"role": "user",
"content": "I am running under debt, how should I keep a tab on my expenses?"
}
],
"stream": true
}
HTTP 200
[Asserts]
header "content-type" matches /text\/event-stream/
body matches /^data: .*?o4-mini.*?\n/