dev-0.9.x-ref -> main #113

Merged

alpha-nerd merged 19 commits from dev-0.9.x-ref into main 2026-06-10 15:48:31 +02:00

Conversation 0 Commits 19 Files changed 34 +106321 -4055

alpha-nerd commented 2026-06-10 11:57:15 +02:00

Owner

Copy link

Major refactor for major release

Major refactor for major release

alpha-nerd added 19 commits 2026-06-10 11:57:16 +02:00

feat: completion errors on an endpoint:model key a caught, cached and rerouted (openai compatible endpoints) 079b677e23

Merge pull request 'feat: completion errors on an endpoint:model key a caught, cached and rerouted (openai compatible endpoints)' (#87) from dev-0.9.x-completion-error-cache into dev-0.9.x ... 078855ba9a

Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/87

refac: split into modules I 90b6868f5a

refac: modularize config II d2b31b6c7b

refac: modularize global states III c88ba1e5a4

refac: modularize backend IV 3a9854c5db

refac: modularize sse, routing, db and token handling V 8355bf9a1e

refac: request handling VI e74f5d1ba6

refac: modularize apis VII 4b5a70e787

feat: add authorization header to llama model endpoint fetch 13d796817f

fix: Lightweight health/introspection probes no longer compete with long-lived streaming completions for the proxy pool's per-host connection slots 820e217da6

feat: after closing the probe session, reset b754daf1af

feat: surface an upstream ollama backend error transitively from a streaming generator d3b2ee3047

feat: add test for ollama stream errors 2dceece0d6

refac: code deduplication for error handling and call sites 497c87b02e

feat: use SSE reconnect to prevent API Key modal to pop up in dashboard if no API Key is configured 75d204e7f3

feat: new load test added 1ce792c48b

feat: cache backend clients per endpoint instead of building one (with a fresh SSL context) per request 3cd530586c

fix: remove aioresponses ... d163fea154

sec: bumb aiohttp 3.14

fix: tiktoken test issue by pre-cache the vocab file

alpha-nerd merged commit e7407b86b3 into main 2026-06-10 15:48:31 +02:00

alpha-nerd referenced this pull request from a commit 2026-06-10 15:48:33 +02:00

Merge pull request 'dev-0.9.x-ref -> main' (#113) from dev-0.9.x-ref into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels   

bug

Something is not working

  

dependencies

dependency management

  

duplicate

This issue or pull request already exists

  

enhancement

New feature

  

help wanted

Need some help

  

invalid

Something is wrong

  

question

More information is needed

  

renovate: stop-updating

stop renovate-bot pushing

  

wontfix

This won't be fixed

  

bug

Something is not working

  

duplicate

This issue or pull request already exists

  

enhancement

New feature

  

help wanted

Need some help

  

invalid

Something is wrong

  

question

More information is needed

  

renovate: stop-updating

cmd renovate to stop updating the pr

  

security

CVE warning

  

wontfix

This won't be fixed

No labels

bug

dependencies

duplicate

enhancement

help wanted

invalid

question

renovate: stop-updating

wontfix

bug

duplicate

enhancement

help wanted

invalid

question

renovate: stop-updating

security

wontfix

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: nomyo-ai/nomyo-router#113

No description provided.