Commit graph

451 commits

Author SHA1 Message Date
Renovate Bot
e025e75c76 chore(deps): update dependency aiohttp to v3.14.1
All checks were successful
PR Tests / test (pull_request) Successful in 1m16s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m3s
2026-06-10 15:30:56 +00:00
e7407b86b3 Merge pull request 'dev-0.9.x-ref -> main' (#113) from dev-0.9.x-ref into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 18m0s
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m44s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 34s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m29s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m17s
Build and Publish Docker Image / merge (push) Successful in 33s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/113
2026-06-10 15:48:30 +02:00
a0f3b06b6c Merge pull request 'chore(deps): update dependency tqdm to v4.68.2' (#110) from renovate/tqdm-4.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m48s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m22s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m4s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m59s
Build and Publish Docker Image / merge (push) Successful in 34s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/110
2026-06-09 19:09:53 +02:00
Renovate Bot
f3f7418b65 chore(deps): update dependency tqdm to v4.68.2
All checks were successful
PR Tests / test (pull_request) Successful in 1m19s
NYX Security Scan / nyx-scan (pull_request) Successful in 5m54s
2026-06-09 14:30:49 +00:00
10b9a4e910 Merge pull request 'chore(deps): update dependency certifi to v2026.5.20' (#91) from renovate/certifi-2026.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m52s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m23s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m12s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m40s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
Build and Publish Docker Image / merge (push) Successful in 33s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/91
2026-06-09 10:21:00 +02:00
f827e0deba Merge pull request 'chore(deps): update dependency tqdm to v4.68.1' (#104) from renovate/tqdm-4.x into main
Some checks failed
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Waiting to run
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Waiting to run
Build and Publish Docker Image / merge (push) Blocked by required conditions
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Has been cancelled
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Has been cancelled
Build and Publish Docker Image (Semantic Cache) / merge (push) Has been cancelled
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/104
2026-06-09 10:20:24 +02:00
Renovate Bot
4ed75cfea6 chore(deps): update dependency tqdm to v4.68.1
All checks were successful
PR Tests / test (pull_request) Successful in 1m19s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m52s
2026-06-07 15:29:54 +00:00
Renovate Bot
04ce9d92da chore(deps): update dependency certifi to v2026.5.20
All checks were successful
PR Tests / test (pull_request) Successful in 1m18s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m46s
2026-06-07 15:29:38 +00:00
0de6a5a65d Merge pull request 'model update' (#107) from workflow-updated into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m57s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m23s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m15s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 34s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m42s
Build and Publish Docker Image / merge (push) Successful in 34s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/107
2026-06-07 16:36:55 +02:00
d163fea154
fix: remove aioresponses
All checks were successful
PR Tests / test (pull_request) Successful in 1m16s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m1s
sec: bumb aiohttp 3.14

fix: tiktoken test issue by pre-cache the vocab file
2026-06-07 13:23:35 +02:00
ff8cfce9c7 .forgejo/workflows/opencode.yml aktualisiert
All checks were successful
PR Tests / test (pull_request) Successful in 1m20s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m50s
2026-06-07 12:02:32 +02:00
3cd530586c
feat: cache backend clients per endpoint instead of building one (with a fresh SSL context) per request
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m59s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m25s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m46s
Build and Publish Docker Image / merge (push) Successful in 33s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 19m56s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
2026-06-07 09:55:54 +02:00
1ce792c48b
feat: new load test added 2026-06-07 09:38:14 +02:00
75d204e7f3
feat: use SSE reconnect to prevent API Key modal to pop up in dashboard if no API Key is configured 2026-06-07 09:29:06 +02:00
497c87b02e
refac: code deduplication for error handling and call sites
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 4m2s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m37s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m43s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 34s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m47s
Build and Publish Docker Image / merge (push) Successful in 33s
2026-06-04 10:57:33 +02:00
2dceece0d6
feat: add test for ollama stream errors 2026-06-04 10:42:18 +02:00
d3b2ee3047
feat: surface an upstream ollama backend error transitively from a streaming generator 2026-06-04 10:33:47 +02:00
f5e08aa896 Merge pull request 'fix: using the right body' (#100) from workflow-tuning into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 4m3s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m22s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 15m27s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m4s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 36s
Build and Publish Docker Image / merge (push) Successful in 34s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/100
2026-05-30 11:26:22 +02:00
fd5b131ff4 .forgejo/workflows/opencode.yml aktualisiert
Some checks failed
NYX Security Scan / nyx-scan (pull_request) Failing after 6m39s
2026-05-30 11:09:47 +02:00
b754daf1af
feat: after closing the probe session, reset
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m52s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m23s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 15m16s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 34s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m59s
Build and Publish Docker Image / merge (push) Successful in 33s
2026-05-28 10:16:54 +02:00
820e217da6
fix: Lightweight health/introspection probes no longer compete with long-lived streaming completions for the proxy pool's per-host connection slots 2026-05-28 09:54:53 +02:00
13d796817f
feat: add authorization header to llama model endpoint fetch 2026-05-28 09:32:20 +02:00
775829796c Merge pull request 'chore(deps): update dependency fastapi to v0.136.3' (#97) from renovate/fastapi-0.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m53s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m21s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 15m32s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m54s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 38s
Build and Publish Docker Image / merge (push) Successful in 33s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/97
2026-05-28 07:36:00 +02:00
Renovate Bot
3e1e206740 chore(deps): update dependency fastapi to v0.136.3
All checks were successful
NYX Security Scan / nyx-scan (pull_request) Successful in 7m3s
PR Tests / test (pull_request) Successful in 1m0s
2026-05-27 19:16:33 +00:00
7cb17cb791 Merge pull request 'requirements.txt aktualisiert' (#99) from alpha-nerd-patch-2 into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 4m14s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m24s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 15m34s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m1s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 38s
Build and Publish Docker Image / merge (push) Successful in 34s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/99
2026-05-27 21:14:41 +02:00
2d1f2506b9 requirements.txt aktualisiert
All checks were successful
PR Tests / test (pull_request) Successful in 1m0s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m46s
2026-05-27 20:25:11 +02:00
4b5a70e787
refac: modularize apis VII 2026-05-19 14:57:39 +02:00
e74f5d1ba6
refac: request handling VI 2026-05-19 14:09:52 +02:00
8355bf9a1e
refac: modularize sse, routing, db and token handling V 2026-05-19 12:48:55 +02:00
2e58a383c5 Merge pull request 'chore(deps): update dependency jiter to v0.15.0' (#88) from renovate/jiter-0.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m41s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m22s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m47s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m54s
Build and Publish Docker Image / merge (push) Successful in 33s
2026-05-19 12:23:47 +02:00
Renovate Bot
9bba10d7f4 chore(deps): update dependency jiter to v0.15.0
All checks were successful
PR Tests / test (pull_request) Successful in 1m1s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m35s
2026-05-19 10:10:54 +00:00
3a9854c5db
refac: modularize backend IV 2026-05-19 12:05:51 +02:00
c88ba1e5a4
refac: modularize global states III 2026-05-19 11:18:06 +02:00
d2b31b6c7b
refac: modularize config II 2026-05-19 11:00:50 +02:00
90b6868f5a
refac: split into modules I 2026-05-19 10:05:27 +02:00
078855ba9a Merge pull request 'feat: completion errors on an endpoint:model key a caught, cached and rerouted (openai compatible endpoints)' (#87) from dev-0.9.x-completion-error-cache into dev-0.9.x
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/87
2026-05-19 07:40:40 +02:00
770de3b93f Merge pull request 'hotfix for #83' (#85) from dev-0.9.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m35s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m18s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m28s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m28s
Build and Publish Docker Image / merge (push) Successful in 33s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/85
2026-05-19 05:58:19 +02:00
19d522f671
Merge branch 'main' into dev-0.9.x
All checks were successful
PR Tests / test (pull_request) Successful in 58s
NYX Security Scan / nyx-scan (pull_request) Successful in 7m15s
Resolve conflict in .forgejo/workflows/docker-publish-semantic.yml:
both sides removed the cache-from/cache-to lines; keep this branch's
unique-per-run platform tag from ea8cda7 (related to issue #84).

Picks up dependency bumps from main (click 8.3.3->8.4.0,
idna 3.14->3.15, openai 1.109.1->2.37.0).
2026-05-18 18:53:20 +02:00
079b677e23
feat: completion errors on an endpoint:model key a caught, cached and rerouted (openai compatible endpoints)
All checks were successful
PR Tests / test (pull_request) Successful in 57s
2026-05-18 18:14:28 +02:00
539d5f98a2
doc: update on /health and /api/config endpoints
All checks were successful
PR Tests / test (pull_request) Successful in 59s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m52s
2026-05-18 17:03:04 +02:00
ea8cda73d9
fix: use unique-per-run platform tags.
All checks were successful
PR Tests / test (pull_request) Successful in 1m0s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m46s
2026-05-18 16:31:09 +02:00
59b59386ac
fix: futureproof docker builds related to #84 2026-05-18 15:59:52 +02:00
db6aa73903
fix:
All checks were successful
PR Tests / test (pull_request) Successful in 58s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m59s
-  _fetch_loaded_models_internal now writes _loaded_error_cache[endpoint] = time.time() on /api/ps or /v1/models failure, and clears the entry on success
- choose_endpoint now filters out candidates with a fresh (<300s) loaded-models error.
-  /health now probes both /api/version and /api/ps for Ollama endpoints
-  dashboard adaption

relates to #83
2026-05-18 13:45:06 +02:00
1df9d75cf7 Merge pull request 'dev-0.9.x -> main' (#81) from dev-0.9.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m18s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m18s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m25s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 32s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m42s
Build and Publish Docker Image / merge (push) Successful in 1m2s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/81
2026-05-17 11:30:51 +02:00
0b64a84e96
fix: replace hardcoded tokendb path
All checks were successful
PR Tests / test (pull_request) Successful in 1m0s
NYX Security Scan / nyx-scan (pull_request) Successful in 6m24s
2026-05-17 10:53:33 +02:00
5193046174 Merge pull request 'chore(deps): update dependency click to v8.4.0' (#80) from renovate/click-8.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m21s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m17s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m39s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 31s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m23s
Build and Publish Docker Image / merge (push) Successful in 34s
2026-05-17 03:10:13 +02:00
Renovate Bot
27bc57d4a4 chore(deps): update dependency click to v8.4.0
All checks were successful
NYX Security Scan / nyx-scan (pull_request) Successful in 6m15s
2026-05-17 00:58:02 +00:00
82f631879c Merge pull request 'chore(deps): update dependency openai to v2' (#57) from renovate/openai-2.x into main
All checks were successful
Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m20s
Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m22s
Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m35s
Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m54s
Build and Publish Docker Image / merge (push) Successful in 33s
Reviewed-on: https://bitfreedom.net/code/code/nomyo-ai/nomyo-router/pulls/57
2026-05-16 10:59:11 +02:00
Renovate Bot
64e38978a9 chore(deps): update dependency openai to v2
All checks were successful
NYX Security Scan / nyx-scan (pull_request) Successful in 6m31s
2026-05-16 07:46:35 +00:00
29ee360082
feat: adding automated tests 2026-05-15 16:43:12 +02:00