nomyo-ai/nomyo-router
3
2
Fork 0
Code Issues 1 Pull requests 8 Projects Releases 13 Packages 1 Wiki Activity Actions

13 releases 17 tags

RSS feed
  • v1.0.3 7f4d59b395

    v1.0.3
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m40s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m29s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m21s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 32s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m38s
    Details
    Build and Publish Docker Image / merge (push) Successful in 31s
    Details
    Stable

    alpha-nerd released this 2026-07-15 11:51:51 +02:00 | 0 commits to main since this release

    • dependency update
    • dependency security update
    • experimental anthropic message api implementation
  • v1.0.2 8a6c5c1122

    v1.0.2
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m13s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m22s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m2s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 32s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 13m4s
    Details
    Build and Publish Docker Image / merge (push) Successful in 31s
    Details
    Stable

    alpha-nerd released this 2026-06-26 10:05:19 +02:00 | 19 commits to main since this release

    • fixing reservation counters in dashboard preventing stale counters
    • fixing a routing bug for openai compatible endpoints
    • improving endpoint selection across different backends advertising the same model
  • v1.0.1 fc512fd0d8

    v1.0.1
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 4m4s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m47s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 17m8s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 38s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m40s
    Details
    Build and Publish Docker Image / merge (push) Successful in 39s
    Details
    Stable

    alpha-nerd released this 2026-06-16 12:13:07 +02:00 | 41 commits to main since this release

    • added llama-swap as backend
    • added improved logic for endpoint selection to better distribute load
    • added transparent openai responses api on router front- and backends
  • v1.0.0 e7407b86b3

    v1.0.0
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 18m0s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m44s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 34s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 12m29s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m17s
    Details
    Build and Publish Docker Image / merge (push) Successful in 33s
    Details
    Stable

    alpha-nerd released this 2026-06-10 15:51:57 +02:00 | 65 commits to main since this release

    • refactor of nomyo-router for better maintainability
    • support llama-server authorization headers
    • improved endpoint check locks and seperate connection pool to improve stability in high load situations
    • making ollama backend errors transient to surface backend errors to clients for better debugging
    • automatic SSE reconnect on dashboard to prevent API Key modal blips
    • adding load test to judge machine performance
    • improving performance by chaching the http-clients to prevent full init with CA OS trust store
  • v0.9.1 770de3b93f

    v0.9.1
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m35s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m18s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m28s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m28s
    Details
    Build and Publish Docker Image / merge (push) Successful in 33s
    Details
    Stable

    alpha-nerd released this 2026-05-19 07:11:46 +02:00 | 101 commits to main since this release

    • fix health endpoint for ollama endpoints
    • fix docker image build
    • doc update
  • v0.9.0 9df5bd35e9

    v0.9.0
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m11s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m21s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m46s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 35s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m58s
    Details
    Build and Publish Docker Image / merge (push) Successful in 35s
    Details
    Stable

    alpha-nerd released this 2026-05-15 16:05:55 +02:00 | 114 commits to main since this release

    • updated docs
    • fix: shutdown tasks for clean stop
    • new feature: conversation affinity causes conversation stickyness to a given endpoint to leverage hot kv-caches (dramatically lowers response latency with larger context sizes)
    • new feature: visualization of conversation affinity in the dashboard
    • dead code removal
    • CI improvements
  • v0.8.1 b6923a2b71

    v0.8.1
    Some checks failed
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m41s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 35s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 32s
    Details
    Build and Publish Docker Image / merge (push) Has been skipped
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m40s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Failing after 1m20s
    Details
    Stable

    alpha-nerd released this 2026-05-11 09:52:28 +02:00 | 141 commits to main since this release

    • updated docs
    • feat: new helper to bridge change of behaviour in llama.cpp v1/models status
    • feat: better default referer handling when requesting remote endpoints
    • feat: correct pass through of openai.APIStatusErrors to be able to debug client-side
  • v0.8 0d5b8110f7

    v0.8.0
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 38s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 37s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 9m57s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 34s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m32s
    Details
    Build and Publish Docker Image / merge (push) Successful in 32s
    Details
    Stable

    alpha-nerd released this 2026-05-01 16:58:27 +02:00 | 206 commits to main since this release

    new features:

    • priority routing
    • endpoint specific max_connection settings
    • updated docs
    • direct llama_server_endpoint connection via unix socket bypassing network overhead
  • v0.7.6 a3928c9c33

    v0.7.6
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 34s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 38s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m5s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 31s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m11s
    Details
    Build and Publish Docker Image / merge (push) Successful in 31s
    Details
    Stable

    alpha-nerd released this 2026-04-16 13:29:27 +02:00 | 215 commits to main since this release

    • fixing a bug in /health endpoint
    • mitigating a possible dependency vulnerability
    • improved documentation on the reactive context-shift feature
  • v0.7.5 f4b3a09151

    v0.7.5
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 37s
    Details
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 36s
    Details
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m10s
    Details
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 33s
    Details
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 10m2s
    Details
    Build and Publish Docker Image / merge (push) Successful in 33s
    Details
    Stable

    alpha-nerd released this 2026-04-13 15:19:22 +02:00 | 220 commits to main since this release

    • dashboard security fix
    • dashboard hostname inclusion improving host visibility when managing multiple instances