• v0.9.0 9df5bd35e9

    v0.9.0
    All checks were successful
    Build and Publish Docker Image (Semantic Cache) / build (amd64, linux/amd64, docker-amd64) (push) Successful in 3m11s
    Build and Publish Docker Image / build (amd64, linux/amd64, docker-amd64) (push) Successful in 1m21s
    Build and Publish Docker Image (Semantic Cache) / build (arm64, linux/arm64, docker-arm64) (push) Successful in 14m46s
    Build and Publish Docker Image (Semantic Cache) / merge (push) Successful in 35s
    Build and Publish Docker Image / build (arm64, linux/arm64, docker-arm64) (push) Successful in 11m58s
    Build and Publish Docker Image / merge (push) Successful in 35s
    Stable

    alpha-nerd released this 2026-05-15 16:05:55 +02:00 | 23 commits to main since this release

    • updated docs
    • fix: shutdown tasks for clean stop
    • new feature: conversation affinity causes conversation stickyness to a given endpoint to leverage hot kv-caches (dramatically lowers response latency with larger context sizes)
    • new feature: visualization of conversation affinity in the dashboard
    • dead code removal
    • CI improvements