• Joined on 2026-04-08
JTHesse commented on issue nomyo-ai/nomyo-router#103 2026-06-04 13:14:22 +02:00
Feature: Enhance error handling and logging

Works great!

JTHesse closed issue nomyo-ai/nomyo-router#103 2026-06-04 11:07:38 +02:00
Feature: Enhance error handling and logging
JTHesse commented on issue nomyo-ai/nomyo-router#103 2026-06-04 11:07:36 +02:00
Feature: Enhance error handling and logging

Amazing, thank you!

JTHesse opened issue nomyo-ai/nomyo-router#103 2026-06-04 10:17:05 +02:00
Feature: Enhance error handling and logging
JTHesse commented on issue nomyo-ai/nomyo-router#102 2026-06-04 10:10:53 +02:00
RC-1 extended testing

I tested the new release and couldn't find any difference to the 0.9.1 version, which is good I guess :D

JTHesse commented on issue nomyo-ai/nomyo-router#102 2026-06-03 14:29:14 +02:00
RC-1 extended testing

Hi @alpha-nerd, just returned from a sick-leave. I can't promise, but I will try to test it this week ;)

JTHesse commented on issue nomyo-ai/nomyo-router#84 2026-05-21 13:43:46 +02:00
Tagged docker images not available

That is all right, just wanted to make sure that future tagged releases will stay available ;)

JTHesse commented on issue nomyo-ai/nomyo-router#83 2026-05-19 18:03:39 +02:00
Bug: Endpoint config error status not acknowledged

Thank you, works now!

JTHesse commented on issue nomyo-ai/nomyo-router#84 2026-05-18 13:37:49 +02:00
Tagged docker images not available

Don't worry, your response time is amazing 👍

JTHesse commented on issue nomyo-ai/nomyo-router#83 2026-05-18 13:08:25 +02:00
Bug: Endpoint config error status not acknowledged

Thank you for the quick response. This explains the behavior, can this be fixed in a new release?

JTHesse opened issue nomyo-ai/nomyo-router#84 2026-05-18 11:30:54 +02:00
Tagged docker images not available
JTHesse opened issue nomyo-ai/nomyo-router#83 2026-05-18 10:56:43 +02:00
Bug: Endpoint config error status not acknowledged
JTHesse commented on issue nomyo-ai/nomyo-router#23 2026-05-11 09:58:47 +02:00
feat: enhance load balancing

Sorry, I was on vacation. Awesome work, thank you!

JTHesse commented on issue nomyo-ai/nomyo-router#23 2026-04-16 13:57:22 +02:00
feat: enhance load balancing

Yes a WRR describes this quite good. However, only if the model is already loaded.

I guess what I am describing could look like this:

if all(tracking_usage(ep) == 0 for ep in loaded_and_fr…
JTHesse commented on issue nomyo-ai/nomyo-router#23 2026-04-16 13:07:52 +02:00
feat: enhance load balancing

Firstly thank you for looking into this. I can imagine that an ideal load balancing for different endpoints is pretty tricky.

Maybe prioritization should only occur if all endpoints are…

JTHesse opened issue nomyo-ai/nomyo-router#24 2026-04-16 10:40:03 +02:00
issue: api/version not found
JTHesse opened issue nomyo-ai/nomyo-router#23 2026-04-16 10:14:23 +02:00
feat: enhance load balancing