RC-3 CA testing #106

New issue

Open

opened 2026-06-07 11:36:20 +02:00 by alpha-nerd · 1 comment

alpha-nerd commented

2026-06-07 11:36:20 +02:00

Owner

@JTHesse the new rc-3 introduces a cache for clients to be reused rather than created for each single request.
The previous behaviour introduced a full init with the complete OS truststore for CA which is a heavy lift causing a performance ceiling.
The cache enables now 7x more req/s with concurrent users and cuts latency to 1/8 making the router in the same machine much more performant and responsive.
All tests pass, but as we are not using custom CA - and I believe you do - may I kindly ask once more for a real-world testing on your end.

docker pull bitfreedom.net/nomyo-ai/nomyo-router:0.9.9-rc3

highly appreciated.
if not possible, just close the issue.

@JTHesse the new rc-3 introduces a cache for clients to be reused rather than created for each single request. The previous behaviour introduced a full init with the complete OS truststore for CA which is a heavy lift causing a performance ceiling. The cache enables now 7x more req/s with concurrent users and cuts latency to 1/8 making the router in the same machine much more performant and responsive. All tests pass, but as we are not using custom CA - and I believe you do - may I kindly ask once more for a real-world testing on your end. `docker pull bitfreedom.net/nomyo-ai/nomyo-router:0.9.9-rc3` highly appreciated. if not possible, just close the issue.