nomyo-ai/nomyo-router
2
2
Fork 0
Code Issues 1 Pull requests Projects Releases 5 Packages 1 Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
Alpha Nerd 2025-09-01 13:47:54 +02:00 • committed by GitHub
parent 8783d623b7
commit 038e1b0f9a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -43,7 +43,7 @@ When the request is embed(dings), chat or generate the request will be forwarded
If another request for the same model config is made, NOMYO Router is aware which model runs on which Ollama server and routes the request to an Ollama server where this model is already deployed. If another request for the same model config is made, NOMYO Router is aware which model runs on which Ollama server and routes the request to an Ollama server where this model is already deployed.
If at the same time there are more than max concurrent connections than configured, NOMYO Router will route this request to another Ollama server for completion. If at the same time there are more than max concurrent connections than configured, NOMYO Router will route this request to another Ollama server serving the requested model and having the least connections for fastest completion.
This way the Ollama backend servers are utilized more efficient than by simply using a wheighted, round-robin or least-connection approach. This way the Ollama backend servers are utilized more efficient than by simply using a wheighted, round-robin or least-connection approach.