Update README.md

This commit is contained in:
Alpha Nerd 2025-08-30 12:47:08 +02:00 committed by GitHub
parent cb7224c030
commit e06745c39e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -10,6 +10,17 @@ It runs between your frontend application and Ollama backend and is transparent
Copy/Clone the repository, edit the config.yaml by adding your Ollama backend servers and the max_concurrent_connections setting per endpoint. This equals to your OLLAMA_NUM_PARALLEL config settings.
```
# config.yaml
endpoints:
- http://ollama0:11434
- http://ollama1:11434
- http://ollama2:11434
# Maximum concurrent connections *per endpointmodel pair*
max_concurrent_connections: 2
```
Run the NOMYO Router in a dedicated virtual environment, install the requirements and run with uvicorn:
```