Update README.md

This commit is contained in:
Alpha Nerd 2025-09-15 12:06:42 +02:00 committed by GitHub
parent ed84be2760
commit beb5395e24
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -18,9 +18,19 @@ endpoints:
- http://ollama0:11434
- http://ollama1:11434
- http://ollama2:11434
- https://api.openai.com/v1
# Maximum concurrent connections *per endpointmodel pair*
max_concurrent_connections: 2
# API keys for remote endpoints
# Set an environment variable like OPENAI_KEY
# Confirm endpoints are exactly as in endpoints block
api_keys:
"http://192.168.0.50:11434": "ollama"
"http://192.168.0.51:11434": "ollama"
"http://192.168.0.52:11434": "ollama"
"https://api.openai.com/v1": "${OPENAI_KEY}"
```
Run the NOMYO Router in a dedicated virtual environment, install the requirements and run with uvicorn:
@ -30,6 +40,13 @@ python3 -m venv .venv/router
source .venv/router/bin/activate
pip3 install -r requirements.txt
```
on the shell do:
```
export OPENAI_KEY=YOUR_SECRET_API_KEY
```
finally you can
```