nomyo-ai/nomyo-router
2
2
Fork 0
Code Issues 1 Pull requests Projects Releases 5 Packages 1 Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
Alpha Nerd 2025-08-26 18:40:23 +02:00 • committed by GitHub
parent 5f1f3f7b57
commit 2cbea0008b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 26 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

27
README.md
View file

@ -1 +1,26 @@
Hello World!
![arch](https://github.com/user-attachments/assets/80b9feac-7d57-40f9-9cbc-78d0e76809c6)# NOMYO Router
is a transparent proxy for ![Ollama](https://github.com/ollama/ollama) with model deployment aware routing.
It runs between your frontend application and Ollama backend and is transparent for both, the front- and backend.
Copy/Clone the repository, edit the config.yaml by adding your Ollama backend servers and the max_concurrent_connections setting per endpoint. This equals to your OLLAMA_NUM_PARALLEL config settings.
Run the NOMYO Router in a dedicated virtual environment, install the requirements and run with uvicorn:
```
python3 -m venv .venv/router
source .venv/router/bin/activate
pip3 install requirements.txt -r
```
finally you can
```
uvicorn router:app --host 127.0.0.1 --port 12434
```
# Routing