diff --git a/README.md b/README.md index 06c781c..44ad47c 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ is a transparent proxy for [Ollama](https://github.com/ollama/ollama) with model deployment aware routing. -Screenshot_NOMYO_Router_Dashboard
+Screenshot_NOMYO_Router_0-2-2_Dashboard
It runs between your frontend application and Ollama backend and is transparent for both, the front- and backend. diff --git a/config.yaml b/config.yaml index a0d14ed..93ae117 100644 --- a/config.yaml +++ b/config.yaml @@ -3,6 +3,18 @@ endpoints: - http://192.168.0.50:11434 - http://192.168.0.51:11434 - http://192.168.0.52:11434 + #- https://openrouter.ai/api/v1 + #- https://api.openai.com/v1 -# Maximum concurrent connections *per endpoint‑model pair* -max_concurrent_connections: 2 \ No newline at end of file +# Maximum concurrent connections *per endpoint‑model pair* (equals to OLLAMA_NUM_PARALLEL) +max_concurrent_connections: 2 + +# API keys for remote endpoints +# Set an environment variable like OPENAI_KEY +# Confirm endpoints are exactly as in endpoints block +api_keys: + "http://192.168.0.50:11434": "ollama" + "http://192.168.0.51:11434": "ollama" + "http://192.168.0.52:11434": "ollama" + #"https://openrouter.ai/api/v1": "${OPENROUTER_KEY}" + #"https://api.openai.com/v1": "${OPENAI_KEY}" diff --git a/requirements.txt b/requirements.txt index e39b50c..4ffd391 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1,17 +1,27 @@ +aiohappyeyeballs==2.6.1 +aiohttp==3.12.15 +aiosignal==1.4.0 annotated-types==0.7.0 anyio==4.10.0 +async-timeout==5.0.1 +attrs==25.3.0 certifi==2025.8.3 click==8.2.1 distro==1.9.0 exceptiongroup==1.3.0 fastapi==0.116.1 +fastapi-sse==1.1.1 +frozenlist==1.7.0 h11==0.16.0 httpcore==1.0.9 httpx==0.28.1 +httpx-aiohttp==0.1.8 idna==3.10 jiter==0.10.0 +multidict==6.6.4 ollama==0.5.3 openai==1.102.0 +propcache==0.3.2 pydantic==2.11.7 pydantic-settings==2.10.1 pydantic_core==2.33.2 @@ -23,3 +33,4 @@ tqdm==4.67.1 typing-inspection==0.4.1 typing_extensions==4.14.1 uvicorn==0.35.0 +yarl==1.20.1 diff --git a/static/index.html b/static/index.html index 86746bd..8237c79 100644 --- a/static/index.html +++ b/static/index.html @@ -5,65 +5,75 @@ NOMYO Router Dashboard -

Router Dashboard

+ +

Router Dashboard

+
-

Available Models (Tags)

+
+

Available Models (Tags)

+
+ + + + +
+
+ - - - +
ModelDigest
Loading…
Loading…
+

Running Models (PS)

@@ -76,10 +86,11 @@ - - - +
Digest
Loading…
Loading…
+ + +
@@ -92,23 +103,22 @@ Version - - Loading… - + Loading… + + \ No newline at end of file