Update README.md
This commit is contained in:
parent
2cbea0008b
commit
1c95bbca66
1 changed files with 2 additions and 2 deletions
|
|
@ -1,10 +1,10 @@
|
||||||
# NOMYO Router
|
# NOMYO Router
|
||||||
|
|
||||||
is a transparent proxy for  with model deployment aware routing.
|
is a transparent proxy for  with model deployment aware routing.
|
||||||
|
|
||||||
It runs between your frontend application and Ollama backend and is transparent for both, the front- and backend.
|
It runs between your frontend application and Ollama backend and is transparent for both, the front- and backend.
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
Copy/Clone the repository, edit the config.yaml by adding your Ollama backend servers and the max_concurrent_connections setting per endpoint. This equals to your OLLAMA_NUM_PARALLEL config settings.
|
Copy/Clone the repository, edit the config.yaml by adding your Ollama backend servers and the max_concurrent_connections setting per endpoint. This equals to your OLLAMA_NUM_PARALLEL config settings.
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue