Update README.md
This commit is contained in:
parent
1c95bbca66
commit
019490b6bd
1 changed files with 3 additions and 1 deletions
|
|
@ -6,6 +6,8 @@ It runs between your frontend application and Ollama backend and is transparent
|
|||
|
||||

|
||||
|
||||
# Installation
|
||||
|
||||
Copy/Clone the repository, edit the config.yaml by adding your Ollama backend servers and the max_concurrent_connections setting per endpoint. This equals to your OLLAMA_NUM_PARALLEL config settings.
|
||||
|
||||
Run the NOMYO Router in a dedicated virtual environment, install the requirements and run with uvicorn:
|
||||
|
|
@ -23,4 +25,4 @@ uvicorn router:app --host 127.0.0.1 --port 12434
|
|||
|
||||
# Routing
|
||||
|
||||
|
||||

|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue