From 019490b6bd6b76f144577113ab5ce4fbfd1b9efb Mon Sep 17 00:00:00 2001 From: alpha-nerd-nomyo Date: Tue, 26 Aug 2025 18:42:32 +0200 Subject: [PATCH] Update README.md --- README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 1e9dcd1..491bcc1 100644 --- a/README.md +++ b/README.md @@ -6,6 +6,8 @@ It runs between your frontend application and Ollama backend and is transparent ![arch](https://github.com/user-attachments/assets/80b9feac-7d57-40f9-9cbc-78d0e76809c6) +# Installation + Copy/Clone the repository, edit the config.yaml by adding your Ollama backend servers and the max_concurrent_connections setting per endpoint. This equals to your OLLAMA_NUM_PARALLEL config settings. Run the NOMYO Router in a dedicated virtual environment, install the requirements and run with uvicorn: @@ -23,4 +25,4 @@ uvicorn router:app --host 127.0.0.1 --port 12434 # Routing - +![routing](https://github.com/user-attachments/assets/ed05dfbb-fcc8-4ff2-b8ca-3cdce2660c9f)