mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-07-10 22:32:16 +02:00
Support separate embedding base URL
This commit is contained in:
parent
aa7388f2f7
commit
6fafedca6a
8 changed files with 160 additions and 6 deletions
|
|
@ -50,6 +50,23 @@ http://<host>:11434
|
|||
|
||||
Replace `<host>` with the LAN IP or domain for that machine.
|
||||
|
||||
## Embeddings on a Separate Ollama Server
|
||||
|
||||
Search-space model connections configure chat and completion models. The global
|
||||
embedding model is configured in the backend environment.
|
||||
|
||||
Use Chonkie's LiteLLM embedding provider when embeddings run on Ollama:
|
||||
|
||||
```dotenv
|
||||
EMBEDDING_MODEL=litellm://ollama/nomic-embed-text
|
||||
EMBEDDING_BASE_URL=http://host.docker.internal:11434
|
||||
```
|
||||
|
||||
If chat and embeddings run on different Ollama instances, keep the chat model
|
||||
connection pointed at the chat server and set `EMBEDDING_BASE_URL` to the
|
||||
embedding server. `OLLAMA_EMBEDDING_BASE_URL` is also supported as an
|
||||
Ollama-specific fallback when `EMBEDDING_BASE_URL` is not set.
|
||||
|
||||
## Add the Connection
|
||||
|
||||
1. Open Search Space Settings.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue