SurfSense/surfsense_web/content/docs/local-models/index.mdx

30 lines
814 B
Text

---
title: Local Models
description: Connect local model servers to SurfSense
---
import { Card, Cards } from 'fumadocs-ui/components/card';
# Local Models
SurfSense can use local model servers such as Ollama and LM Studio.
The API Base URL is read by the SurfSense backend. If SurfSense runs in Docker, use an address the backend container can reach.
<Cards>
<Card
title="Ollama"
description="Connect an Ollama server and discover local model tags"
href="/docs/local-models/ollama"
/>
<Card
title="LM Studio"
description="Connect an LM Studio local server"
href="/docs/local-models/lm-studio"
/>
<Card
title="Other Local Servers"
description="Connect llama.cpp, vLLM, LocalAI, LiteLLM Proxy, and more"
href="/docs/local-models/other-local-servers"
/>
</Cards>