SurfSense/surfsense_web/content/docs/local-models/index.mdx

31 lines
814 B
Text
Raw Normal View History

---
title: Local Models
description: Connect local model servers to SurfSense
---
import { Card, Cards } from 'fumadocs-ui/components/card';
# Local Models
SurfSense can use local model servers such as Ollama and LM Studio.
The API Base URL is read by the SurfSense backend. If SurfSense runs in Docker, use an address the backend container can reach.
<Cards>
<Card
title="Ollama"
description="Connect an Ollama server and discover local model tags"
href="/docs/local-models/ollama"
/>
<Card
title="LM Studio"
description="Connect an LM Studio local server"
href="/docs/local-models/lm-studio"
/>
<Card
title="Other Local Servers"
description="Connect llama.cpp, vLLM, LocalAI, LiteLLM Proxy, and more"
href="/docs/local-models/other-local-servers"
/>
</Cards>