mirror of
https://github.com/rowboatlabs/rowboat.git
synced 2026-05-04 04:42:37 +02:00
Mintlify docs (#217)
* add the new docs * Update to latest comprehensive docs from mintlify2 branch - Add conversations, jobs, triggers guides - Complete tools documentation - Enhanced RAG and agents docs - Add UI screenshots and images - Update contribution guide and quickstart * added intro gif * Update introduction.mdx with intro gif * Add public/videos folder with Intro-Video.gif for proper Next.js/Mintlify serving * updated gif * Update introduction.mdx to have a working intro gif
This commit is contained in:
parent
8f40b5fb33
commit
daaac23f76
45 changed files with 1972 additions and 0 deletions
53
apps/docs/docs/using-rowboat/customise/custom-llms.mdx
Normal file
53
apps/docs/docs/using-rowboat/customise/custom-llms.mdx
Normal file
|
|
@ -0,0 +1,53 @@
|
|||
---
|
||||
title: "Custom LLMs"
|
||||
description: "How to use and configure custom LLMs in Rowboat."
|
||||
|
||||
---
|
||||
|
||||
<Note> This is currently only possible in the self hosted version of Rowboat</Note>
|
||||
|
||||
## Using custom LLM providers
|
||||
|
||||
By default, Rowboat uses OpenAI LLMs (gpt-4o, gpt-4.1, etc.) for both agents and copilot, when you export your OPENAI_API_KEY.
|
||||
|
||||
However, you can also configure custom LLM providers (e.g. LiteLLM, OpenRouter) to use any of the hundreds of available LLMs beyond OpenAI, such as Claude, DeepSeek, Ollama LLMs and so on.
|
||||
|
||||
<Steps>
|
||||
<Step title="Set up your LLM provider">
|
||||
Configure your environment variables to point to your preferred LLM backend. Example using LiteLLM:
|
||||
|
||||
```bash
|
||||
export PROVIDER_BASE_URL=http://host.docker.internal:4000/
|
||||
export PROVIDER_API_KEY=sk-1234
|
||||
```
|
||||
|
||||
Rowboat uses <code>gpt-4.1</code> as the default model for agents and copilot. You can override these:
|
||||
|
||||
```bash
|
||||
export PROVIDER_DEFAULT_MODEL=claude-3-7-sonnet-latest
|
||||
export PROVIDER_COPILOT_MODEL=gpt-4o
|
||||
```
|
||||
|
||||
**Notes:**
|
||||
- Copilot is optimized for <code>gpt-4o</code>/<code>gpt-4.1</code>. We strongly recommend using these models for best results.
|
||||
- You can use different models for the copilot and each agent, but all must be from the same provider (e.g., LiteLLM).
|
||||
- Rowboat is provider-agnostic — any backend implementing the OpenAI messages format should work.
|
||||
- OpenAI-specific tools (like <code>web_search</code>) will not function with non-OpenAI providers. Remove such tools to avoid errors.
|
||||
</Step>
|
||||
|
||||
<Step title="Clone the repository and start Rowboat Docker">
|
||||
Clone the Rowboat repo and spin it up locally:
|
||||
|
||||
```bash
|
||||
git clone git@github.com:rowboatlabs/rowboat.git
|
||||
cd rowboat
|
||||
docker-compose up --build
|
||||
```
|
||||
</Step>
|
||||
|
||||
<Step title="Access the app">
|
||||
Once Docker is running, navigate to:
|
||||
|
||||
[http://localhost:3000](http://localhost:3000)
|
||||
</Step>
|
||||
</Steps>
|
||||
Loading…
Add table
Add a link
Reference in a new issue