dograh/docs/configurations/llm.mdx

19 lines
1 KiB
Text
Raw Normal View History

---
title: "LLM"
description: "Voice Agents use LLM (Large Language Models), which are trained to understand the conversational context, and respond to users."
---
2026-06-26 11:57:26 +05:30
Dograh platform supports OpenAI, Google AI Studio, Google Vertex AI, Azure OpenAI, AWS Bedrock, Groq, OpenRouter, Hugging Face, MiniMax, Sarvam, and Dograh-managed LLMs. There are some models provided by default for you to choose from the drop down.
<Warning>
LLM providers receive the data needed to generate responses, such as prompts, conversation history, model settings, and any configured tool/function definitions or tool call context. Review the provider's data processing, retention, model training, and regional hosting policies before using sensitive data.
</Warning>
2026-06-26 11:57:26 +05:30
For locally deployed or self-hosted LLMs, Dograh also supports OpenAI-compatible endpoints such as Ollama and vLLM.
![Select Models from DropDown](../images/models_dropdown.png)
If you don't find a model in the drop down, you can always add a model manually.
2026-06-26 11:57:26 +05:30
![Select Models from DropDown](../images/add_model_manually.png)