From 376e63a8bc4fc2d43eb2838ccb1ef5ff07e8edd9 Mon Sep 17 00:00:00 2001 From: Adil Hafeez Date: Fri, 24 Jan 2025 17:03:08 -0800 Subject: [PATCH] Apply suggestions from code review Co-authored-by: Salman Paracha --- docs/source/concepts/llm_provider.rst | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/docs/source/concepts/llm_provider.rst b/docs/source/concepts/llm_provider.rst index 24cf2c14..1b854cf5 100644 --- a/docs/source/concepts/llm_provider.rst +++ b/docs/source/concepts/llm_provider.rst @@ -35,10 +35,9 @@ make outbound LLM calls. Adding custom LLM Provider -------------------------- -We support any OpenAI compliant LLM provider for example mistral, openai, ollama etc. Out of the box we provide support for openai and mistral. But if you want to add your custom provider you can follow the below steps: - -1. Add the llm provider in the `llm_providers` section of the `arch_config.yaml` file. And supply details of how to reach to the provider using "endpoint" and specify `https` in `protocol`` if your endpoint is hosted on public cloud. +We support any OpenAI compliant LLM for example mistral, openai, ollama etc. We offer first class support for openai and ollama. You can easily configure an LLM that communicates over the OpenAI API interface, by following the below guide. +For example following code block shows you how to add an ollama-supported LLM in the `arch_config.yaml` file. .. code-block:: yaml - name: local-llama