This commit is contained in:
adilhafeez 2024-10-09 22:53:41 +00:00
parent ae329c98b1
commit 8f099f1814
5 changed files with 3 additions and 14 deletions

View file

@ -342,7 +342,7 @@ traffic, apply rate limits, and utilize a large set of traffic management capabi
<div class="admonition attention">
<p class="admonition-title">Attention</p>
<p>When you start Arch, it automatically creates a listener port for egress calls to upstream LLMs. This is based on the
<code class="docutils literal notranslate"><span class="pre">llm_providers</span></code> configuration section in the <code class="docutils literal notranslate"><span class="pre">prompt_config.yml</span></code> file. Arch binds itself to a local address such as
<code class="docutils literal notranslate"><span class="pre">llm_providers</span></code> configuration section in the <code class="docutils literal notranslate"><span class="pre">arch_config.yml</span></code> file. Arch binds itself to a local address such as
127.0.0.1:12000/v1.</p>
</div>
<section id="example-using-openai-client-with-arch-as-an-egress-gateway">