mirror of
https://github.com/katanemo/plano.git
synced 2026-05-15 11:02:39 +02:00
Salmanap/fix docs new providers model alias (#571)
* fixed docs and added ollama as a first-class LLM provider * matching the LLM routing section on the README.md to the docs * updated the section on preference-based routing --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-167.local>
This commit is contained in:
parent
8d0b468345
commit
fbe82351c0
16 changed files with 1696 additions and 150 deletions
|
|
@ -31,7 +31,7 @@ code to LLMs.
|
|||
|
||||
When you start Arch, you specify a listener address/port that you want to bind downstream. But, Arch uses are predefined port
|
||||
that you can use (``127.0.0.1:12000``) to proxy egress calls originating from your application to LLMs (API-based or hosted).
|
||||
For more details, check out :ref:`LLM provider <llm_provider>`.
|
||||
For more details, check out :ref:`LLM providers <llm_providers>`.
|
||||
|
||||
**Prompt Target**: Arch offers a primitive called :ref:`prompt target <prompt_target>` to help separate business logic from
|
||||
undifferentiated work in building generative AI apps. Prompt targets are endpoints that receive prompts that are processed by Arch.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue