mirror of
https://github.com/katanemo/plano.git
synced 2026-04-25 00:36:34 +02:00
add note about hosted arch-fc (#308)
This commit is contained in:
parent
704b928d61
commit
adec02e742
1 changed files with 3 additions and 5 deletions
|
|
@ -26,11 +26,8 @@ Engineered with purpose-built LLMs, Arch handles the critical but undifferentiat
|
|||
|
||||
**Jump to our [docs](https://docs.archgw.com)** to learn how you can use Arch to improve the speed, security and personalization of your GenAI apps.
|
||||
|
||||
> [!NOTE]
|
||||
> Today, the function calling LLM (Arch-Function) designed for the agentic and RAG scenarios is hosted free of charge in the US-central region.
|
||||
> To offer consistent latencies and throughput, and to manage our expenses, we will enable access to the hosted version via developers keys soon, and give you the option to run that
|
||||
> LLM locally. Pricing for the hosted version of Arch-Function will be ~ $0.10/M output token (100x cheaper that GPT-4o for function calling scenarios).
|
||||
|
||||
> [!IMPORTANT]
|
||||
> Today, the function calling LLM (Arch-Function) designed for the agentic and RAG scenarios is hosted free of charge in the US-central region. To offer consistent latencies and throughput, and to manage our expenses, we will enable access to the hosted version via developers keys soon, and give you the option to run that LLM locally. For more details see this issue [#258](https://github.com/katanemo/archgw/issues/258)
|
||||
|
||||
## Contact
|
||||
To get in touch with us, please join our [discord server](https://discord.gg/pGZf2gcwEc). We will be monitoring that actively and offering support there.
|
||||
|
|
@ -51,6 +48,7 @@ Before you begin, ensure you have the following:
|
|||
- `Docker` & `Python` installed on your system
|
||||
- `API Keys` for LLM providers (if using external LLMs)
|
||||
|
||||
|
||||
### Step 1: Install Arch
|
||||
|
||||
Arch's CLI allows you to manage and interact with the Arch gateway efficiently. To install the CLI, simply run the following command:
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue