apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-17 15:25:17 +02:00
Code Issues Projects Releases Packages Wiki Activity

add note about hosted arch-fc

Browse source
This commit is contained in:
Adil Hafeez 2024-11-26 13:58:49 -08:00
parent 704b928d61
commit 5814fbbc01
1 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

5
README.md
View file

@ -51,6 +51,11 @@ Before you begin, ensure you have the following:
- `Docker` & `Python` installed on your system
- `API Keys` for LLM providers (if using external LLMs)
<div style="background-color: #ffdddd; border-left: 5px solid #ff0000; padding: 10px;">
**Important Note:**
We use vllm to serve arch-fc model but vllm is not supported in mac currently. So we have hosted arch-fc in a cloud instance to simplify the e2e experience. We are working on to make this better by providing support for running arch-fc locally. More here [#258](https://github.com/katanemo/archgw/issues/258).
</div>
### Step 1: Install Arch
Arch's CLI allows you to manage and interact with the Arch gateway efficiently. To install the CLI, simply run the following command: