From 5814fbbc01a07bb26b0f8e8d80078ebf0e8a4a2e Mon Sep 17 00:00:00 2001 From: Adil Hafeez Date: Tue, 26 Nov 2024 13:58:49 -0800 Subject: [PATCH] add note about hosted arch-fc --- README.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/README.md b/README.md index 1440ec57..8deb44e3 100644 --- a/README.md +++ b/README.md @@ -51,6 +51,11 @@ Before you begin, ensure you have the following: - `Docker` & `Python` installed on your system - `API Keys` for LLM providers (if using external LLMs) +
+**Important Note:** +We use vllm to serve arch-fc model but vllm is not supported in mac currently. So we have hosted arch-fc in a cloud instance to simplify the e2e experience. We are working on to make this better by providing support for running arch-fc locally. More here [#258](https://github.com/katanemo/archgw/issues/258). +
+ ### Step 1: Install Arch Arch's CLI allows you to manage and interact with the Arch gateway efficiently. To install the CLI, simply run the following command: