plano/arch/tools
Shuguang Chen 88a02dc478
Some fixes on model server (#362)
* Some fixes on model server

* Remove prompt_prefilling message

* Fix logging

* Fix poetry issues

* Improve logging and update the support for text truncation

* Fix tests

* Fix tests

* Fix tests

* Fix modelserver tests

* Update modelserver tests
2025-01-10 16:45:36 -08:00
..
cli use per user docker socket if system docker socket doesn't exist (#361) 2025-01-08 14:55:42 -08:00
test fix cli models and logs (#196) 2024-10-18 12:09:45 -07:00
__init__.py archgw cli (#117) 2024-10-03 18:21:27 -07:00
build_cli.sh remove dependency on docker-compose when starting up archgw (#305) 2024-11-26 13:13:02 -08:00
poetry.lock Some fixes on model server (#362) 2025-01-10 16:45:36 -08:00
pyproject.toml Some fixes on model server (#362) 2025-01-10 16:45:36 -08:00
README.md updated docs for 0.1.8 support (#366) 2025-01-10 16:38:48 -08:00

Setup Instructions(User): archgw CLI

This guide will walk you through the steps to set up the archgw cli on your local machine

Step 1: Create a Python virtual environment

In the tools directory, create a Python virtual environment by running:

python -m venv venv

Step 2: Activate the virtual environment

  • On Linux/MacOS:
source venv/bin/activate

Step 3: Run the build script

pip install archgw==0.1.8

Uninstall Instructions: archgw CLI

pip uninstall archgw

Setup Instructions (Dev): archgw CLI

This guide will walk you through the steps to set up the archgw cli on your local machine when you want to develop the Archgw CLI

Step 1: Create a Python virtual environment

In the tools directory, create a Python virtual environment by running:

python -m venv venv

Step 2: Activate the virtual environment

  • On Linux/MacOS:
source venv/bin/activate

Step 3: Run the build script

poetry install

Step 4: build Arch

archgw build

Step 5: download models

This will help download models so model_server can load faster. This should be done once.

archgw download-models

Logs

archgw command can also view logs from gateway and model_server. Use following command to view logs,

archgw logs --follow

Uninstall Instructions: archgw CLI

pip uninstall archgw