mirror of
https://github.com/katanemo/plano.git
synced 2026-05-01 03:46:35 +02:00
88c2bd1851
* adding function_calling functionality via rust * fixed rendered YAML file * removed model_server from envoy.template and forwarding traffic to bright_staff * fixed bugs in function_calling.rs that were breaking tests. All good now * updating e2e test to clean up disk usage * removing Arch* models to be used as a default model if one is not specified * if the user sets arch-function base_url we should honor it * fixing demos as we needed to pin to a particular version of huggingface_hub else the chatbot ui wouldn't build * adding a constant for Arch-Function model name * fixing some edge cases with calls made to Arch-Function * fixed JSON parsing issues in function_calling.rs * fixed bug where the raw response from Arch-Function was re-encoded * removed debug from supervisord.conf * commenting out disk cleanup * adding back disk space --------- Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-288.local> Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local> |
||
|---|---|---|
| .. | ||
| cli | ||
| test | ||
| __init__.py | ||
| build_cli.sh | ||
| poetry.lock | ||
| pyproject.toml | ||
| README.md | ||
| uv.lock | ||
Setup Instructions(User): archgw CLI
This guide will walk you through the steps to set up the archgw cli on your local machine
Step 1: Create a Python virtual environment
In the tools directory, create a Python virtual environment by running:
python -m venv venv
Step 2: Activate the virtual environment
- On Linux/MacOS:
source venv/bin/activate
Step 3: Run the build script
pip install archgw==0.3.18
Uninstall Instructions: archgw CLI
pip uninstall archgw
Setup Instructions (Dev): archgw CLI
This guide will walk you through the steps to set up the archgw cli on your local machine when you want to develop the Archgw CLI
Step 1: Create a Python virtual environment
In the tools directory, create a Python virtual environment by running:
python -m venv venv
Step 2: Activate the virtual environment
- On Linux/MacOS:
source venv/bin/activate
Step 3: Run the build script
poetry install
Step 4: build Arch
archgw build
Step 5: download models
This will help download models so model_server can load faster. This should be done once.
archgw download-models
Logs
archgw command can also view logs from gateway and model_server. Use following command to view logs,
archgw logs --follow
Uninstall Instructions: archgw CLI
pip uninstall archgw