apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-04 13:23:00 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
plano/arch
History
Salman Paracha 88c2bd1851
removing model_server python module to brightstaff (function calling) (#615) 
* adding function_calling functionality via rust

* fixed rendered YAML file

* removed model_server from envoy.template and forwarding traffic to bright_staff

* fixed bugs in function_calling.rs that were breaking tests. All good now

* updating e2e test to clean up disk usage

* removing Arch* models to be used as a default model if one is not specified

* if the user sets arch-function base_url we should honor it

* fixing demos as we needed to pin to a particular version of huggingface_hub else the chatbot ui wouldn't build

* adding a constant for Arch-Function model name

* fixing some edge cases with calls made to Arch-Function

* fixed JSON parsing issues in function_calling.rs

* fixed bug where the raw response from Arch-Function was re-encoded

* removed debug from supervisord.conf

* commenting out disk cleanup

* adding back disk space

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-288.local>
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>
2025-11-22 12:55:00 -08:00
..
tools removing model_server python module to brightstaff (function calling) (#615) 2025-11-22 12:55:00 -08:00
arch_config_schema.yaml add support for agents (#564) 2025-10-14 14:01:11 -07:00
docker-compose.dev.yaml refactor demos (#398) 2025-02-07 18:45:42 -08:00
Dockerfile add support for agents (#564) 2025-10-14 14:01:11 -07:00
env.list Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
envoy.template.yaml removing model_server python module to brightstaff (function calling) (#615) 2025-11-22 12:55:00 -08:00
README.md update rust toolchain to 1.82 (#255) 2024-11-12 10:35:14 -08:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00
supervisord.conf fix console logs (#598) 2025-10-23 10:59:21 -07:00
validate_arch_config.sh add support for agents (#564) 2025-10-14 14:01:11 -07:00

README.md

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasip1

Building

$ cargo build --target wasm32-wasip1 --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh

  • Build filter binary,

    $ cargo build --target wasm32-wasip1 --release

  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw

  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm