apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-17 15:25:17 +02:00
Code Issues Projects Releases Packages Wiki Activity
plano/arch
History
Adil Hafeez 0ef9d62565 add support for format
2024-12-11 12:06:59 -08:00
..
tools remove nli model 2024-12-10 21:03:02 -08:00
arch_config_schema.yaml add support for format 2024-12-11 12:06:59 -08:00
docker-compose.dev.yaml move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
docker-compose.e2e.yaml move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
Dockerfile use envoy to publish traces (#270) 2024-11-18 17:55:39 -08:00
env.list Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
envoy.template.yaml integrate arch with model_server 2024-12-10 15:12:31 -08:00
README.md update rust toolchain to 1.82 (#255) 2024-11-12 10:35:14 -08:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00

README.md

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasip1

Building

$ cargo build --target wasm32-wasip1 --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh

  • Build filter binary,

    $ cargo build --target wasm32-wasip1 --release

  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw

  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm