plano/arch
2024-11-15 10:44:01 -08:00
..
tools move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
arch_config_schema.yaml add support for jaeger tracing (#229) 2024-11-07 22:11:00 -06:00
build_filter_image.sh Add support for streaming and fixes few issues (see description) (#202) 2024-10-28 17:05:06 -07:00
docker-compose.dev.yaml move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
docker-compose.e2e.yaml move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
docker-compose.yaml move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
Dockerfile move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
env.list Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
envoy.template.yaml move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
README.md update rust toolchain to 1.82 (#255) 2024-11-12 10:35:14 -08:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00
stream_traces.py move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
supervisord.conf move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasip1

Building

$ cargo build --target wasm32-wasip1 --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh
    
  • Build filter binary,

    $ cargo build --target wasm32-wasip1 --release
    
  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw
    
  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm