plano/arch
José Ulises Niño Rivera bbd6058ca0 debug streaming
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-10-13 15:36:53 -06:00
..
grafana rename envoyfilter => arch (#91) 2024-09-27 16:41:39 -07:00
prometheus rename envoyfilter => arch (#91) 2024-09-27 16:41:39 -07:00
src debug streaming 2024-10-13 15:36:53 -06:00
tests llm listener split (#155) 2024-10-09 15:47:32 -07:00
tools update lock file 2024-10-09 21:01:12 -07:00
arch_config_schema.yaml llm listener split (#155) 2024-10-09 15:47:32 -07:00
build_filter_image.sh Split listener (#141) 2024-10-08 16:24:08 -07:00
Cargo.lock Implement Client trait for StreamContext (#134) 2024-10-07 16:50:15 -07:00
Cargo.toml Implement Client trait for StreamContext (#134) 2024-10-07 16:50:15 -07:00
CONTRIBUTING.md minor fixes to README (#156) 2024-10-09 10:12:36 -07:00
docker-compose.dev.yaml debug streaming 2024-10-13 15:36:53 -06:00
docker-compose.yaml updated archgw cli to pull from archgw_modelserver from pypi (#169) 2024-10-09 21:00:26 -07:00
Dockerfile fixed cli to use poetry as well. this way we make it easy to have the… (#160) 2024-10-09 15:53:12 -07:00
envoy.template.yaml debug streaming 2024-10-13 15:36:53 -06:00
README.md Update README.md 2024-10-08 17:20:51 -07:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00
stage.env Salmanap/fix config generator (#124) 2024-10-05 10:49:47 -07:00

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasi

Building

$ cargo build --target wasm32-wasi --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh
    
  • Build filter binary,

    $ cargo build --target wasm32-wasi --release
    
  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw
    
  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm