plano/arch
Salman Paracha 6fb63510b3
fix cli models and logs (#196)
* removing unnecessar setup.py files

* updated the cli for debug and access logs

* ran the pre-commit locally to fix pull request

* fixed bug where if archgw_process is None we didn't handle it gracefully

* Apply suggestions from code review

Co-authored-by: Adil Hafeez <adil@katanemo.com>

* fixed changes based on PR

* fixed version not found message

* fixed message based on PR feedback

* adding poetry lock

* fixed pre-commit

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-10-18 12:09:45 -07:00
..
tools fix cli models and logs (#196) 2024-10-18 12:09:45 -07:00
arch_config_schema.yaml llm listener split (#155) 2024-10-09 15:47:32 -07:00
build_filter_image.sh Split listener (#141) 2024-10-08 16:24:08 -07:00
CONTRIBUTING.md minor fixes to README (#156) 2024-10-09 10:12:36 -07:00
docker-compose.dev.yaml llm listener split (#155) 2024-10-09 15:47:32 -07:00
docker-compose.yaml fix for linux (#175) 2024-10-10 14:56:23 -07:00
Dockerfile split wasm filter (#186) 2024-10-16 14:20:26 -07:00
envoy.template.yaml Split arch wasm filter code into prompt and llm gateway filters (#190) 2024-10-17 10:16:40 -07:00
README.md Update README.md 2024-10-08 17:20:51 -07:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00
stage.env Salmanap/fix config generator (#124) 2024-10-05 10:49:47 -07:00

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasi

Building

$ cargo build --target wasm32-wasi --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh
    
  • Build filter binary,

    $ cargo build --target wasm32-wasi --release
    
  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw
    
  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm