plano/arch
Salman Paracha d5a273f740
enable state management for v1/responses (#631)
* first commit with tests to enable state mamangement via memory

* fixed logs to follow the conversational flow a bit better

* added support for supabase

* added the state_storage_v1_responses flag, and use that to store state appropriately

* cleaned up logs and fixed issue with connectivity for llm gateway in weather forecast demo

* fixed mixed inputs from openai v1/responses api (#632)

* fixed mixed inputs from openai v1/responses api

* removing tracing from model-alias-rouing

* handling additional input types from openairs

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>

* resolving PR comments

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>
2025-12-17 12:18:38 -08:00
..
tools enable state management for v1/responses (#631) 2025-12-17 12:18:38 -08:00
arch_config_schema.yaml enable state management for v1/responses (#631) 2025-12-17 12:18:38 -08:00
docker-compose.dev.yaml removing model_server. buh bye (#619) 2025-11-22 15:04:41 -08:00
Dockerfile add support for agents (#564) 2025-10-14 14:01:11 -07:00
env.list Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
envoy.template.yaml Improve end to end tracing (#628) 2025-12-11 15:21:57 -08:00
README.md update rust toolchain to 1.82 (#255) 2024-11-12 10:35:14 -08:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00
supervisord.conf enable state management for v1/responses (#631) 2025-12-17 12:18:38 -08:00
validate_arch_config.sh add support for agents (#564) 2025-10-14 14:01:11 -07:00

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasip1

Building

$ cargo build --target wasm32-wasip1 --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh
    
  • Build filter binary,

    $ cargo build --target wasm32-wasip1 --release
    
  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw
    
  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm