plano/arch
Salman Paracha 8d0b468345
draft commit to add support for xAI, TogehterAI, AzureOpenAI (#570)
* draft commit to add support for xAI, LambdaAI, TogehterAI, AzureOpenAI

* fixing failing tests and updating rederend config file

* Update arch_config_with_aliases.yaml

* adding the AZURE_API_KEY to the GH workflow for e2e

* fixing GH secerts

* adding valdiating for azure_openai

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-167.local>
2025-09-18 18:36:30 -07:00
..
tools draft commit to add support for xAI, TogehterAI, AzureOpenAI (#570) 2025-09-18 18:36:30 -07:00
arch_config_schema.yaml adding support for model aliases in archgw (#566) 2025-09-16 11:12:08 -07:00
docker-compose.dev.yaml refactor demos (#398) 2025-02-07 18:45:42 -08:00
Dockerfile update base image to python3.13 (#554) 2025-08-13 14:20:46 -07:00
env.list Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
envoy.template.yaml draft commit to add support for xAI, TogehterAI, AzureOpenAI (#570) 2025-09-18 18:36:30 -07:00
README.md update rust toolchain to 1.82 (#255) 2024-11-12 10:35:14 -08:00
requirements.txt simplify developer getting started experience (#102) 2024-10-01 10:02:23 -07:00
supervisord.conf add support for v1/messages and transformations (#558) 2025-09-10 07:40:30 -07:00
validate_arch_config.sh better model names (#517) 2025-07-11 16:42:16 -07:00

Envoy filter code for gateway

Add toolchain

$ rustup target add wasm32-wasip1

Building

$ cargo build --target wasm32-wasip1 --release

Testing

$ cargo test

Local development

  • Build docker image for arch gateway. Note this needs to be built once.

    $ sh build_filter_image.sh
    
  • Build filter binary,

    $ cargo build --target wasm32-wasip1 --release
    
  • Start envoy with arch_config.yaml and test,

    $ docker compose -f docker-compose.dev.yaml up archgw
    
  • dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,

    • envoy.template.yaml
    • intelligent_prompt_gateway.wasm