mirror of
https://github.com/katanemo/plano.git
synced 2026-06-11 15:05:14 +02:00
38f7691163
* add support for custom llm with ssl support Add support for using custom llm that are served through https protocol. * add instructions on how to add custom inference endpoint * fix formatting * add more details * Apply suggestions from code review Co-authored-by: Salman Paracha <salman.paracha@gmail.com> * Apply suggestions from code review * fix precommit --------- Co-authored-by: Salman Paracha <salman.paracha@gmail.com> |
||
|---|---|---|
| .. | ||
| tools | ||
| arch_config_schema.yaml | ||
| docker-compose.dev.yaml | ||
| Dockerfile | ||
| env.list | ||
| envoy.template.yaml | ||
| README.md | ||
| requirements.txt | ||
Envoy filter code for gateway
Add toolchain
$ rustup target add wasm32-wasip1
Building
$ cargo build --target wasm32-wasip1 --release
Testing
$ cargo test
Local development
-
Build docker image for arch gateway. Note this needs to be built once.
$ sh build_filter_image.sh -
Build filter binary,
$ cargo build --target wasm32-wasip1 --release -
Start envoy with arch_config.yaml and test,
$ docker compose -f docker-compose.dev.yaml up archgw -
dev version of docker-compose file uses following files that are mounted inside the container. That means no docker rebuild is needed if any of these files change. Just restart the container and chagne will be picked up,
- envoy.template.yaml
- intelligent_prompt_gateway.wasm