apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-17 15:25:17 +02:00
Code Issues Projects Releases Packages Wiki Activity

Update README.md

Browse source
This commit is contained in:
Salman Paracha 2025-03-19 13:58:09 -07:00 • committed by GitHub
parent 582c38e051
commit b7e324ec72
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
README.md
View file

@ -41,9 +41,9 @@ And you think to youself, can't I move faster by focusing on higher-level object
- `🚦 Routing`. Engineered with purpose-built [LLMs](https://huggingface.co/collections/katanemo/arch-function-66f209a693ea8df14317ad68) for blazng fast (<100ms) routing and hand-off decisions to downstream agents.
- `⚡ Function Calling`: Improve speed for common scenarios by letting Arch clarfiy and convert prompts to tools/APIs.
- `⛨ Guardrails`: Centrally configure and prevent jailbreaks and harmful outcomes, and ensure safe user interactions.
- `🔗 Unified Access to LLMs`: Centralize= calls to LLMs with smart retries, automatic cutover, and resilient upstream connections for continuous availability.
- `🕵 Observability`: W3C Trace Context compatiblerequest tracing, ensuring compatibility with popular observability tools, and provides metrics to monitor latency, token usage, and error rates.
- `🧱 Built on Envoy`: Arch runs alongside application servers as a separate containerized process, and builds on top of [Envoy's](https://envoyproxy.io) proven HTTP management and scalability features to handle ingress and egress traffic related to prompts and LLMs.
- `🔗 Unified Access to LLMs`: Centralize access and traffic to LLMs with smart retries, automatic cutover for continuous availability.
- `🕵 Observability`: W3C Trace Context compatible request tracing, ensuring compatibility with popular observability tools, and provides metrics to monitor latency, token usage, and error rates.
- `🧱 Built on Envoy`: Arch runs alongside app servers as a containerized process, and builds on top of [Envoy's](https://envoyproxy.io) proven HTTP management and scalability features to handle ingress and egress traffic related to prompts and LLMs.
**High-Level Sequence Diagram**:
![alt text](docs/source/_static/img/arch_network_diagram_high_level.png)