diff --git a/README.md b/README.md index eb5ba62b..e52c2f3f 100644 --- a/README.md +++ b/README.md @@ -41,9 +41,9 @@ And you think to youself, can't I move faster by focusing on higher-level object - `🚦 Routing`. Engineered with purpose-built [LLMs](https://huggingface.co/collections/katanemo/arch-function-66f209a693ea8df14317ad68) for blazng fast (<100ms) routing and hand-off decisions to downstream agents. - `⚡ Function Calling`: Improve speed for common scenarios by letting Arch clarfiy and convert prompts to tools/APIs. - `⛨ Guardrails`: Centrally configure and prevent jailbreaks and harmful outcomes, and ensure safe user interactions. - - `🔗 Unified Access to LLMs`: Centralize= calls to LLMs with smart retries, automatic cutover, and resilient upstream connections for continuous availability. - - `🕵 Observability`: W3C Trace Context compatiblerequest tracing, ensuring compatibility with popular observability tools, and provides metrics to monitor latency, token usage, and error rates. - - `🧱 Built on Envoy`: Arch runs alongside application servers as a separate containerized process, and builds on top of [Envoy's](https://envoyproxy.io) proven HTTP management and scalability features to handle ingress and egress traffic related to prompts and LLMs. + - `🔗 Unified Access to LLMs`: Centralize access and traffic to LLMs with smart retries, automatic cutover for continuous availability. + - `🕵 Observability`: W3C Trace Context compatible request tracing, ensuring compatibility with popular observability tools, and provides metrics to monitor latency, token usage, and error rates. + - `🧱 Built on Envoy`: Arch runs alongside app servers as a containerized process, and builds on top of [Envoy's](https://envoyproxy.io) proven HTTP management and scalability features to handle ingress and egress traffic related to prompts and LLMs. **High-Level Sequence Diagram**: ![alt text](docs/source/_static/img/arch_network_diagram_high_level.png)