diff --git a/README.md b/README.md index c1f9bbf0..fecb5d39 100644 --- a/README.md +++ b/README.md @@ -7,7 +7,7 @@ [![e2e tests](https://github.com/katanemo/arch/actions/workflows/e2e_tests.yml/badge.svg)](https://github.com/katanemo/arch/actions/workflows/e2e_tests.yml) [![Build and Deploy Documentation](https://github.com/katanemo/arch/actions/workflows/static.yml/badge.svg)](https://github.com/katanemo/arch/actions/workflows/static.yml) -## Build fast, robust, and personalized AI agents. +## Build fast, observable, and personalized AI agents. Arch is an intelligent [Layer 7](https://www.cloudflare.com/learning/ddos/what-is-layer-7/) gateway designed to protect, observe, and personalize LLM applications (agents, assistants, co-pilots) with your APIs. @@ -156,6 +156,8 @@ print("OpenAI Response:", response.choices[0].message.content) ### [Observability](https://docs.archgw.com/guides/observability/observability.html) Arch is designed to support best-in class observability by supporting open standards. Please read our [docs](https://docs.archgw.com/guides/observability/observability.html) on observability for more details on tracing, metrics, and logs +![alt text](docs/source/_static/img/tracing.png) + ### Contribution We would love feedback on our [Roadmap](https://github.com/orgs/katanemo/projects/1) and we welcome contributions to **Arch**! Whether you're fixing bugs, adding new features, improving documentation, or creating tutorials, your help is much appreciated. diff --git a/docs/source/_static/img/tracing.png b/docs/source/_static/img/tracing.png new file mode 100644 index 00000000..91d6a82b Binary files /dev/null and b/docs/source/_static/img/tracing.png differ diff --git a/docs/source/concepts/tech_overview/listener.rst b/docs/source/concepts/tech_overview/listener.rst index c79a22b0..632d5315 100644 --- a/docs/source/concepts/tech_overview/listener.rst +++ b/docs/source/concepts/tech_overview/listener.rst @@ -21,8 +21,8 @@ Upstream (Egress) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Arch automatically configures a listener to route requests from your application to upstream LLM API providers (or hosts). When you start Arch, it creates a listener for egress traffic based on the presence of the ``listener`` configuration -section in the configuration file. Arch binds itself to a local address such as ``127.0.0.1:9000/v1`` or a DNS-based -address like ``arch.local:9000/v1`` for outgoing traffic. For more details on LLM providers, read :ref:`here `. +section in the configuration file. Arch binds itself to a local address such as ``127.0.0.1:12000/v1`` or a DNS-based +address like ``arch.local:12000/v1`` for outgoing traffic. For more details on LLM providers, read :ref:`here `. Configure Listener ^^^^^^^^^^^^^^^^^^ diff --git a/docs/source/conf.py b/docs/source/conf.py index 00ca3311..02837294 100644 --- a/docs/source/conf.py +++ b/docs/source/conf.py @@ -15,7 +15,7 @@ from sphinxawesome_theme.postprocess import Icons project = "Arch Docs" copyright = "2024, Katanemo Labs, Inc" author = "Katanemo Labs, Inc" -release = " v0.1" +release = " v0.1.2" # -- General configuration --------------------------------------------------- # https://www.sphinx-doc.org/en/master/usage/configuration.html#general-configuration diff --git a/docs/source/guides/observability/tracing.rst b/docs/source/guides/observability/tracing.rst index b1027d25..23bf80d2 100644 --- a/docs/source/guides/observability/tracing.rst +++ b/docs/source/guides/observability/tracing.rst @@ -23,6 +23,10 @@ flow, enabling **end-to-end tracing** across the entire application. By using Op that developers can capture this trace data consistently and in a format compatible with various observability tools. +.. image:: /_static/img/tracing.png + :width: 100% + :align: center + Benefits of Using ``Traceparent`` Headers ----------------------------------------- diff --git a/docs/source/index.rst b/docs/source/index.rst index dea9d8d0..39bc2922 100644 --- a/docs/source/index.rst +++ b/docs/source/index.rst @@ -9,10 +9,12 @@ Welcome to Arch!

-

Build fast, robust, and personalized GenAI apps

+

Build fast, observable, and personalized GenAI apps

-Arch (built by the contributors of `Envoy `_ ) was born out of the belief that: + Arch - Build fast, hyper-personalized agents with intelligent infra | Product Hunt + +`Arch `_ is an intelligent infrastructure primitive for GenAI (built by the contributors of `Envoy `_ ) that born out of the belief that: *Prompts are nuanced and opaque user requests, which require the same capabilities as traditional HTTP requests including secure handling, intelligent routing, robust observability, and integration with backend (API) systems for personalization - all outside business logic.* diff --git a/api_llm_gateway.rest b/e2e_tests/api_llm_gateway.rest similarity index 100% rename from api_llm_gateway.rest rename to e2e_tests/api_llm_gateway.rest diff --git a/api_model_server.rest b/e2e_tests/api_model_server.rest similarity index 100% rename from api_model_server.rest rename to e2e_tests/api_model_server.rest diff --git a/api_prompt_gateway.rest b/e2e_tests/api_prompt_gateway.rest similarity index 100% rename from api_prompt_gateway.rest rename to e2e_tests/api_prompt_gateway.rest diff --git a/tracing.rest b/e2e_tests/tracing.rest similarity index 100% rename from tracing.rest rename to e2e_tests/tracing.rest