LLM provider is a top-level primitive in Arch, helping developers centrally define, secure, observe, -and manage the usage of of their LLMs. Arch builds on Envoy’s reliable cluster subsystem +and manage the usage of their LLMs. Arch builds on Envoy’s reliable cluster subsystem to manage egress traffic to LLMs, which includes intelligent routing, retry and fail-over mechanisms, ensuring high availability and fault tolerance. This abstraction also enables developers to seamlessly switching between LLM providers or upgrade LLM versions, simplifying the integration and scaling of LLMs @@ -268,7 +268,7 @@ make outbound LLM calls.
diff --git a/concepts/prompt_target.html b/concepts/prompt_target.html index 00d82816..c3339360 100755 --- a/concepts/prompt_target.html +++ b/concepts/prompt_target.html @@ -365,7 +365,7 @@ Each parameter can be marked as required or optional. Here is a full list of par diff --git a/concepts/tech_overview/error_target.html b/concepts/tech_overview/error_target.html index af3ff939..8297bd0b 100755 --- a/concepts/tech_overview/error_target.html +++ b/concepts/tech_overview/error_target.html @@ -232,7 +232,7 @@ The errors are communicated to the application via headers like
-© 2025, Katanemo Labs, Inc Last updated: Mar 27, 2025.
+© 2025, Katanemo Labs, Inc Last updated: Mar 28, 2025.
diff --git a/concepts/tech_overview/listener.html b/concepts/tech_overview/listener.html
index 1538e967..254b380a 100755
--- a/concepts/tech_overview/listener.html
+++ b/concepts/tech_overview/listener.html
@@ -236,7 +236,7 @@ address like arch.l
diff --git a/concepts/tech_overview/model_serving.html b/concepts/tech_overview/model_serving.html
index e227f37d..388e1905 100755
--- a/concepts/tech_overview/model_serving.html
+++ b/concepts/tech_overview/model_serving.html
@@ -223,7 +223,7 @@ how to generate API keys for model serving
diff --git a/concepts/tech_overview/prompt.html b/concepts/tech_overview/prompt.html
index c1d38761..a16a8b56 100755
--- a/concepts/tech_overview/prompt.html
+++ b/concepts/tech_overview/prompt.html
@@ -397,7 +397,7 @@ This setup allows you to take advantage of Arch’s advanced traffic management
diff --git a/concepts/tech_overview/request_lifecycle.html b/concepts/tech_overview/request_lifecycle.html
index 790931de..5783b8e1 100755
--- a/concepts/tech_overview/request_lifecycle.html
+++ b/concepts/tech_overview/request_lifecycle.html
@@ -397,7 +397,7 @@ processing request headers and then finalized by the HCM during post-request pro
diff --git a/concepts/tech_overview/tech_overview.html b/concepts/tech_overview/tech_overview.html
index 1ab4b50e..e225ac24 100755
--- a/concepts/tech_overview/tech_overview.html
+++ b/concepts/tech_overview/tech_overview.html
@@ -219,7 +219,7 @@
diff --git a/concepts/tech_overview/terminology.html b/concepts/tech_overview/terminology.html
index 19570c96..61d924da 100755
--- a/concepts/tech_overview/terminology.html
+++ b/concepts/tech_overview/terminology.html
@@ -216,7 +216,7 @@ and take appropriate actions.
diff --git a/concepts/tech_overview/threading_model.html b/concepts/tech_overview/threading_model.html
index 087fd438..1adc275b 100755
--- a/concepts/tech_overview/threading_model.html
+++ b/concepts/tech_overview/threading_model.html
@@ -194,7 +194,7 @@ hardware threads on the machine.
diff --git a/get_started/intro_to_arch.html b/get_started/intro_to_arch.html
index 6e79655d..530d3e12 100755
--- a/get_started/intro_to_arch.html
+++ b/get_started/intro_to_arch.html
@@ -238,7 +238,7 @@ For more details, read
-© 2025, Katanemo Labs, Inc Last updated: Mar 27, 2025.
+© 2025, Katanemo Labs, Inc Last updated: Mar 28, 2025.
diff --git a/get_started/overview.html b/get_started/overview.html
index 38bad121..b12b3ab3 100755
--- a/get_started/overview.html
+++ b/get_started/overview.html
@@ -332,7 +332,7 @@ simplify the interaction with upstream LLMs, and improve observability all while
diff --git a/get_started/quickstart.html b/get_started/quickstart.html
index baf20989..ba32fd19 100755
--- a/get_started/quickstart.html
+++ b/get_started/quickstart.html
@@ -441,7 +441,7 @@
diff --git a/guides/agent_routing.html b/guides/agent_routing.html
index 41f4c5b6..0348c443 100755
--- a/guides/agent_routing.html
+++ b/guides/agent_routing.html
@@ -290,7 +290,7 @@ please see our
-© 2025, Katanemo Labs, Inc Last updated: Mar 27, 2025.
+© 2025, Katanemo Labs, Inc Last updated: Mar 28, 2025.
diff --git a/guides/function_calling.html b/guides/function_calling.html
index bd24eae7..13b42745 100755
--- a/guides/function_calling.html
+++ b/guides/function_calling.html
@@ -366,7 +366,7 @@ on the stuff that matters most.
diff --git a/guides/observability/access_logging.html b/guides/observability/access_logging.html
index f2364182..71cd2b1c 100755
--- a/guides/observability/access_logging.html
+++ b/guides/observability/access_logging.html
@@ -242,7 +242,7 @@ Access logs can be exported to centralized logging systems (e.g., ELK stack or F
diff --git a/guides/observability/monitoring.html b/guides/observability/monitoring.html
index 25170235..d840258f 100755
--- a/guides/observability/monitoring.html
+++ b/guides/observability/monitoring.html
@@ -254,7 +254,7 @@ are some sample configuration files for both, respectively.
diff --git a/guides/observability/observability.html b/guides/observability/observability.html
index 7d26eadd..3f488a30 100755
--- a/guides/observability/observability.html
+++ b/guides/observability/observability.html
@@ -206,7 +206,7 @@
diff --git a/guides/observability/tracing.html b/guides/observability/tracing.html
index 943a333b..2538fd00 100755
--- a/guides/observability/tracing.html
+++ b/guides/observability/tracing.html
@@ -576,7 +576,7 @@ tools like AWS X-Ray and Datadog, enhancing observability and facilitating faste
diff --git a/guides/prompt_guard.html b/guides/prompt_guard.html
index 89bb6fe0..2a6d3935 100755
--- a/guides/prompt_guard.html
+++ b/guides/prompt_guard.html
@@ -266,7 +266,7 @@ By implementing Prompt Guard, developers can provide a robust layer of input val
diff --git a/index.html b/index.html
index bb17585a..723f1bea 100755
--- a/index.html
+++ b/index.html
@@ -246,7 +246,7 @@ Resources
diff --git a/resources/configuration_reference.html b/resources/configuration_reference.html
index 16721289..ebc2aa87 100755
--- a/resources/configuration_reference.html
+++ b/resources/configuration_reference.html
@@ -274,7 +274,7 @@ where prompts get routed to, apply guardrails, and enable critical agent observa
diff --git a/search.html b/search.html
index 191179cf..0db9a131 100755
--- a/search.html
+++ b/search.html
@@ -214,7 +214,7 @@