Update docs/source/guides/llm_router.rst

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
This commit is contained in:
CTran 2025-05-30 09:53:02 -07:00 committed by GitHub
parent da94da03b7
commit 0016e200b2
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -11,8 +11,8 @@ For **preference-based routing**, instead of predicting raw model quality, it ro
Arch Router
-----------
is a powerful feature in Arch that allows your application to dynamically change the response LLM based on user prompts.
Arch-Router matches user prompts to high-level task categories specified by developers (e.g., FAQ answer, creative writing, code generation), and routes each query to the corresponding model or pipeline.
Arch Router is a powerful feature in Arch that allows your application to dynamically change the response LLM based on user prompts.
Arch Router matches user prompts to high-level task categories specified by developers (e.g., FAQ answer, creative writing, code generation), and routes each query to the corresponding model or pipeline.
This developer-first approach makes routing decisions more transparent and adaptable, reflecting the practical definitions of quality that matter in production environments.