apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-17 15:25:17 +02:00
Code Issues Projects Releases Packages Wiki Activity

LLM router doc fixes

Browse source
This commit is contained in:
Salman Paracha 2025-06-16 17:51:14 -07:00
parent 603238b135
commit e65be1a460
2 changed files with 7 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -5,7 +5,7 @@
_The AI-native proxy server and the universal data plane for AI agents._<br><br>
Arch implements **pesky**, low-level infrastructure patterns in building AI agents like quickly clarifying vague user inputs, routing prompts to the right agents or specialized Model Context Protocol (MCP) tools, and providing unified access and observability to large language models (LLMs) - all without locking you into a framework. <br>With Arch, you shup faster by focusing on the high-level logic of your agents.
Arch implements **pesky**, low-level work in building AI agents like clarifying vague user inputs, routing prompts to the right agents, calling specific tools for common tasks, and providing unified access and observability to large language models (LLMs) - all without locking you into a framework. <br>With Arch, you shup faster by focusing on the high-level logic of your agents.
[Quickstart](#Quickstart) •

7
docs/source/guides/llm_router.rst
View file

@ -3,7 +3,12 @@
LLM Routing
==============================================================
LLM Router is an intelligent routing system that automatically selects the most appropriate large language model (LLM) for each user request based on the intent, domain, and complexity of the prompt. This enables optimal performance, cost efficiency, and response quality by matching requests with the most suitable model from your available LLM fleet.
With the rapid proliferation of large language models (LLM) — each optimized for different strengths, style, or latency/cost profile — routing has become an essential technique to operationalize the use of different models.
Arch Router is an intelligent routing system that automatically selects the most appropriate LLM for each user request based on user-defined usage preferences. Specifically Arch-Router guides model selection by matching queries to user-defined domains (e.g., finance and healthcare) and action types (e.g., code generation, image editing, etc.).
Our preference-aligned approach matches practical definitions of performance in the real world and makes routing decisions more transparent and adaptable.
This enables optimal performance, cost efficiency, and response quality by matching requests with the most suitable model from your available LLM fleet.
Routing Workflow