mirror of
https://github.com/katanemo/plano.git
synced 2026-06-08 14:55:14 +02:00
e448479d3b
Mirrors the pii_anonymizer demo: a FastAPI input/output filter pair that delegates PII detection to the Peyeeye API (https://api.peyeeye.ai). - /redact/{path:path} redacts user text in chat completions, Anthropic messages, and Responses-API request bodies. - /rehydrate/{path:path} restores placeholders in the LLM response, then best-effort deletes the stateful session. Fail-closed semantics: any unexpected response shape from /v1/redact, or a length mismatch between sent and returned text counts, raises a 502 rather than forwarding partially-redacted data. Auth errors map to 500. Stateful (default) and stateless (sealed skey_... blob) session modes are both supported via PEYEEYE_SESSION_MODE. Includes 24 pytest cases covering the round trip, length-guard, unexpected-shape guard, multimodal content lists, Anthropic and Responses formats, and stateless mode. |
||
|---|---|---|
| .. | ||
| advanced | ||
| agent_orchestration | ||
| filter_chains | ||
| getting_started | ||
| integrations | ||
| llm_routing | ||
| shared | ||
| README.md | ||
Plano Demos
This directory contains demos showcasing Plano's capabilities as an AI-native proxy for agentic applications.
Getting Started
| Demo | Description |
|---|---|
| Weather Forecast | Core function calling with a weather query agent, interactive chat UI, and Jaeger tracing |
| LLM Gateway | Key management and dynamic routing to multiple LLM providers with header-based model override |
LLM Routing
| Demo | Description |
|---|---|
| Preference-Based Routing | Routes prompts to LLMs based on user-defined preferences and task type (e.g. code generation vs. understanding) |
| Model Alias Routing | Maps semantic aliases (arch.summarize.v1) to provider-specific models for centralized governance |
| Claude Code Router | Extends Claude Code with multi-provider access and preference-aligned routing for coding tasks |
| Codex Router | Extends Codex CLI with multi-provider access and preference-aligned routing for coding tasks |
Agent Orchestration
| Demo | Description |
|---|---|
| Travel Agents | Multi-agent travel booking with weather and flight agents, intelligent routing, and OpenTelemetry tracing |
| Multi-Agent CrewAI & LangChain | Framework-agnostic orchestration combining CrewAI and LangChain agents in unified conversations |
Filter Chains
| Demo | Description |
|---|---|
| HTTP Filter | RAG agent with filter chains for input validation, query rewriting, and context building |
| MCP Filter | RAG agent using MCP-based filters for domain validation, query optimization, and knowledge base retrieval |
Integrations
| Demo | Description |
|---|---|
| Ollama | Use Ollama as a local LLM provider through Plano |
| Spotify Bearer Auth | Bearer token authentication for third-party APIs (Spotify new releases and top tracks) |
Advanced
| Demo | Description |
|---|---|
| Currency Exchange | Function calling with public REST APIs (Frankfurter currency exchange) |
| Stock Quote | Protected REST API integration with access key management |
| Multi-Turn RAG | Multi-turn conversational RAG agent for answering questions about energy sources |
| Model Choice Test Harness | Evaluation framework for safely testing and switching between models with benchmark fixtures |