apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-27 09:46:28 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic. https://planoai.dev
153 commits 498 branches 66 tags 80 MiB
Find a file
Salman Paracha 976b2eaae0
fixing docs so that GH pages picks up the right CNAME for DNS (#135) 
* fixing docs so that GH pages picks up the right CNAME for DNS

* updating workflow to pick CNAME

* making sure to correctly set permissions on the build/html directory

* fixing GH actions issues with CNAME

* updated docker build command to run as local user

* fixed the CNAME issue and udpated GH actions

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-07 11:03:02 -07:00
.github/workflows fixing docs so that GH pages picks up the right CNAME for DNS (#135) 2024-10-07 11:03:02 -07:00
arch Serialize tool calls for Arch FC (#131) 2024-10-07 00:03:25 -07:00
chatbot_ui Serialize tool calls for Arch FC (#131) 2024-10-07 00:03:25 -07:00
demos don't compute embeddings for names and other fixes see description (#126) 2024-10-05 19:25:16 -07:00
docs fixing docs so that GH pages picks up the right CNAME for DNS (#135) 2024-10-07 11:03:02 -07:00
model_server Serialize tool calls for Arch FC (#131) 2024-10-07 00:03:25 -07:00
public_types Doc Update (#129) 2024-10-06 16:54:34 -07:00
www added index.html and made minor README.md edits (#130) 2024-10-06 17:16:48 -07:00
.gitignore model server build (#127) 2024-10-06 18:21:43 -07:00
.gitmodules Remove OMF (#78) 2024-09-24 15:18:20 -07:00
.pre-commit-config.yaml add files for local development (#133) 2024-10-06 23:10:13 -07:00
gateway.code-workspace archgw cli (#117) 2024-10-03 18:21:27 -07:00
README.md added index.html and made minor README.md edits (#130) 2024-10-06 17:16:48 -07:00

README.md

Arch Gateway Logo

Build fast, robust, and personalized GenAI apps (agents, assistants, etc.)

Arch is an intelligent Layer 7 gateway designed for generative AI apps, AI agents, and co-pilots that work with prompts. Engineered with purpose-built LLMs, Arch handles the critical but undifferentiated tasks related to the handling and processing of prompts, including detecting and rejecting jailbreak attempts, intelligently calling "backend" APIs to fulfill the user's request represented in a prompt, routing to and offering disaster recovery between upstream LLMs, and managing the observability of prompts and LLM interactions in a centralized way.

Arch is built on (and by the core contributors of) the wildly popular and robust Envoy Proxy with the belief that:

Prompts are nuanced and opaque user requests, which require the same capabilities as traditional HTTP requests including secure handling, intelligent routing, robust observability, and integration with backend (API) systems for personalization – all outside business logic.

Contact

To get in touch with us, please join our discord server. We will be monitoring that actively.

Demos

Complete

In progress

  • Network Co-pilot

Not Started

  • Show routing between different prompt targets (keyword search vs. top-k semantic search).
  • Show routing between different prompt-resolver vs RAG-based resolver targets.
  • Text Summarization Based on Lightweight vs. Thoughtful Dialogue using OpenAI
  • Show conversational and system observability metrics. This includes topic/intent detection
  • Show how we can help developers implement safeguards customized to their application requirements and responsible AI policies.

Dev setup

Pre-commit

Use instructions at pre-commit.com to set it up for your machine. Once installed make sure github hooks are setup, so that when you upstream your change pre-commit hooks can run and validate your change. Follow command below to setup github hooks,

$ brew install pre-commit
$ pre-commit install
pre-commit installed at .git/hooks/pre-commit