apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-05-18 13:45:15 +02:00
Code Issues Projects Releases Packages Wiki Activity
Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic. https://planoai.dev
48 commits 509 branches 66 tags 85 MiB
Find a file
José Ulises Niño Rivera 4dd1f3693e
Add the Ratelimit module (#34) 
Signed-off-by: José Ulises Niño Rivera <junr03@users.noreply.github.com>
2024-08-28 11:11:05 -07:00
.github/workflows Add initial integration style tests (#20) 2024-07-25 14:41:36 -07:00
chatbot-ui Add support for local llm (mistral 7b) (#31) 2024-08-06 23:40:06 -07:00
config_generator Improve demo experience (#28) 2024-07-31 17:13:39 -07:00
demos Add support for local llm (mistral 7b) (#31) 2024-08-06 23:40:06 -07:00
embedding-server Add support for local llm (mistral 7b) (#31) 2024-08-06 23:40:06 -07:00
envoyfilter Add the Ratelimit module (#34) 2024-08-28 11:11:05 -07:00
open-message-format@1e838f3f40 update open-message-format (#30) 2024-07-31 15:56:13 -07:00
.gitignore Add support for local llm (mistral 7b) (#31) 2024-08-06 23:40:06 -07:00
.gitmodules Use open-message-format to serialize and deserialize embeddings api (#18) 2024-07-23 11:56:49 -07:00
.pre-commit-config.yaml Add workflow logic for weather forecast demo (#24) 2024-07-30 16:23:23 -07:00
gateway.code-workspace Add support for local llm (mistral 7b) (#31) 2024-08-06 23:40:06 -07:00
README.md Update README.md 2024-08-01 13:26:42 -07:00

README.md

A open source project for developers to build and secure faster, more personalized generative AI apps. Katanemo is a high performance gateway designed with state of the art (SOTA) fast LLMs to process, route and evaluate prompts.

Demos

Complete

In progress

  • Network Co-pilot

Not Started

  • Show routing between different prompt targets (keyword search vs. top-k semantic search).
  • Show routing between different prompt-resolver vs RAG-based resolver targets.
  • Text Summarization Based on Lightweight vs. Thoughtful Dialogue using OpenAI
  • Show conversational and system observability metrics. This includes topic/intent detection
  • Show how we can help developers implement safeguards customized to their application requirements and responsible AI policies.

Dev setup

Pre-commit

Use instructions at pre-commit.com to set it up for your machine. Once installed make sure github hooks are setup, so that when you upstream your change pre-commit hooks can run and validate your change. Follow command below to setup github hooks,

$ brew install pre-commit
$ pre-commit install
pre-commit installed at .git/hooks/pre-commit