plano/README.md

26 lines
1.3 KiB
Markdown
Raw Normal View History

2024-07-09 13:36:42 -07:00
A open source project for developers to build and secure faster, more personalized generative AI apps. Katanemo is a high performance gateway designed with state of the art (SOTA) fast LLMs to process, route and evaluate prompts.
2024-08-01 13:22:47 -07:00
# Demos
2024-08-01 13:25:42 -07:00
## Complete
2024-09-10 14:27:14 -07:00
* [Weather Forecast](demos/function-calling/README.md)
2024-08-01 13:25:42 -07:00
* Showing function calling cabaility
## In progress
* Network Co-pilot
## Not Started
* Show routing between different prompt targets (keyword search vs. top-k semantic search).
* Show routing between different prompt-resolver vs RAG-based resolver targets.
* Text Summarization Based on Lightweight vs. Thoughtful Dialogue using OpenAI
* Show conversational and system observability metrics. This includes topic/intent detection
* Show how we can help developers implement safeguards customized to their application requirements and responsible AI policies.
2024-08-01 13:22:47 -07:00
# Dev setup
## Pre-commit
Use instructions at [pre-commit.com](https://pre-commit.com/#install) to set it up for your machine. Once installed make sure github hooks are setup, so that when you upstream your change pre-commit hooks can run and validate your change. Follow command below to setup github hooks,
```sh
2024-08-01 13:26:42 -07:00
$ brew install pre-commit
$ pre-commit install
pre-commit installed at .git/hooks/pre-commit
```