mirror of
https://github.com/katanemo/plano.git
synced 2026-05-30 14:25:15 +02:00
38f7691163
* add support for custom llm with ssl support Add support for using custom llm that are served through https protocol. * add instructions on how to add custom inference endpoint * fix formatting * add more details * Apply suggestions from code review Co-authored-by: Salman Paracha <salman.paracha@gmail.com> * Apply suggestions from code review * fix precommit --------- Co-authored-by: Salman Paracha <salman.paracha@gmail.com> |
||
|---|---|---|
| .. | ||
| arch_config.yaml | ||
| docker-compose.yaml | ||
| docker-compose_honeycomb.yaml | ||
| README.md | ||
| run_demo.sh | ||
This demo shows how you can use ollama as upstream LLM.
Before you can start the demo please make sure you have ollama up and running. You can use command ollama run llama3.2 to start llama 3.2 (3b) model locally at port 11434.