plano/demos/use_cases/ollama
2025-03-17 11:50:14 -07:00
..
arch_config.yaml fix ollama demo - add egress endpoint for llm routing (#433) 2025-03-17 11:50:14 -07:00
docker-compose.yaml fix ollama demo - add egress endpoint for llm routing (#433) 2025-03-17 11:50:14 -07:00
docker-compose_honeycomb.yaml refactor demos (#398) 2025-02-07 18:45:42 -08:00
README.md refactor demos (#398) 2025-02-07 18:45:42 -08:00
run_demo.sh refactor demos (#398) 2025-02-07 18:45:42 -08:00

This demo shows how you can use ollama as upstream LLM.

Before you can start the demo please make sure you have ollama up and running. You can use command ollama run llama3.2 to start llama 3.2 (3b) model locally at port 11434.