plano/demos/integrations/ollama
2026-03-04 15:40:01 -08:00
..
config.yaml replace host.docker.internal with localhost in configs and docs 2026-03-04 15:40:01 -08:00
docker-compose.yaml Overhaul demos directory: cleanup, restructure, and standardize configs (#760) 2026-02-17 03:09:28 -08:00
README.md Overhaul demos directory: cleanup, restructure, and standardize configs (#760) 2026-02-17 03:09:28 -08:00
run_demo.sh remove --docker from demo scripts, native is default 2026-03-04 06:23:00 -08:00

This demo shows how you can use ollama as upstream LLM.

Before you can start the demo please make sure you have ollama up and running. You can use command ollama run llama3.2 to start llama 3.2 (3b) model locally at port 11434.