plano/demos/integrations/ollama
Adil Hafeez 5a4f8cb321
Standardize demo configs and CLI templates to v0.3.0
- Update all demo config files to version v0.3.0
- Rename llm_providers → model_providers across all configs
- Modernize listener format from object to array style
  (e.g. listeners: [{type: model, name:, port:}])
- Replace chatbot_ui with AnythingLLM in 6 docker-compose files
- Remove prometheus/grafana services from llm_gateway and
  preference_based_routing docker-compose files
- Add tracing: random_sampling: 100 to configs that lacked it
- Update 3 CLI init templates (coding_agent_routing,
  preference_aware_routing, conversational_state_v1_responses)
- Fix test_init.py assertion for model_providers key

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-15 01:43:59 -08:00
..
config.yaml Standardize demo configs and CLI templates to v0.3.0 2026-02-15 01:43:59 -08:00
docker-compose.yaml Standardize demo configs and CLI templates to v0.3.0 2026-02-15 01:43:59 -08:00
README.md Clean up dead demos and restructure directory layout 2026-02-15 01:43:31 -08:00
run_demo.sh Clean up dead demos and restructure directory layout 2026-02-15 01:43:31 -08:00

This demo shows how you can use ollama as upstream LLM.

Before you can start the demo please make sure you have ollama up and running. You can use command ollama run llama3.2 to start llama 3.2 (3b) model locally at port 11434.