plano/demos/currency_exchange_ollama
Adil Hafeez 12e4d8d8b8 add support for custom llm with ssl support
Add support for using custom llm that are served through https protocol.
2025-01-24 12:40:45 -08:00
..
arch_config.yaml add support for custom llm with ssl support 2025-01-24 12:40:45 -08:00
docker-compose.yaml add support for using custom upstream llm (#365) 2025-01-17 18:25:55 -08:00
docker-compose_honeycomb.yaml add docker-compose file for honeycomb tracing (#377) 2025-01-22 14:02:59 -08:00
README.md add support for using custom upstream llm (#365) 2025-01-17 18:25:55 -08:00
run_demo.sh add support for using custom upstream llm (#365) 2025-01-17 18:25:55 -08:00

This demo shows how you can use ollama as upstream LLM.

Before you can start the demo please make sure you have ollama up and running. You can use command ollama run llama3.2 to start llama 3.2 (3b) model locally at port 11434.