- Update all demo config files to version v0.3.0
- Rename llm_providers → model_providers across all configs
- Modernize listener format from object to array style
(e.g. listeners: [{type: model, name:, port:}])
- Replace chatbot_ui with AnythingLLM in 6 docker-compose files
- Remove prometheus/grafana services from llm_gateway and
preference_based_routing docker-compose files
- Add tracing: random_sampling: 100 to configs that lacked it
- Update 3 CLI init templates (coding_agent_routing,
preference_aware_routing, conversational_state_v1_responses)
- Fix test_init.py assertion for model_providers key
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
|
||
|---|---|---|
| .. | ||
| hurl_tests | ||
| config.yaml | ||
| docker-compose.yaml | ||
| Dockerfile | ||
| main.py | ||
| pyproject.toml | ||
| README.md | ||
| run_demo.sh | ||
| uv.lock | ||
Function calling
This demo shows how you can use Plano's core function calling capabilities.
Starting the demo
-
Please make sure the pre-requisites are installed correctly
-
Start Plano
-
sh run_demo.sh -
Navigate to http://localhost:18080/
-
You can type in queries like "how is the weather?"
Observability
Plano gateway publishes stats endpoint at http://localhost:19901/stats. In this demo we are using prometheus to pull stats from Plano and we are using grafana to visalize the stats in dashboard. To see grafana dashboard follow instructions below,
- Start grafana and prometheus using following command
docker compose --profile monitoring up - Navigate to http://localhost:3000/ to open grafana UI (use admin/grafana as credentials)
- From grafana left nav click on dashboards and select "Intelligent Gateway Overview" to view Plano gateway stats
Here is a sample interaction,
Tracing
To see a tracing dashboard follow instructions below,
- For Jaeger, you can either use the default run_demo.sh script or run the following command:
sh run_demo.sh jaeger
- For Logfire, first make sure to add a LOGFIRE_API_KEY to the .env file. You can either use the default run_demo.sh script or run the following command:
sh run_demo.sh logfire
- For Signoz, you can either use the default run_demo.sh script or run the following command:
sh run_demo.sh signoz
If using Jaeger, navigate to http://localhost:16686/ to open Jaeger UI
If using Signoz, navigate to http://localhost:3301/ to open Signoz UI
If using Logfire, navigate to your logfire dashboard that you got the write key from to view the dashboard
Stopping Demo
- To end the demo, run the following command:
sh run_demo.sh down