plano/demos/getting_started/weather_forecast/README.md

40 lines
1 KiB
Markdown
Raw Normal View History

# Function calling
This demo shows how you can use Plano's core function calling capabilities.
# Starting the demo
1. Please make sure the [pre-requisites](https://github.com/katanemo/arch/?tab=readme-ov-file#prerequisites) are installed correctly
2. Start Plano
3. ```sh
sh run_demo.sh
```
2026-03-11 12:49:36 -07:00
4. Test with curl:
```sh
curl http://localhost:10000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"model": "gpt-4o", "messages": [{"role": "user", "content": "how is the weather in San Francisco?"}]}'
```
Here is a sample interaction,
<img width="575" alt="image" src="https://github.com/user-attachments/assets/e0929490-3eb2-4130-ae87-a732aea4d059">
2026-03-11 12:49:36 -07:00
## Using the Chat UI and Tracing (optional)
To start AnythingLLM (chat UI) and other optional services, pass `--with-ui`:
```sh
sh run_demo.sh --with-ui
```
2026-03-11 12:49:36 -07:00
- Navigate to http://localhost:3001/ for AnythingLLM
- Navigate to http://localhost:16686/ for Jaeger tracing UI
### Stopping Demo
1. To end the demo, run the following command:
```sh
sh run_demo.sh down
```