2026-02-17 03:09:28 -08:00
|
|
|
# Function calling
|
|
|
|
|
|
|
|
|
|
This demo shows how you can use Plano's core function calling capabilities.
|
|
|
|
|
|
|
|
|
|
# Starting the demo
|
|
|
|
|
|
|
|
|
|
1. Please make sure the [pre-requisites](https://github.com/katanemo/arch/?tab=readme-ov-file#prerequisites) are installed correctly
|
|
|
|
|
2. Start Plano
|
|
|
|
|
|
|
|
|
|
3. ```sh
|
|
|
|
|
sh run_demo.sh
|
|
|
|
|
```
|
2026-03-11 12:49:36 -07:00
|
|
|
4. Test with curl:
|
|
|
|
|
```sh
|
|
|
|
|
curl http://localhost:10000/v1/chat/completions \
|
|
|
|
|
-H "Content-Type: application/json" \
|
|
|
|
|
-d '{"model": "gpt-4o", "messages": [{"role": "user", "content": "how is the weather in San Francisco?"}]}'
|
|
|
|
|
```
|
2026-02-17 03:09:28 -08:00
|
|
|
|
|
|
|
|
Here is a sample interaction,
|
|
|
|
|
<img width="575" alt="image" src="https://github.com/user-attachments/assets/e0929490-3eb2-4130-ae87-a732aea4d059">
|
|
|
|
|
|
2026-03-11 12:49:36 -07:00
|
|
|
## Using the Chat UI and Tracing (optional)
|
|
|
|
|
|
|
|
|
|
To start AnythingLLM (chat UI) and other optional services, pass `--with-ui`:
|
|
|
|
|
|
|
|
|
|
```sh
|
|
|
|
|
sh run_demo.sh --with-ui
|
|
|
|
|
```
|
2026-02-17 03:09:28 -08:00
|
|
|
|
2026-03-11 12:49:36 -07:00
|
|
|
- Navigate to http://localhost:3001/ for AnythingLLM
|
|
|
|
|
- Navigate to http://localhost:16686/ for Jaeger tracing UI
|
2026-02-17 03:09:28 -08:00
|
|
|
|
|
|
|
|
### Stopping Demo
|
|
|
|
|
|
|
|
|
|
1. To end the demo, run the following command:
|
|
|
|
|
```sh
|
|
|
|
|
sh run_demo.sh down
|
|
|
|
|
```
|