apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-29 02:46:28 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

fixed cli to use poetry as well. this way we make it easy to have the… (#160)

Browse source
This commit is contained in:
Salman Paracha 2024-10-09 15:53:12 -07:00 • committed by GitHub
parent e81ca8d5cf
commit 1acf43ff7a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
26 changed files with 771 additions and 116 deletions
Download patch file Download diff file Expand all files Collapse all files

18
demos/function_calling/README.md
View file

@ -1,22 +1,14 @@
# Function calling
This demo shows how you can use Arch's function calling capabilites.
This demo shows how you can use Arch's core function calling capabilites.
# Starting the demo
1. Create `.env` file and set OpenAI key using env var `OPENAI_API_KEY`
1. Please make sure the [pre-requisites](../../../README.md?tab=readme-ov-file#prerequisites) are installed correctly
2. Start Arch
```sh
archgw up arch_config.yaml
sh run_demo.sh
```
3. Start Network Agent
```sh
docker compose up
```
4. Navigate to http://localhost:18080/
4. You can type in queries like "how is the weather in Seattle"
- You can also ask follow up questions like "show me sunny days"
6. To see metrics navigate to "http://localhost:3000/" (use admin/grafana for login)
- Open up dahsboard named "Intelligent Gateway Overview"
- On this dashboard you can see reuqest latency and number of requests
3. Navigate to http://localhost:18080/
4. You can type in queries like "how is the weather?"
# Observability
Arch gateway publishes stats endpoint at http://localhost:19901/stats. In this demo we are using prometheus to pull stats from arch and we are using grafana to visalize the stats in dashboard. To see grafana dashboard follow instructions below,