apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-26 01:06:25 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 3
plano/demos/function_calling
History
Salman Paracha 95a0f1be5b
updated archgw cli to pull from archgw_modelserver from pypi (#169) 
* updated archgw cli to pull from archgw_modelserver from pypi

* fix image name

* update rev

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
Co-authored-by: Adil Hafeez <adil@katanemo.com>
2024-10-09 21:00:26 -07:00
..
api_server updated archgw cli to pull from archgw_modelserver from pypi (#169) 2024-10-09 21:00:26 -07:00
grafana improve service names (#54) 2024-09-17 08:47:35 -07:00
prometheus changes prometheus config target to arch so that data collection works (#98) 2024-09-30 14:35:21 -07:00
arch_config.yaml make ratelimit section optional (#168) 2024-10-09 19:53:00 -07:00
docker-compose.yaml fixed function calling arch config yaml 2024-10-09 17:10:54 -07:00
Dockerfile-opentelemetry Split listener (#141) 2024-10-08 16:24:08 -07:00
otel-collector-config.yaml Split listener (#141) 2024-10-08 16:24:08 -07:00
README.md fixed cli to use poetry as well. this way we make it easy to have the… (#160) 2024-10-09 15:53:12 -07:00
run_demo.sh fixed cli to use poetry as well. this way we make it easy to have the… (#160) 2024-10-09 15:53:12 -07:00

README.md

Function calling

This demo shows how you can use Arch's core function calling capabilites.

Starting the demo

  1. Please make sure the pre-requisites are installed correctly
  2. Start Arch 
    sh run_demo.sh
  3. Navigate to http://localhost:18080/
  4. You can type in queries like "how is the weather?"

Observability

Arch gateway publishes stats endpoint at http://localhost:19901/stats. In this demo we are using prometheus to pull stats from arch and we are using grafana to visalize the stats in dashboard. To see grafana dashboard follow instructions below,

  1. Start grafana and prometheus using following command 
    docker compose --profile monitoring up
  2. Navigate to http://localhost:3000/ to open grafana UI (use admin/grafana as credentials)
  3. From grafana left nav click on dashboards and select "Intelligent Gateway Overview" to view arch gateway stats

Here is a sample interaction, image