apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-26 09:16:24 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
plano/demos/function_calling/README.md
Salman Paracha 42d4a28e13
updated all demo READMes and minor doc changes (#154) 
* updated all demo READMes and minor doc changes

* minor typo fixes

* updated main Readme

* fixed README and docs

* fixed README and docs

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-261.local>
2024-10-08 23:58:55 -07:00

1.4 KiB
Raw Blame History

Function calling

This demo shows how you can use Arch's function calling capabilites.

Starting the demo

  1. Create .env file and set OpenAI key using env var OPENAI_API_KEY
  2. Start Arch 
    archgw up arch_config.yaml
  3. Start Network Agent 
    docker compose up
  4. Navigate to http://localhost:18080/
  5. You can type in queries like "how is the weather in Seattle"
    • You can also ask follow up questions like "show me sunny days"
  6. To see metrics navigate to "http://localhost:3000/" (use admin/grafana for login)
    • Open up dahsboard named "Intelligent Gateway Overview"
    • On this dashboard you can see reuqest latency and number of requests

Observability

Arch gateway publishes stats endpoint at http://localhost:19901/stats. In this demo we are using prometheus to pull stats from arch and we are using grafana to visalize the stats in dashboard. To see grafana dashboard follow instructions below,

  1. Start grafana and prometheus using following command 
    docker compose --profile monitoring up
  2. Navigate to http://localhost:3000/ to open grafana UI (use admin/grafana as credentials)
  3. From grafana left nav click on dashboards and select "Intelligent Gateway Overview" to view arch gateway stats

Here is a sample interaction, image