apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-27 17:56:28 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
plano/demos/network_copilot/README.md
Sampreeth Sarma ed6a9139e6
demos for network copilot and sql analyzer (#57) 
* pulled from main branch after adding enums and made changes

* added sql_analyzer folder and built a demo for Employee stats function calling. "top_employees" and "aggregate_stats".

* sql_anayzer

* After addressing PR comments

* PR comments

* PR comments

* Addeed Network Analyzer FC Code

* Added network Analyzer code for diff timeframes

* Network Copilot and Employee Details demos are updated with their descriptions and resolved the PR comments

* Added 2nd function in network copilot

* Added 2nd function in network copilot

* Added 2nd function in network copilot

* Added 2nd function in network copilot

* Added 2nd function in network copilot
2024-09-19 11:40:31 -07:00

1.5 KiB
Raw Blame History

Function calling

This demo shows how you can use intelligent prompt gateway as a network copilot that could give information about correlation between packet loss with device reboots, downs, or maintainence. This demo assumes you are using ollama running natively. If you want to run ollama running inside docker then please update ollama endpoint in docker-compose file.

Startig the demo

  1. Ensure that submodule is up to date 
    git submodule sync --recursive
  2. Create .env file and set OpenAI key using env var OPENAI_API_KEY
  3. Start services 
    docker compose up
  4. Download Bolt-FC model. This demo assumes we have downloaded Bolt-Function-Calling-1B:Q4_K_M to local folder.
  5. If running ollama natively run 
    ollama serve
  6. Create model file in ollama repository 
    ollama create Bolt-Function-Calling-1B:Q4_K_M -f Bolt-FC-1B-Q4_K_M.model_file
  7. Navigate to http://localhost:18080/
  8. You can type in queries like "show me any packet drops due to interface failure in the past 3 days"
    • You can also ask follow up questions like "show me just the ones with maximum 200 in errors"
  9. To see metrics navigate to "http://localhost:3000/" (use admin/grafana for login)
    • Open up dahsboard named "Intelligent Gateway Overview"
    • On this dashboard you can see reuqest latency and number of requests