apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-25 16:56:24 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 3
plano/demos/samples_python/multi_turn_rag_agent
History
Salman Paracha 88c2bd1851
removing model_server python module to brightstaff (function calling) (#615) 
* adding function_calling functionality via rust

* fixed rendered YAML file

* removed model_server from envoy.template and forwarding traffic to bright_staff

* fixed bugs in function_calling.rs that were breaking tests. All good now

* updating e2e test to clean up disk usage

* removing Arch* models to be used as a default model if one is not specified

* if the user sets arch-function base_url we should honor it

* fixing demos as we needed to pin to a particular version of huggingface_hub else the chatbot ui wouldn't build

* adding a constant for Arch-Function model name

* fixing some edge cases with calls made to Arch-Function

* fixed JSON parsing issues in function_calling.rs

* fixed bug where the raw response from Arch-Function was re-encoded

* removed debug from supervisord.conf

* commenting out disk cleanup

* adding back disk space

---------

Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-288.local>
Co-authored-by: Salman Paracha <salmanparacha@MacBook-Pro-342.local>
2025-11-22 12:55:00 -08:00
..
arch_config.yaml better model names (#517) 2025-07-11 16:42:16 -07:00
docker-compose.yaml refactor demos (#398) 2025-02-07 18:45:42 -08:00
Dockerfile refactor demos (#398) 2025-02-07 18:45:42 -08:00
main.py refactor demos (#398) 2025-02-07 18:45:42 -08:00
mutli-turn-example.png refactor demos (#398) 2025-02-07 18:45:42 -08:00
README.md refactor demos (#398) 2025-02-07 18:45:42 -08:00
requirements.txt removing model_server python module to brightstaff (function calling) (#615) 2025-11-22 12:55:00 -08:00
run_demo.sh refactor demos (#398) 2025-02-07 18:45:42 -08:00

README.md

Multi-Turn Agentic Demo (RAG)

This demo showcases how the Arch can be used to build accurate multi-turn RAG agent by just writing simple APIs.

Example of Multi-turn Interaction

Energy Source Q/A

Provides information about various energy sources and considerations.

  • Endpoint: /agent/energy_source
  • Parameters:
    • energy_source (str, required): A source of energy (e.g., renewable, fossil).
    • consideration (str, optional): A specific type of consideration for an energy source (e.g., cost, economic, technology).

Starting the demo

  1. Please make sure the pre-requisites are installed correctly
  2. Start Arch 
    sh run_demo.sh
  3. Navigate to http://localhost:18080
  4. Ask "give me information about renewable energy sources"