apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-04-25 00:36:34 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 3
plano/e2e_tests
History
Adil Hafeez d3c17c7abd
move custom tracer to llm filter (#267)
2024-11-15 10:44:01 -08:00
..
.vscode add prefill and test (#236) 2024-11-07 11:59:29 -08:00
common.py add prefill and test (#236) 2024-11-07 11:59:29 -08:00
common_scripts.sh Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
poetry.lock Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
pyproject.toml Use large github action machine to run e2e tests (#230) 2024-10-30 17:54:51 -07:00
README.md update docs with weather_forecast path (#253) 2024-11-08 10:00:15 -08:00
run_e2e_tests.sh move custom tracer to llm filter (#267) 2024-11-15 10:44:01 -08:00
test_llm_gateway.py Add support for streaming and fixes few issues (see description) (#202) 2024-10-28 17:05:06 -07:00
test_prompt_gateway.py add support for jaeger tracing (#229) 2024-11-07 22:11:00 -06:00

README.md

e2e tests

e2e tests for arch llm gateway and prompt gateway

To be able to run e2e tests successfully run_e2e_script prepares environment in following way,

  1. build and start weather_forecast demo (using docker compose)
  2. build, install and start model server async (using poetry)
  3. build and start arch gateway (using docker compose)
  4. wait for model server to be ready
  5. wait for arch gateway to be ready
  6. start e2e tests (using poetry)
    1. runs llm gateway tests for llm routing
    2. runs prompt gateway tests to test function calling, parameter gathering and summarization
  7. cleanup
    1. stops arch gateway
    2. stops model server
    3. stops weather_forecast demo

How to run

To run locally make sure that following requirements are met.

Requirements

  • Python 3.10
  • Poetry
  • Docker

Running tests locally

sh run_e2e_test.sh