Use intent model from archfc to pick prompt gateway (#328)

This commit is contained in:
Shuguang Chen 2024-12-20 13:25:01 -08:00 committed by GitHub
parent 67b8fd635e
commit ba7279becb
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
151 changed files with 8642 additions and 10932 deletions

34
tests/e2e/README.md Normal file
View file

@ -0,0 +1,34 @@
# e2e tests
e2e tests for arch llm gateway and prompt gateway
To be able to run e2e tests successfully run_e2e_script prepares environment in following way,
1. build and start weather_forecast demo (using docker compose)
1. build, install and start model server async (using poetry)
1. build and start arch gateway (using docker compose)
1. wait for model server to be ready
1. wait for arch gateway to be ready
1. start e2e tests (using poetry)
1. runs llm gateway tests for llm routing
2. runs prompt gateway tests to test function calling, parameter gathering and summarization
2. cleanup
1. stops arch gateway
2. stops model server
3. stops weather_forecast demo
## How to run
To run locally make sure that following requirements are met.
### Requirements
- Python 3.10
- Poetry
- Docker
### Running tests locally
```sh
sh run_e2e_test.sh
```