mirror of
https://github.com/katanemo/plano.git
synced 2026-05-15 11:02:39 +02:00
3a6a672c9d
Introduce a new mock-based E2E test suite that uses pytest_httpserver to simulate LLM provider responses, eliminating the need for real API keys on PR builds. The mock tests cover model alias routing, protocol transformation (OpenAI↔Anthropic), Responses API passthrough/translation, streaming, tool calls, thinking mode, and multi-turn state management. CI changes: - Add mock-e2e-tests job (zero secrets, runs on every PR) - Gate all live E2E jobs to main pushes + nightly schedule - Scope secrets to only the keys each job actually needs - Add daily cron schedule for full live test coverage Also relaxes exact-match assertions in live e2e tests to structural checks (non-null, non-empty) since LLM output is non-deterministic. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| .vscode | ||
| common.py | ||
| common.sh | ||
| config.yaml | ||
| config_mock_llm.yaml | ||
| conftest.py | ||
| docker-compose.mock.yaml | ||
| docker-compose.yaml | ||
| pyproject.toml | ||
| test_llm_gateway.py | ||
| test_model_alias_routing.py | ||
| test_prompt_gateway.py | ||
| test_responses_api.py | ||
| test_streaming.py | ||
| uv.lock | ||