mirror of
https://github.com/katanemo/plano.git
synced 2026-06-26 15:39:40 +02:00
Add three state management components: - LatencyBlockStateManager: tracks providers blocked due to high latency with configurable block duration and scope - LatencyTriggerCounter: counts consecutive latency threshold breaches before triggering provider blocking - RetryAfterStateManager: honors Retry-After headers with per-provider/model/endpoint blocking scope Signed-off-by: Troy Mitchell <i@troy-y.org> |
||
|---|---|---|
| .. | ||
| backoff.rs | ||
| error_detector.rs | ||
| error_response.rs | ||
| latency_block_state.rs | ||
| latency_trigger.rs | ||
| mod.rs | ||
| retry_after_state.rs | ||