plano/crates
raheelshahzad 851d8a3054 feat: add support for retrying LLM requests on 429 ratelimits (#697)
- Added 'retry_on_ratelimit' configuration to LlmProvider.
- Implemented a retry loop in the LLM handler to automatically failover to an alternative model when a 429 status is received.
- Added comprehensive unit tests for fallback selection and failover logic.
- Ensured default behavior is unchanged when the feature is disabled.
2026-02-09 20:52:29 -08:00
..
.vscode use standard tracing and logging in brightstaff (#721) 2026-02-09 13:33:27 -08:00
brightstaff feat: add support for retrying LLM requests on 429 ratelimits (#697) 2026-02-09 20:52:29 -08:00
common feat: add support for retrying LLM requests on 429 ratelimits (#697) 2026-02-09 20:52:29 -08:00
hermesllm upgrade rust to 1.93.0 and fix pre-commit (#720) 2026-02-02 11:03:12 -08:00
llm_gateway use standard tracing and logging in brightstaff (#721) 2026-02-09 13:33:27 -08:00
prompt_gateway upgrade rust to 1.93.0 and fix pre-commit (#720) 2026-02-02 11:03:12 -08:00
build.sh feat: add support for retrying LLM requests on 429 ratelimits (#697) 2026-02-09 20:52:29 -08:00
Cargo.lock use standard tracing and logging in brightstaff (#721) 2026-02-09 13:33:27 -08:00
Cargo.toml use standard tracing and logging in brightstaff (#721) 2026-02-09 13:33:27 -08:00