mirror of
https://github.com/katanemo/plano.git
synced 2026-06-17 15:25:17 +02:00
851d8a3054
- Added 'retry_on_ratelimit' configuration to LlmProvider. - Implemented a retry loop in the LLM handler to automatically failover to an alternative model when a 429 status is received. - Added comprehensive unit tests for fallback selection and failover logic. - Ensured default behavior is unchanged when the feature is disabled.
1 line
118 B
Bash
Executable file
1 line
118 B
Bash
Executable file
cargo build --release --target wasm32-wasip1 -p prompt_gateway -p llm_gateway && cargo build --release -p brightstaff
|