cybermaggedon 0e03bc05a4 Refactor rate limit handling (#280) ... * - Refactored retry for rate limits into the base class - ConsumerProducer is derived from Consumer to simplify code - Added rate_limit_count metrics for rate limit events * Add rate limit events to VertexAI and Google AI Studio * Added Grafana rate limit dashboard * Add rate limit handling to all LLMs		2025-01-27 17:04:49 +00:00
..
dashboards	Refactor rate limit handling (#280)	2025-01-27 17:04:49 +00:00
provisioning	K8s (#58)	2024-09-07 18:59:38 +01:00