trustgraph/trustgraph-flow/trustgraph/model/text_completion/azure_openai
cybermaggedon 0e03bc05a4
Refactor rate limit handling (#280)
* - Refactored retry for rate limits into the base class
- ConsumerProducer is derived from Consumer to simplify code
- Added rate_limit_count metrics for rate limit events

* Add rate limit events to VertexAI and Google AI Studio

* Added Grafana rate limit dashboard

* Add rate limit handling to all LLMs
2025-01-27 17:04:49 +00:00
..
__init__.py AzureOpenAI support (#102) 2024-10-04 14:44:50 +01:00
__main__.py AzureOpenAI support (#102) 2024-10-04 14:44:50 +01:00
llm.py Refactor rate limit handling (#280) 2025-01-27 17:04:49 +00:00