trustgraph/trustgraph-vertexai/trustgraph/model/text_completion/vertexai
cybermaggedon 0e03bc05a4
Refactor rate limit handling (#280)
* - Refactored retry for rate limits into the base class
- ConsumerProducer is derived from Consumer to simplify code
- Added rate_limit_count metrics for rate limit events

* Add rate limit events to VertexAI and Google AI Studio

* Added Grafana rate limit dashboard

* Add rate limit handling to all LLMs
2025-01-27 17:04:49 +00:00
..
__init__.py Fix VertexAI package. Add Python packaging to Makefile. (#85) 2024-09-30 20:50:20 +01:00
__main__.py Fix VertexAI package. Add Python packaging to Makefile. (#85) 2024-09-30 20:50:20 +01:00
llm.py Refactor rate limit handling (#280) 2025-01-27 17:04:49 +00:00