6 commits

Author	SHA1	Message	Date
cybermaggedon	f350abb415	Maint/asyncio (#305) ... * Move to asyncio services, even though everything is largely sync	2025-02-11 23:24:46 +00:00
cybermaggedon	0e03bc05a4	Refactor rate limit handling (#280) ... * - Refactored retry for rate limits into the base class - ConsumerProducer is derived from Consumer to simplify code - Added rate_limit_count metrics for rate limit events * Add rate limit events to VertexAI and Google AI Studio * Added Grafana rate limit dashboard * Add rate limit handling to all LLMs	2025-01-27 17:04:49 +00:00
cybermaggedon	65cda7b276	Implement system in text completion API (#137) ... * Add system prompt to LLM invocation * Added system parameter to LLMs * Added to Bedrock and VertexAI	2024-11-05 22:46:17 +00:00
cybermaggedon	04617a81f7	Fix env var passing (#120)	2024-10-15 20:02:21 +01:00
cybermaggedon	86288339cf	Feature/environment var creds (#116) ... - Change templates to interpolate environment variables in docker compose - Change templates to invoke secrets for environment variable credentials in K8s configuration - Update LLMs to pull in credentials from environment variables if not specified	2024-10-15 00:34:52 +01:00
cybermaggedon	9b91d5eee3	Feature/pkgsplit (#83) ... * Starting to spawn base package * More package hacking * Bedrock and VertexAI * Parquet split * Updated templates * Utils	2024-09-30 19:36:09 +01:00

Renamed from trustgraph-core/trustgraph/model/text_completion/cohere/llm.py (Browse further)