7 commits

Author	SHA1	Message	Date
cybermaggedon	64e42bed6f	Fix/async send typos (#322)	2025-03-19 00:03:58 +00:00
cybermaggedon	f350abb415	Maint/asyncio (#305) ... * Move to asyncio services, even though everything is largely sync	2025-02-11 23:24:46 +00:00
cybermaggedon	0e03bc05a4	Refactor rate limit handling (#280) ... * - Refactored retry for rate limits into the base class - ConsumerProducer is derived from Consumer to simplify code - Added rate_limit_count metrics for rate limit events * Add rate limit events to VertexAI and Google AI Studio * Added Grafana rate limit dashboard * Add rate limit handling to all LLMs	2025-01-27 17:04:49 +00:00
cybermaggedon	65cda7b276	Implement system in text completion API (#137) ... * Add system prompt to LLM invocation * Added system parameter to LLMs * Added to Bedrock and VertexAI	2024-11-05 22:46:17 +00:00
cybermaggedon	04617a81f7	Fix env var passing (#120)	2024-10-15 20:02:21 +01:00
cybermaggedon	86288339cf	Feature/environment var creds (#116) ... - Change templates to interpolate environment variables in docker compose - Change templates to invoke secrets for environment variable credentials in K8s configuration - Update LLMs to pull in credentials from environment variables if not specified	2024-10-15 00:34:52 +01:00
cybermaggedon	c26ada08c2	Fix VertexAI package. Add Python packaging to Makefile. (#85) ... Bump version & generate templates.	2024-09-30 20:50:20 +01:00