Cyber MacGeddon
b110af41fb
Prompt template working
2025-04-17 16:12:46 +01:00
Cyber MacGeddon
b94b4b7389
API finalised
2025-04-16 16:11:18 +01:00
Cyber MacGeddon
cfdeadfb34
Chunker ported
2025-04-15 23:09:32 +01:00
Cyber MacGeddon
c3f1aacbfc
Remove cruft
2025-04-15 16:18:03 +01:00
Cyber MacGeddon
60ca5aa3a6
input/output is working
2025-04-15 16:13:18 +01:00
Cyber MacGeddon
9fdc408a95
Metrics working
2025-04-14 22:39:09 +01:00
Cyber MacGeddon
1d150cdc21
Working on processor API
2025-04-14 17:51:23 +01:00
Cyber MacGeddon
e66c06f99a
New API emerging
2025-04-14 09:05:42 +01:00
cybermaggedon
a2c64cad4a
Added config reload handler mechanism, calls a Python method on config ( #334 )
2025-04-02 00:23:30 +01:00
cybermaggedon
f350abb415
Maint/asyncio ( #305 )
...
* Move to asyncio services, even though everything is largely sync
2025-02-11 23:24:46 +00:00
cybermaggedon
0e03bc05a4
Refactor rate limit handling ( #280 )
...
* - Refactored retry for rate limits into the base class
- ConsumerProducer is derived from Consumer to simplify code
- Added rate_limit_count metrics for rate limit events
* Add rate limit events to VertexAI and Google AI Studio
* Added Grafana rate limit dashboard
* Add rate limit handling to all LLMs
2025-01-27 17:04:49 +00:00
cybermaggedon
cd9a208432
Processors use shared queues, means there can be more than process on a queue to share load ( #265 )
2025-01-11 18:10:04 +00:00
cybermaggedon
9b91d5eee3
Feature/pkgsplit ( #83 )
...
* Starting to spawn base package
* More package hacking
* Bedrock and VertexAI
* Parquet split
* Updated templates
* Utils
2024-09-30 19:36:09 +01:00