Commit graph

2 commits

Author SHA1 Message Date
cybermaggedon
90127dfecb
Feature/rag metering (#75)
* Add metering-rag for RAG token metrics

* Make metering executable

* Add metering-rag to Prom metrics

* Metricate the right queue

* Update templates to include metering-rag
2024-09-29 20:15:03 +01:00
cybermaggedon
2a49365482
Adds basic metering infrastructure (#68)
* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
2024-09-28 20:48:20 +01:00