Adds basic metering infrastructure (#68)

* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
This commit is contained in:
cybermaggedon 2024-09-28 20:48:20 +01:00 committed by GitHub
parent 8085bb0118
commit 2a49365482
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 176 additions and 8 deletions

View file

@ -20,3 +20,4 @@ pyyaml
prometheus-client
pyarrow
boto3
ollama