Adds basic metering infrastructure (#68)

* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
This commit is contained in:
cybermaggedon 2024-09-28 20:48:20 +01:00 committed by GitHub
parent 8085bb0118
commit 2a49365482
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 176 additions and 8 deletions

5
scripts/metering Normal file
View file

@ -0,0 +1,5 @@
#!/usr/bin/env python3
from trustgraph.metering import run
run()