Adds basic metering infrastructure (#68)

* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
This commit is contained in:
cybermaggedon 2024-09-28 20:48:20 +01:00 committed by GitHub
parent 8085bb0118
commit 2a49365482
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 176 additions and 8 deletions

View file

@ -81,6 +81,7 @@ setuptools.setup(
"scripts/load-pdf",
"scripts/load-text",
"scripts/load-triples",
"scripts/metering",
"scripts/object-extract-row",
"scripts/oe-write-milvus",
"scripts/pdf-decoder",