apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-05-04 21:02:37 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Adds basic metering infrastructure (#68)

Browse source 
* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
This commit is contained in:
cybermaggedon 2024-09-28 20:48:20 +01:00 • committed by GitHub
parent 8085bb0118
commit 2a49365482
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 176 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

2
Containerfile
View file

@ -13,7 +13,7 @@ RUN dnf install -y python3 python3-pip python3-wheel python3-aiohttp \
RUN pip3 install torch --index-url https://download.pytorch.org/whl/cpu
RUN pip3 install anthropic boto3 cohere openai google-cloud-aiplatform \
RUN pip3 install anthropic boto3 cohere openai google-cloud-aiplatform ollama \
langchain langchain-core langchain-huggingface langchain-text-splitters \
langchain-community pymilvus sentence-transformers transformers \
huggingface-hub pulsar-client cassandra-driver pyarrow pyyaml \