Cyber MacGeddon
39ddf8a37a
Headings
2024-10-03 17:45:07 +01:00
Cyber MacGeddon
4dd33a6be0
Dev guide update
2024-10-03 17:44:15 +01:00
Cyber MacGeddon
cea22345ea
Dev guide update
2024-10-03 17:43:23 +01:00
Cyber MacGeddon
bf358f5daf
Give it markdown extension
2024-10-03 17:41:04 +01:00
Cyber MacGeddon
77686940ed
Add developer guide
2024-10-03 17:40:26 +01:00
Cyber MacGeddon
3c1ee0c91b
Merge branch 'release/v0.11' into master
2024-10-03 11:16:06 +01:00
cybermaggedon
44a6088465
Update 0.11 release with front-page README changes ( #98 )
...
* Readme updates
* Fixed typo
* Updated banner image
* Updated readme table
---------
Authored-by: JackColquitt <daniel@kalntera.ai>
2024-10-03 09:58:29 +01:00
JackColquitt
e23e5d4813
Updated readme table
2024-10-02 18:31:28 -07:00
JackColquitt
63cf8a27d2
Updated banner image
2024-10-02 18:26:45 -07:00
JackColquitt
81a1447907
Fixed typo
2024-10-02 18:25:20 -07:00
JackColquitt
ce9d21b65f
Readme updates
2024-10-02 18:22:09 -07:00
Cyber MacGeddon
adba99f270
Bump version
2024-10-02 22:25:48 +01:00
Cyber MacGeddon
8bd710972b
Fix service
2024-10-02 22:25:37 +01:00
cybermaggedon
db9ed06b1c
Fix/broken kg extract topics ( #97 )
...
* Add missing kg-extract-topics service
* Bump version
2024-10-02 22:23:00 +01:00
cybermaggedon
709221fa10
Add missing rdflib import ( #95 )
2024-10-02 11:39:57 +01:00
cybermaggedon
6891053107
Maint/remove cruft ( #94 )
...
* Remove cruft
2024-10-02 00:09:11 +01:00
cybermaggedon
14672f7f0e
Fix/processor state specify prom ( #93 )
...
* Provide mean to specify -p prometheus server
* Bump version
2024-10-01 22:14:28 +01:00
Cyber MacGeddon
2e6be5cdce
Bump version
2024-10-01 21:06:07 +01:00
cybermaggedon
56a9ac3ba9
Change LLM latency dashboard to be rate & bump version ( #92 )
2024-10-01 21:04:55 +01:00
cybermaggedon
5985b8612b
Replace... ( #91 )
...
Replace tg-load-* -f file with tg-load-* file1 file2 ...
2024-10-01 19:34:35 +01:00
cybermaggedon
647010be9f
Put Docker Compose config resources in the docker-compose directory, ( #90 )
...
Put Docker Compose config resources in the docker-compose directory to save having to workaround directory structures.
2024-10-01 19:33:14 +01:00
cybermaggedon
ef1b8b5a13
Feature/metering dashboard ( #89 )
...
* Bump version
* Added Prom metrics to metering, added dashboard
* Update YAMLs
* Add $ on axis
* Tweak dashboard
2024-10-01 06:46:41 +01:00
cybermaggedon
88a7dfa126
Maint/rename pkg ( #88 )
...
* Rename trustgraph-utils -> trustgraph-cli
* Update YAMLs
2024-09-30 22:20:26 +01:00
cybermaggedon
771d9fc2c7
Make util pathnames have tg- prefix ( #87 )
2024-09-30 21:24:22 +01:00
cybermaggedon
0e4c9c69ee
Add twine upload target ( #86 )
2024-09-30 21:07:18 +01:00
cybermaggedon
c26ada08c2
Fix VertexAI package. Add Python packaging to Makefile. ( #85 )
...
Bump version & generate templates.
2024-09-30 20:50:20 +01:00
cybermaggedon
f00baab1b8
Maint/fix build env ( #84 )
...
* Put README placeholders for packages in place
* Bump version
2024-09-30 19:47:09 +01:00
cybermaggedon
9b91d5eee3
Feature/pkgsplit ( #83 )
...
* Starting to spawn base package
* More package hacking
* Bedrock and VertexAI
* Parquet split
* Updated templates
* Utils
2024-09-30 19:36:09 +01:00
cybermaggedon
3fb75c617b
Maint/auto pkg versions ( #82 )
...
* Remove need to manage setup.py version
* Update YAMLs
2024-09-30 16:38:50 +01:00
cybermaggedon
cdace22ee4
Feature/simpler subpackages ( #81 )
...
* Back to simpler directory structure
* Bump version, update templates
2024-09-30 16:16:20 +01:00
cybermaggedon
f081933217
Feature/subpackages ( #80 )
...
* Renaming what will become the core package
* Tweaking to get package build working
* Fix metering merge
* Rename to core directory
* Bump version. Use namespace searching for packaging trustgraph-core
* Change references to trustgraph-core
* Forming embeddings-hf package
* Reference modules in core package.
* Build both packages to one container, bump version
* Update YAMLs
2024-09-30 14:00:29 +01:00
cybermaggedon
14d79ef9f1
Streamline startup ( #79 )
...
* Separate Prom metrics, different processors as different jobs
* Create producers before consumers, may streamline startup.
* Bump version
* Add Pulsar init command, will replace pulsar-admin invocations.
* Integrate tg-init-pulsar with YAMLs
* Update YAMLs
2024-09-30 12:19:22 +01:00
Cyber MacGeddon
5e8a1520ee
Bump version & update templates
2024-09-30 00:00:36 +01:00
Jack Colquitt
2f23309f05
Metering for all LLMs ( #76 )
...
* Fixed VertexAI token counts
* Slight fix for Cohere token count
* Slight tweak to AzureAI
* Fix for prometheus for AzureAI
2024-09-29 23:59:17 +01:00
cybermaggedon
74a14639bd
Feature/track processor state ( #78 )
...
* Add a Prom metric to consumers & consumer/producers to track the running
state.
* New script, gets processor state using prometheus
* Bump version, add tg-processor-state to package
* Update templates
2024-09-29 23:50:57 +01:00
cybermaggedon
efc364583b
Fix/graph rag uses wrong prompt ( #77 )
...
* Fix queue name invocation, use correct names, not defaults
* Bump version
* Update templates
2024-09-29 20:38:50 +01:00
cybermaggedon
90127dfecb
Feature/rag metering ( #75 )
...
* Add metering-rag for RAG token metrics
* Make metering executable
* Add metering-rag to Prom metrics
* Metricate the right queue
* Update templates to include metering-rag
2024-09-29 20:15:03 +01:00
cybermaggedon
6d57b7a6f3
Add metering to templates ( #74 )
...
* Add metering to trustgraph-core component
* Regenerate templates to run metering
2024-09-29 19:48:35 +01:00
cybermaggedon
56b3b50e94
Fix/cohere temperature not string ( #73 )
...
* Temperature should be a string in the templates
* Fix YAMLs for Cohere
2024-09-29 19:37:49 +01:00
cybermaggedon
24b80f4789
Fix/template config vol broken ( #72 )
...
* Fix config volume invocation
* Regenerate YAMLs
2024-09-29 18:33:39 +01:00
Cyber MacGeddon
5951fb4e56
Bump version to 0.11.1
2024-09-29 18:15:34 +01:00
cybermaggedon
fa30544999
Fix/revert template change ( #71 )
...
* Ditched the deploy directory (going away in 0.11) and putting
YAML files in top-dir of Github (for now).
* Update Makefile for the template change
2024-09-29 18:13:34 +01:00
Jack Colquitt
88246742f3
Features/metering all llms ( #70 )
...
* Added Anthropic support and None logic
* Added Cohere API support
* Added support for Llamafile and OpenAI
* Added support for VertexAI
* Added AzureAI support
2024-09-29 18:11:48 +01:00
Cyber MacGeddon
e5249c2bac
Bump version
2024-09-29 18:03:32 +01:00
cybermaggedon
6cad3674c0
Update templates to 0.11 ( #69 )
2024-09-28 22:08:28 +01:00
cybermaggedon
2a49365482
Adds basic metering infrastructure ( #68 )
...
* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
2024-09-28 20:48:20 +01:00
cybermaggedon
8085bb0118
Add version number to template generation ( #67 )
2024-09-28 19:44:29 +01:00
cybermaggedon
92a3e9816c
Script for deploy-bundle generation ( #65 )
...
* Added output config generation to ZIP file
* Added a README which is bundled with the ZIP file
* Remove CONFIGDIR reference
2024-09-28 17:46:41 +01:00
Cyber MacGeddon
1d89e466d5
Docker hub login
2024-09-28 11:55:30 +01:00
Cyber MacGeddon
2c8dd0bd39
Updated templates
2024-09-28 11:54:00 +01:00
