cybermaggedon
74a14639bd
Feature/track processor state ( #78 )
...
* Add a Prom metric to consumers & consumer/producers to track the running
state.
* New script, gets processor state using prometheus
* Bump version, add tg-processor-state to package
* Update templates
2024-09-29 23:50:57 +01:00
cybermaggedon
efc364583b
Fix/graph rag uses wrong prompt ( #77 )
...
* Fix queue name invocation, use correct names, not defaults
* Bump version
* Update templates
2024-09-29 20:38:50 +01:00
cybermaggedon
90127dfecb
Feature/rag metering ( #75 )
...
* Add metering-rag for RAG token metrics
* Make metering executable
* Add metering-rag to Prom metrics
* Metricate the right queue
* Update templates to include metering-rag
2024-09-29 20:15:03 +01:00
cybermaggedon
6d57b7a6f3
Add metering to templates ( #74 )
...
* Add metering to trustgraph-core component
* Regenerate templates to run metering
2024-09-29 19:48:35 +01:00
cybermaggedon
56b3b50e94
Fix/cohere temperature not string ( #73 )
...
* Temperature should be a string in the templates
* Fix YAMLs for Cohere
2024-09-29 19:37:49 +01:00
cybermaggedon
24b80f4789
Fix/template config vol broken ( #72 )
...
* Fix config volume invocation
* Regenerate YAMLs
2024-09-29 18:33:39 +01:00
Cyber MacGeddon
5951fb4e56
Bump version to 0.11.1
2024-09-29 18:15:34 +01:00
cybermaggedon
fa30544999
Fix/revert template change ( #71 )
...
* Ditched the deploy directory (going away in 0.11) and putting
YAML files in top-dir of Github (for now).
* Update Makefile for the template change
2024-09-29 18:13:34 +01:00
Jack Colquitt
88246742f3
Features/metering all llms ( #70 )
...
* Added Anthropic support and None logic
* Added Cohere API support
* Added support for Llamafile and OpenAI
* Added support for VertexAI
* Added AzureAI support
2024-09-29 18:11:48 +01:00
Cyber MacGeddon
e5249c2bac
Bump version
2024-09-29 18:03:32 +01:00
cybermaggedon
6cad3674c0
Update templates to 0.11 ( #69 )
2024-09-28 22:08:28 +01:00
cybermaggedon
2a49365482
Adds basic metering infrastructure ( #68 )
...
* Basic metering module structure
* Token counting working for Bedrock
* Price calc using price list
* Added more models to pricelist
* Added Ollama token counts
----
Authored-by: JackColquitt <daniel@kalntera.ai>
2024-09-28 20:48:20 +01:00
cybermaggedon
8085bb0118
Add version number to template generation ( #67 )
2024-09-28 19:44:29 +01:00
cybermaggedon
92a3e9816c
Script for deploy-bundle generation ( #65 )
...
* Added output config generation to ZIP file
* Added a README which is bundled with the ZIP file
* Remove CONFIGDIR reference
2024-09-28 17:46:41 +01:00
Cyber MacGeddon
1d89e466d5
Docker hub login
2024-09-28 11:55:30 +01:00
Cyber MacGeddon
2c8dd0bd39
Updated templates
2024-09-28 11:54:00 +01:00
Cyber MacGeddon
d6cacd3fb7
Bump version
2024-09-28 11:50:57 +01:00
Cyber MacGeddon
39cf256f5c
Merge branch 'master' into release/v0.10. Includes llamafile and
...
prompt modifications.
2024-09-28 11:26:52 +01:00
JackColquitt
a2a93ebaff
Updated agent messaging in readme
2024-09-24 14:24:16 -07:00
JackColquitt
78e3418dcb
Readme tweaks
2024-09-23 15:01:23 -07:00
JackColquitt
e2c326c626
Added sample files
2024-09-23 14:21:50 -07:00
JackColquitt
124cb20932
More readme tweaks
2024-09-23 14:14:30 -07:00
JackColquitt
74094d4471
Link tweak in readme
2024-09-23 14:07:17 -07:00
JackColquitt
99370670de
Readme tweaks
2024-09-23 14:05:01 -07:00
JackColquitt
a6f38fc214
Tidy up readme
2024-09-23 13:59:02 -07:00
JackColquitt
543c10090f
Readme tweaks
2024-09-22 10:41:49 -07:00
JackColquitt
28c2815ac3
Fixed readme typos
2024-09-16 17:53:47 -07:00
JackColquitt
28a28b9f0a
Updated readme
2024-09-16 17:52:02 -07:00
JackColquitt
7818178f41
Updated readme
2024-09-16 10:37:53 -07:00
Jack Colquitt
9612a11581
Added basic Llamafile integration ( #63 )
...
* Added basic Llamafile integration
* Added llamafile template support
* New templates following llamafile addition
---------
Co-authored-by: Cyber MacGeddon <cybermaggedon@gmail.com>
2024-09-16 16:18:01 +01:00
cybermaggedon
6af86fa09f
Topic templates for extractor ( #62 )
...
* Add topic prompt to templates
* Bump version
* Updated templates
2024-09-15 23:40:37 +01:00
Jack Colquitt
728ff7542a
Extraction upgrade ( #61 )
...
* Added KG Topics
* Updated prompt-template
* Fixed prompt-generic
2024-09-15 22:47:57 +01:00
JackColquitt
13f6b5d87f
Updated readme
2024-09-11 10:10:39 -07:00
cybermaggedon
054ea6c76a
Fix Docker Compose relative directory problem ( #60 )
...
- Fix Docker Compose relative directory problem
- Added CONFIGDIR environment variable for docker compose
- Correct Pulsar URL defaults for graph utils to be localhost again
2024-09-09 22:03:10 +01:00
cybermaggedon
0ae6feddb0
Added GCP and Minikube output ( #59 )
...
* Added a config to create Minikube k8s, uses hostpath volumes
* Reworked templater to produce docker compose and minikube output
* Fix config templates
2024-09-09 17:16:50 +01:00
cybermaggedon
f661791bbf
K8s ( #58 )
...
Added templates which produce K8s resources. With the provided GCP wrapper, it works on GCP K8s cluster. This isn't stable enough for other folks to use so will need more piloting before it can be documented and released.
2024-09-07 18:59:38 +01:00
JackColquitt
7af32b0eef
Doc updates for v0.9.3
2024-09-05 14:01:41 -07:00
cybermaggedon
375b213a54
Fix replace strings for JSON ( #57 )
...
* Fix replace strings for JSON
* Add JSON markdown preamble/postamble in prompts
* Remove JSON chicanery in LLM handling
* Bump version
2024-09-05 20:49:32 +01:00
cybermaggedon
3445759598
Fix bedrock replace ( #56 )
...
* Fix replace ignoring first output
* Bump version
2024-09-05 20:00:38 +01:00
cybermaggedon
ddd8cc90e5
Fix templates ( #55 )
...
* Fix template import problem
* Bump version
2024-09-05 18:24:51 +01:00
cybermaggedon
f7429f2f9b
Fix remaining templates ( #54 )
2024-09-05 18:17:47 +01:00
Cyber MacGeddon
6fb118ba95
Bump version
2024-09-05 16:47:49 +01:00
cybermaggedon
6e4534e35c
Tidied scripts, added 2 query scripts ( #53 )
2024-09-05 16:45:22 +01:00
cybermaggedon
65d7f6d261
Refactor templates ( #52 )
...
* Switching from docker compose to abstract form - should be easier to k8s later
* Text loader util
* Recreate templates
2024-09-05 16:40:47 +01:00
cybermaggedon
af5508ff68
Cannot access s error ( #50 )
...
* Fix order of statements error
* Bump version
* Update templates
* Add missing script files
* Added missing DE support init
* Fixed bugs preventing definition extraction from working (#49 ).
2024-09-03 22:10:48 +01:00
cybermaggedon
208c219962
Template rejig ( #48 )
...
* document-rag / graph-rag refactor of templates
* Tweaking the docs and categories
* Clarify triple store vs RAG
* Tweak knowledge graph linkage
* Doc embedding for Qdrant
* Fix document RAG on Qdrant
* Fix templates
* Bump version
* Updated templates
2024-09-03 00:09:15 +01:00
cybermaggedon
121f7bb776
Updates for config util repo ( #47 )
...
* Fix pulsar manager template import
* Add pattern categories. Update parameters with new schema.
* Add more parameters to config
2024-09-01 21:29:29 +01:00
cybermaggedon
06a9e913dc
Enable model overrides, added a null option in config-loader ( #45 )
...
Enable model overrides, added a null option in config-loader
2024-08-30 21:33:03 +01:00
cybermaggedon
f7a30006ad
Make templating work more flexibly ( #44 )
...
* Restructure directory
* Config loading
* Variable override points in JSONNET templates, separate pulsar-manager template
* Bump version
* Tidy chunking
* Simplified prompt overrides
* Update config loader
* Fix recursive chunker template
2024-08-30 17:47:35 +01:00
JackColquitt
f10c2822f4
Fixed typo
2024-08-27 19:11:36 -07:00
