cybermaggedon
ba6d6c13af
Fix API gateway integration, added to templates ( #165 )
2024-11-20 20:56:23 +00:00
cybermaggedon
90127dfecb
Feature/rag metering ( #75 )
...
* Add metering-rag for RAG token metrics
* Make metering executable
* Add metering-rag to Prom metrics
* Metricate the right queue
* Update templates to include metering-rag
2024-09-29 20:15:03 +01:00
cybermaggedon
6d57b7a6f3
Add metering to templates ( #74 )
...
* Add metering to trustgraph-core component
* Regenerate templates to run metering
2024-09-29 19:48:35 +01:00
cybermaggedon
f661791bbf
K8s ( #58 )
...
Added templates which produce K8s resources. With the provided GCP wrapper, it works on GCP K8s cluster. This isn't stable enough for other folks to use so will need more piloting before it can be documented and released.
2024-09-07 18:59:38 +01:00
cybermaggedon
65d7f6d261
Refactor templates ( #52 )
...
* Switching from docker compose to abstract form - should be easier to k8s later
* Text loader util
* Recreate templates
2024-09-05 16:40:47 +01:00
cybermaggedon
208c219962
Template rejig ( #48 )
...
* document-rag / graph-rag refactor of templates
* Tweaking the docs and categories
* Clarify triple store vs RAG
* Tweak knowledge graph linkage
* Doc embedding for Qdrant
* Fix document RAG on Qdrant
* Fix templates
* Bump version
* Updated templates
2024-09-03 00:09:15 +01:00
cybermaggedon
f7a30006ad
Make templating work more flexibly ( #44 )
...
* Restructure directory
* Config loading
* Variable override points in JSONNET templates, separate pulsar-manager template
* Bump version
* Tidy chunking
* Simplified prompt overrides
* Update config loader
* Fix recursive chunker template
2024-08-30 17:47:35 +01:00
cybermaggedon
d69de52b04
Increase resources ( #35 )
...
* More memory for Cassandra
* More memory/CPU for embeddings
* Bump version, regenerate templates
2024-08-25 20:38:19 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates ( #33 )
...
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.
* Bump version & add prompt-templates to YAMLs
* Apply to graph rag flow
* Break out different templates
2024-08-23 23:34:16 +01:00
cybermaggedon
305dda4463
Fix errors in previous update ( #23 )
...
* Increase some limits
* Fix msg errors and update version
2024-08-22 20:58:44 +01:00
cybermaggedon
a01a72ba00
Set resource limits ( #22 )
...
* Added resource limits to resources.
* Boost version number, rebuild YAMLs
2024-08-22 17:54:00 +01:00
Cyber MacGeddon
7d00a53711
Some default values in yaml file
2024-08-21 17:17:24 +01:00
cybermaggedon
0e2db095e3
Add a docker-compose for just the stores ( #13 )
...
* - Added docker-compose-storage.yaml, just the infrastructure bits
- Tidied storage invocation
* Util, sits on chunker output and reports histogram of chunk sizes
2024-08-21 16:20:21 +01:00
cybermaggedon
fa0b89b5d4
Simplify templates ( #10 )
...
- Add component template files for all LLM types
- Top-level templates simplified to use just components
- Version to 0.6.2
2024-08-14 20:56:57 +01:00
Cyber MacGeddon
2f72fceaa2
Tidy templates directory
2024-08-13 19:22:57 +01:00