apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-25 00:16:23 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
163 commits 76 branches 497 tags 113 MiB
Commit graph

54 commits

Author SHA1 Message Date
Cyber MacGeddon
937dad3381 Version to 0.8.0 2024-08-27 23:40:40 +01:00
cybermaggedon
32b087fbf6
Switch Milvus for Qdrant in YAMLs (#43) 
* Qdrant working

* - Fix missing prompt templates
- Bump version
- Add Qdrant to packages

* Switch Milvus for Qdrant in config files
 2024-08-27 23:37:24 +01:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings (#42) 
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
 2024-08-27 21:55:12 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support (#41) 
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
 2024-08-26 23:45:23 +01:00
cybermaggedon
0159e938a2
Update LLM text-completion duration metric (#40) 
* Added LLM duration metric, better buckets

* Added heatmap to dashboard to replace 95/97/99 chart

* Bump version
 2024-08-26 11:46:36 +01:00
cybermaggedon
d0e3fcf019
Catch LLM mismatches (#39) 
* Catch more upstream LLM issues

* Bump version
 2024-08-26 10:58:02 +01:00
cybermaggedon
acd60e95ec
Catch llm errors (#38) 
* Catch 'null' output from prompt for some values, presumably this is
caused by an upstream LLM error.

* Bump version
 2024-08-26 10:52:39 +01:00
cybermaggedon
cea8562ecf
Fix timeouts (#37) 
* Fix other timeout default settings

* Add storage-only YAML output

* Bump version
 2024-08-25 23:57:30 +01:00
cybermaggedon
3ca1defc88
Increase timeout (#36) 
* Increase timeout
* Bump version
 2024-08-25 20:45:04 +01:00
cybermaggedon
d69de52b04
Increase resources (#35) 
* More memory for Cassandra
* More memory/CPU for embeddings
* Bump version, regenerate templates
 2024-08-25 20:38:19 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates (#33) 
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.

* Bump version & add prompt-templates to YAMLs

* Apply to graph rag flow

* Break out different templates
 2024-08-23 23:34:16 +01:00
cybermaggedon
6d0776c7bb
Fix OpenAI reporting (#32) 
* Fix OpenAI reporting

* bump version
 2024-08-23 14:02:06 +01:00
cybermaggedon
380bddeb90
Fix LLM output reporting (#31) 
* Fix LLM output reporting

* Bump version
 2024-08-23 13:44:42 +01:00
cybermaggedon
1e92b2048a
Fix client missing exception import (#30) 
* Fix missing import, remove cruft imports

* Bump version
 2024-08-23 12:59:14 +01:00
cybermaggedon
e7c498be92
Fix neo4j (#29) 
* - Fix Neo4j memory
- Fix neo4j query

* Version to 0.7.6
 2024-08-23 12:49:42 +01:00
cybermaggedon
8372ff0eb6
Fix exception import fail (#28) 
* Fix a missing import

* Fix missing  import, bump version
 2024-08-22 23:59:26 +01:00
cybermaggedon
b1b26a3f55
- Updated dashboard (#27) 
- Adjusted limits everything works
- Bump version
 2024-08-22 23:23:11 +01:00
cybermaggedon
2bc602fdcf
Fix, was putting Neo in Cassandra config (#26) 2024-08-22 22:02:57 +01:00
cybermaggedon
a2ae1d8820
Generate all YAML files (#24) 
* All templates generated, added missing file

* Up version
 2024-08-22 21:20:17 +01:00
cybermaggedon
305dda4463
Fix errors in previous update (#23) 
* Increase some limits
* Fix msg errors and update version
 2024-08-22 20:58:44 +01:00
cybermaggedon
a01a72ba00
Set resource limits (#22) 
* Added resource limits to resources.

* Boost version number, rebuild YAMLs
 2024-08-22 17:54:00 +01:00
cybermaggedon
86cbe7f929
- Version to 0.7.0 (#19) 
- Tweak Containerfile to add more dependencies, speed up container
  build.
 2024-08-22 17:02:36 +01:00
Cyber MacGeddon
f09618081e Version 0.6.10 2024-08-22 00:21:42 +01:00
cybermaggedon
d3cdb97528
Fix auto-templates (#17) 2024-08-22 00:19:55 +01:00
Jack Colquitt
c4bfd9fc8c
Parameters, Parsing, renaming YAMLs and Neo4j YAMLS (#15) 
* Added some params
* Parameter updates
* Fixed Neo4j issue
 2024-08-22 00:03:56 +01:00
cybermaggedon
7113d04f21
Add token chunker (#14) 2024-08-21 16:51:33 +01:00
cybermaggedon
0e2db095e3
Add a docker-compose for just the stores (#13) 
* - Added docker-compose-storage.yaml, just the infrastructure bits
- Tidied storage invocation

* Util, sits on chunker output and reports histogram of chunk sizes
 2024-08-21 16:20:21 +01:00
Cyber MacGeddon
b0fdb4f314 Version to 0.6.6 2024-08-20 22:14:13 +01:00
Cyber MacGeddon
ba056b93ed Catch JSON parse errors in prompt processor 2024-08-20 20:51:32 +01:00
Cyber MacGeddon
20f983eec9 - Change flawed _client timeout logic which was causing major lags 
- Moved clients to trustgraph.clients to tidy the parent directory
- Version bump
 2024-08-20 17:54:11 +01:00
cybermaggedon
a38f530c5f
Rate limit handling (#11) 
* Added a rate limit exception
* Reduce request/response timeouts because looks like there are major issues
* Add rate limit exception catch to all consumers
* Version to 0.6.3
 2024-08-19 22:15:32 +01:00
cybermaggedon
fa0b89b5d4
Simplify templates (#10) 
- Add component template files for all LLM types
- Top-level templates simplified to use just components
- Version to 0.6.2
 2024-08-14 20:56:57 +01:00
cybermaggedon
d3e213f194
Add Neo4j support (#9) 
- Add triples-write-neo4j and triples-query-neo4j to interact with neo4j
- Add docker-compose-openai-neo4j to demo Neo4j working
 2024-08-14 09:06:33 +01:00
cybermaggedon
a3ea1301d6
Breakout store queries (#8) 
- Break out store queries, so not locked into a Milvus/Cassandra backend
- Break out prompting into a separate module, so that prompts can be tailored to other LLMs
- Jsonnet used to generate docker compose templates
- Version to 0.6.0
 2024-08-13 17:30:59 +01:00
Cyber MacGeddon
ab22fd4c24 Variable DOCKER 2024-08-12 17:39:54 +01:00
cybermaggedon
fd547f7762
OpenAI integration (#7) 
* Preliminary OpenAI support
* Version to 0.5.9

---------

Co-authored-by: JackColquitt <daniel@kalntera.ai>
 2024-08-12 15:37:04 +01:00
Cyber MacGeddon
9fbe8e2f4a v0.5.8 2024-08-07 20:37:54 +01:00
Jack Colquitt
f349c8a72e
Bedrock, Cohere, and Mixed Support (#6) 
* Added Cohere support
* Tweaks to rag prompt
* Bedrock support
* Version to 0.5.7
 2024-08-07 19:27:37 +01:00
Cyber MacGeddon
63a30b25eb Boost version file, put 2y text-completion process in each docker compose just for RAG 2024-08-05 23:00:05 +01:00
Cyber MacGeddon
c55df0309c - Put version to 0.5.5. 
- Consolidate changes to all docker compose files
 2024-07-29 22:27:08 +01:00
Cyber MacGeddon
4bc215e19a - Some protection in extract-definition 
- Up version
 2024-07-25 22:44:51 +01:00
Cyber MacGeddon
fca086d60f Update version 2024-07-23 23:20:43 +01:00
cybermaggedon
3947920ee8
Refactor names (#4) 
- Downsize embeddings model to mini-lm in docker-compose files
- Rename for structure
- Default queues defined in schema file
- Standardize naming: graph embeddings, chunk embeddings, triples
 2024-07-23 21:34:03 +01:00
Cyber MacGeddon
202f4e5298 Fix extract-definitions bug 2024-07-22 19:47:21 +01:00
cybermaggedon
9ab7613e07
Metrics (#3) 
* Basic metrics working
* Add consumer & producer metrics
* Grafana & Prometheus in docker compose
 2024-07-18 17:20:42 +01:00
Cyber MacGeddon
0574eb6177 Fix graph-rag 2024-07-17 22:10:25 +01:00
Cyber MacGeddon
816ee2038f Fix RAG service 2024-07-17 21:43:53 +01:00
Cyber MacGeddon
4e09ce75bc Add restart on fail 2024-07-17 21:32:53 +01:00
Cyber MacGeddon
29180216e6 version 0.3.0 2024-07-17 21:22:58 +01:00
Cyber MacGeddon
d007a5c97c Fix Azure, 0.2.5 2024-07-16 23:45:38 +01:00