Commit graph

26 commits

Author SHA1 Message Date
Jack Colquitt
9612a11581
Added basic Llamafile integration (#63)
* Added basic Llamafile integration
* Added llamafile template support
* New templates following llamafile addition
---------
Co-authored-by: Cyber MacGeddon <cybermaggedon@gmail.com>
2024-09-16 16:18:01 +01:00
Jack Colquitt
728ff7542a
Extraction upgrade (#61)
* Added KG Topics
* Updated prompt-template
* Fixed prompt-generic
2024-09-15 22:47:57 +01:00
cybermaggedon
6e4534e35c
Tidied scripts, added 2 query scripts (#53) 2024-09-05 16:45:22 +01:00
cybermaggedon
65d7f6d261
Refactor templates (#52)
* Switching from docker compose to abstract form - should be easier to k8s later
* Text loader util
* Recreate templates
2024-09-05 16:40:47 +01:00
cybermaggedon
af5508ff68
Cannot access s error (#50)
* Fix order of statements error
* Bump version
* Update templates
* Add missing script files
* Added missing DE support init
* Fixed bugs preventing definition extraction from working (#49).
2024-09-03 22:10:48 +01:00
cybermaggedon
32b087fbf6
Switch Milvus for Qdrant in YAMLs (#43)
* Qdrant working

* - Fix missing prompt templates
- Bump version
- Add Qdrant to packages

* Switch Milvus for Qdrant in config files
2024-08-27 23:37:24 +01:00
cybermaggedon
e4c4774b5d
Extract rows and apply object embeddings (#42)
* - Restructured the extract directories
- Added an extractor for 'rows' == a row of a table
- Added a row extractor prompt to prompter.
* Add row support to template prompter
* Row extraction working
* Bump version
* Emit extracted info
* Object embeddings store
* Invocation script
* Add script to package, remove cruft output
* Write rows to Cassandra
* Remove output cruft
2024-08-27 21:55:12 +01:00
cybermaggedon
669aed0f8a
Added doc embedding support (#41)
* document embedding writer & query
* Added test query for doc embeddings
* Bump version
* Added doc rag prompt
* Document RAG service
2024-08-26 23:45:23 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates (#33)
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.

* Bump version & add prompt-templates to YAMLs

* Apply to graph rag flow

* Break out different templates
2024-08-23 23:34:16 +01:00
cybermaggedon
7113d04f21
Add token chunker (#14) 2024-08-21 16:51:33 +01:00
Cyber MacGeddon
20f983eec9 - Change flawed _client timeout logic which was causing major lags
- Moved clients to trustgraph.clients to tidy the parent directory
- Version bump
2024-08-20 17:54:11 +01:00
cybermaggedon
d3e213f194
Add Neo4j support (#9)
- Add triples-write-neo4j and triples-query-neo4j to interact with neo4j
- Add docker-compose-openai-neo4j to demo Neo4j working
2024-08-14 09:06:33 +01:00
cybermaggedon
a3ea1301d6
Breakout store queries (#8)
- Break out store queries, so not locked into a Milvus/Cassandra backend
- Break out prompting into a separate module, so that prompts can be tailored to other LLMs
- Jsonnet used to generate docker compose templates
- Version to 0.6.0
2024-08-13 17:30:59 +01:00
cybermaggedon
fd547f7762
OpenAI integration (#7)
* Preliminary OpenAI support
* Version to 0.5.9

---------

Co-authored-by: JackColquitt <daniel@kalntera.ai>
2024-08-12 15:37:04 +01:00
Jack Colquitt
f349c8a72e
Bedrock, Cohere, and Mixed Support (#6)
* Added Cohere support
* Tweaks to rag prompt
* Bedrock support
* Version to 0.5.7
2024-08-07 19:27:37 +01:00
Cyber MacGeddon
354e95cb1c Fix loader load error 2024-07-25 22:24:14 +01:00
Cyber MacGeddon
d626ab904d Load previously-saved data 2024-07-25 21:43:55 +01:00
Cyber MacGeddon
7d864fe370 Dump GEs 2024-07-24 00:27:05 +01:00
Cyber MacGeddon
de3525371c Tidy closedown 2024-07-23 22:53:54 +01:00
Cyber MacGeddon
2db050fe93 Parquet dumper for triples 2024-07-23 22:38:07 +01:00
cybermaggedon
3947920ee8
Refactor names (#4)
- Downsize embeddings model to mini-lm in docker-compose files
- Rename for structure
- Default queues defined in schema file
- Standardize naming: graph embeddings, chunk embeddings, triples
2024-07-23 21:34:03 +01:00
Cyber MacGeddon
50a114fbbe Ollama embeddings module 2024-07-16 17:24:16 +01:00
Cyber MacGeddon
b63ffbd95e Fix bugs in setup.py 2024-07-15 21:48:51 +01:00
Cyber MacGeddon
bc34f8b99f Processor model prototype 2024-07-15 17:17:04 +01:00
Cyber MacGeddon
da94865fb5 Updated utils to have command line 2024-07-12 15:06:51 +01:00
Cyber MacGeddon
9b5cbbf9ca Trustgraph initial code drop 2024-07-10 23:20:06 +01:00