Commit graph

120 commits

Author SHA1 Message Date
cybermaggedon
3ca1defc88
Increase timeout (#36)
* Increase timeout
* Bump version
2024-08-25 20:45:04 +01:00
Jack Colquitt
980a4c5b93
Jamba and Cohere support for Bedrock (#34) 2024-08-25 20:44:00 +01:00
cybermaggedon
6edc3f0ee1
Prompt templates (#33)
* Added prompt-template, allows definiton, relationships and kg query
to be specified in config / command-line.

* Bump version & add prompt-templates to YAMLs

* Apply to graph rag flow

* Break out different templates
2024-08-23 23:34:16 +01:00
cybermaggedon
6d0776c7bb
Fix OpenAI reporting (#32)
* Fix OpenAI reporting

* bump version
2024-08-23 14:02:06 +01:00
cybermaggedon
380bddeb90
Fix LLM output reporting (#31)
* Fix LLM output reporting

* Bump version
2024-08-23 13:44:42 +01:00
cybermaggedon
1e92b2048a
Fix client missing exception import (#30)
* Fix missing import, remove cruft imports

* Bump version
2024-08-23 12:59:14 +01:00
cybermaggedon
e7c498be92
Fix neo4j (#29)
* - Fix Neo4j memory
- Fix neo4j query

* Version to 0.7.6
2024-08-23 12:49:42 +01:00
cybermaggedon
8372ff0eb6
Fix exception import fail (#28)
* Fix a missing import

* Fix missing  import, bump version
2024-08-22 23:59:26 +01:00
cybermaggedon
a2ae1d8820
Generate all YAML files (#24)
* All templates generated, added missing file

* Up version
2024-08-22 21:20:17 +01:00
cybermaggedon
305dda4463
Fix errors in previous update (#23)
* Increase some limits
* Fix msg errors and update version
2024-08-22 20:58:44 +01:00
cybermaggedon
1297cdb1d0
Improve request/response handling (#18)
* Request/response error handling with common client

* Fixup error handling change
2024-08-22 17:02:18 +01:00
cybermaggedon
0043b871ff
Added chunk_size metrics, and added metrics to dashboard (#16) 2024-08-22 00:20:24 +01:00
Jack Colquitt
c4bfd9fc8c
Parameters, Parsing, renaming YAMLs and Neo4j YAMLS (#15)
* Added some params
* Parameter updates
* Fixed Neo4j issue
2024-08-22 00:03:56 +01:00
cybermaggedon
7113d04f21
Add token chunker (#14) 2024-08-21 16:51:33 +01:00
Cyber MacGeddon
4cee446920 Fix timing issue in 2 other client fetches 2024-08-20 22:13:08 +01:00
Cyber MacGeddon
ba056b93ed Catch JSON parse errors in prompt processor 2024-08-20 20:51:32 +01:00
Cyber MacGeddon
20f983eec9 - Change flawed _client timeout logic which was causing major lags
- Moved clients to trustgraph.clients to tidy the parent directory
- Version bump
2024-08-20 17:54:11 +01:00
cybermaggedon
a38f530c5f
Rate limit handling (#11)
* Added a rate limit exception
* Reduce request/response timeouts because looks like there are major issues
* Add rate limit exception catch to all consumers
* Version to 0.6.3
2024-08-19 22:15:32 +01:00
cybermaggedon
d3e213f194
Add Neo4j support (#9)
- Add triples-write-neo4j and triples-query-neo4j to interact with neo4j
- Add docker-compose-openai-neo4j to demo Neo4j working
2024-08-14 09:06:33 +01:00
cybermaggedon
a3ea1301d6
Breakout store queries (#8)
- Break out store queries, so not locked into a Milvus/Cassandra backend
- Break out prompting into a separate module, so that prompts can be tailored to other LLMs
- Jsonnet used to generate docker compose templates
- Version to 0.6.0
2024-08-13 17:30:59 +01:00
cybermaggedon
fd547f7762
OpenAI integration (#7)
* Preliminary OpenAI support
* Version to 0.5.9

---------

Co-authored-by: JackColquitt <daniel@kalntera.ai>
2024-08-12 15:37:04 +01:00
JackColquitt
4584464e69 Added quick Cohere fix 2024-08-11 13:42:24 -07:00
Cyber MacGeddon
90fe017240 Bedrock LLM fix 2024-08-07 20:37:24 +01:00
Jack Colquitt
f349c8a72e
Bedrock, Cohere, and Mixed Support (#6)
* Added Cohere support
* Tweaks to rag prompt
* Bedrock support
* Version to 0.5.7
2024-08-07 19:27:37 +01:00
Cyber MacGeddon
103251dbf2 Make embedding & text-completion queues configurable in graph-rag 2024-08-05 22:37:11 +01:00
Cyber MacGeddon
963944f4aa Have configurable input/output queues on call from kg-relationships 2024-08-05 22:10:18 +01:00
Cyber MacGeddon
8386712574 Have configurable input/output queues on call from kg-definitions 2024-08-05 22:05:28 +01:00
Cyber MacGeddon
df5e7c42b9 Make embeddings-vectorize have arguments to configure the embeddings
queue names
2024-08-05 21:48:52 +01:00
Cyber MacGeddon
cd0671e777 Using persistent/non-persistent, tenants and namespaces. 2024-07-29 22:23:32 +01:00
Cyber MacGeddon
5d53de74cb Pass in module name instead of default test 2024-07-26 14:31:23 +01:00
Cyber MacGeddon
2628558fc8 Tweak subscriber name 2024-07-26 14:30:57 +01:00
Cyber MacGeddon
b8bc2ba109 Fix metrics command line options 2024-07-26 14:30:31 +01:00
Cyber MacGeddon
8e6defdc38 Parse args and start metrics server only on init 2024-07-25 22:47:56 +01:00
Cyber MacGeddon
69197861d9 Another protection 2024-07-25 22:46:13 +01:00
Cyber MacGeddon
4bc215e19a - Some protection in extract-definition
- Up version
2024-07-25 22:44:51 +01:00
Cyber MacGeddon
7d864fe370 Dump GEs 2024-07-24 00:27:05 +01:00
Cyber MacGeddon
d75d2923fe Lock in subscriber names 2024-07-23 23:02:09 +01:00
Cyber MacGeddon
de3525371c Tidy closedown 2024-07-23 22:53:54 +01:00
Cyber MacGeddon
2db050fe93 Parquet dumper for triples 2024-07-23 22:38:07 +01:00
cybermaggedon
3947920ee8
Refactor names (#4)
- Downsize embeddings model to mini-lm in docker-compose files
- Rename for structure
- Default queues defined in schema file
- Standardize naming: graph embeddings, chunk embeddings, triples
2024-07-23 21:34:03 +01:00
Cyber MacGeddon
202f4e5298 Fix extract-definitions bug 2024-07-22 19:47:21 +01:00
cybermaggedon
9ab7613e07
Metrics (#3)
* Basic metrics working
* Add consumer & producer metrics
* Grafana & Prometheus in docker compose
2024-07-18 17:20:42 +01:00
JackColquitt
33b646eaec Fixed json import 2024-07-17 14:58:14 -07:00
Cyber MacGeddon
0574eb6177 Fix graph-rag 2024-07-17 22:10:25 +01:00
Cyber MacGeddon
816ee2038f Fix RAG service 2024-07-17 21:43:53 +01:00
Cyber MacGeddon
4e09ce75bc Add restart on fail 2024-07-17 21:32:53 +01:00
Cyber MacGeddon
96a12efd70 Other LLMs 2024-07-17 17:18:24 +01:00
Cyber MacGeddon
ab616b2779 Fix bugs 2024-07-17 16:55:46 +01:00
Cyber MacGeddon
d0bc32892a Standard core complete 2024-07-17 16:48:33 +01:00
Cyber MacGeddon
25e3c8e97d kg 2024-07-17 16:17:08 +01:00