cybermaggedon
7113d04f21
Add token chunker ( #14 )
2024-08-21 16:51:33 +01:00
Cyber MacGeddon
4cee446920
Fix timing issue in 2 other client fetches
2024-08-20 22:13:08 +01:00
Cyber MacGeddon
ba056b93ed
Catch JSON parse errors in prompt processor
2024-08-20 20:51:32 +01:00
Cyber MacGeddon
20f983eec9
- Change flawed _client timeout logic which was causing major lags
...
- Moved clients to trustgraph.clients to tidy the parent directory
- Version bump
2024-08-20 17:54:11 +01:00
cybermaggedon
a38f530c5f
Rate limit handling ( #11 )
...
* Added a rate limit exception
* Reduce request/response timeouts because looks like there are major issues
* Add rate limit exception catch to all consumers
* Version to 0.6.3
2024-08-19 22:15:32 +01:00
cybermaggedon
d3e213f194
Add Neo4j support ( #9 )
...
- Add triples-write-neo4j and triples-query-neo4j to interact with neo4j
- Add docker-compose-openai-neo4j to demo Neo4j working
2024-08-14 09:06:33 +01:00
cybermaggedon
a3ea1301d6
Breakout store queries ( #8 )
...
- Break out store queries, so not locked into a Milvus/Cassandra backend
- Break out prompting into a separate module, so that prompts can be tailored to other LLMs
- Jsonnet used to generate docker compose templates
- Version to 0.6.0
2024-08-13 17:30:59 +01:00
cybermaggedon
fd547f7762
OpenAI integration ( #7 )
...
* Preliminary OpenAI support
* Version to 0.5.9
---------
Co-authored-by: JackColquitt <daniel@kalntera.ai>
2024-08-12 15:37:04 +01:00
JackColquitt
4584464e69
Added quick Cohere fix
2024-08-11 13:42:24 -07:00
Cyber MacGeddon
90fe017240
Bedrock LLM fix
2024-08-07 20:37:24 +01:00
Jack Colquitt
f349c8a72e
Bedrock, Cohere, and Mixed Support ( #6 )
...
* Added Cohere support
* Tweaks to rag prompt
* Bedrock support
* Version to 0.5.7
2024-08-07 19:27:37 +01:00
Cyber MacGeddon
103251dbf2
Make embedding & text-completion queues configurable in graph-rag
2024-08-05 22:37:11 +01:00
Cyber MacGeddon
963944f4aa
Have configurable input/output queues on call from kg-relationships
2024-08-05 22:10:18 +01:00
Cyber MacGeddon
8386712574
Have configurable input/output queues on call from kg-definitions
2024-08-05 22:05:28 +01:00
Cyber MacGeddon
df5e7c42b9
Make embeddings-vectorize have arguments to configure the embeddings
...
queue names
2024-08-05 21:48:52 +01:00
Cyber MacGeddon
cd0671e777
Using persistent/non-persistent, tenants and namespaces.
2024-07-29 22:23:32 +01:00
Cyber MacGeddon
5d53de74cb
Pass in module name instead of default test
2024-07-26 14:31:23 +01:00
Cyber MacGeddon
2628558fc8
Tweak subscriber name
2024-07-26 14:30:57 +01:00
Cyber MacGeddon
b8bc2ba109
Fix metrics command line options
2024-07-26 14:30:31 +01:00
Cyber MacGeddon
8e6defdc38
Parse args and start metrics server only on init
2024-07-25 22:47:56 +01:00
Cyber MacGeddon
69197861d9
Another protection
2024-07-25 22:46:13 +01:00
Cyber MacGeddon
4bc215e19a
- Some protection in extract-definition
...
- Up version
2024-07-25 22:44:51 +01:00
Cyber MacGeddon
7d864fe370
Dump GEs
2024-07-24 00:27:05 +01:00
Cyber MacGeddon
d75d2923fe
Lock in subscriber names
2024-07-23 23:02:09 +01:00
Cyber MacGeddon
de3525371c
Tidy closedown
2024-07-23 22:53:54 +01:00
Cyber MacGeddon
2db050fe93
Parquet dumper for triples
2024-07-23 22:38:07 +01:00
cybermaggedon
3947920ee8
Refactor names ( #4 )
...
- Downsize embeddings model to mini-lm in docker-compose files
- Rename for structure
- Default queues defined in schema file
- Standardize naming: graph embeddings, chunk embeddings, triples
2024-07-23 21:34:03 +01:00
Cyber MacGeddon
202f4e5298
Fix extract-definitions bug
2024-07-22 19:47:21 +01:00
cybermaggedon
9ab7613e07
Metrics ( #3 )
...
* Basic metrics working
* Add consumer & producer metrics
* Grafana & Prometheus in docker compose
2024-07-18 17:20:42 +01:00
JackColquitt
33b646eaec
Fixed json import
2024-07-17 14:58:14 -07:00
Cyber MacGeddon
0574eb6177
Fix graph-rag
2024-07-17 22:10:25 +01:00
Cyber MacGeddon
816ee2038f
Fix RAG service
2024-07-17 21:43:53 +01:00
Cyber MacGeddon
4e09ce75bc
Add restart on fail
2024-07-17 21:32:53 +01:00
Cyber MacGeddon
96a12efd70
Other LLMs
2024-07-17 17:18:24 +01:00
Cyber MacGeddon
ab616b2779
Fix bugs
2024-07-17 16:55:46 +01:00
Cyber MacGeddon
d0bc32892a
Standard core complete
2024-07-17 16:48:33 +01:00
Cyber MacGeddon
25e3c8e97d
kg
2024-07-17 16:17:08 +01:00
Cyber MacGeddon
48386bc7f3
embeddings-ollama
2024-07-17 16:08:58 +01:00
Cyber MacGeddon
de283f2582
Ported embeddings-hf
2024-07-17 16:03:49 +01:00
Cyber MacGeddon
39d066a07c
Porting
2024-07-17 15:58:11 +01:00
Cyber MacGeddon
40b3553053
producer base
2024-07-17 15:39:16 +01:00
Cyber MacGeddon
1a506d79fb
Added producer/consumer
2024-07-17 15:33:50 +01:00
Cyber MacGeddon
7b6f10de69
Added consumer
2024-07-17 15:25:40 +01:00
Cyber MacGeddon
605a455e07
Base class
2024-07-17 15:13:12 +01:00
Cyber MacGeddon
d007a5c97c
Fix Azure, 0.2.5
2024-07-16 23:45:38 +01:00
Cyber MacGeddon
d1066d8e12
Fix Cassandra index, cache loaded vector index from Milvus
2024-07-16 23:20:30 +01:00
Cyber MacGeddon
7c191bd38c
Configurable RAG query
2024-07-16 19:51:08 +01:00
Cyber MacGeddon
5c4a1ce092
Configuration of chunk size / overlap
2024-07-16 19:34:43 +01:00
Cyber MacGeddon
a5d63883f5
Add Ollama embeddings
2024-07-16 19:26:05 +01:00
Cyber MacGeddon
3741b54566
Make dimensions work dynamically
2024-07-16 17:43:29 +01:00