Commit graph

237 commits

Author SHA1 Message Date
Cyber MacGeddon
f2e2793339 Improved, mapped from classes to properties 2025-11-12 19:32:43 +00:00
Cyber MacGeddon
e3289243bb Fixed missing URIs from ontology 2025-11-12 17:55:10 +00:00
Cyber MacGeddon
828540aebc Refactored URI stuff 2025-11-12 17:40:57 +00:00
Cyber MacGeddon
bf067e1d2d Update ontology prompt 2025-11-12 17:19:50 +00:00
Cyber MacGeddon
2356fce876 Fixing prompt invocation 2025-11-12 17:17:25 +00:00
Cyber MacGeddon
3ff16fdcf6 Ontology matching not working, debug 2025-11-12 17:03:22 +00:00
Cyber MacGeddon
e00d69fb82 Fix dimension stuff 2025-11-12 16:59:18 +00:00
Cyber MacGeddon
92647cf088 Ontology fix 2025-11-12 16:56:23 +00:00
Cyber MacGeddon
4fb602242d Fix nltk stuff 2025-11-12 16:50:47 +00:00
Cyber MacGeddon
0410e7dc9d Fix flow lifetimes 2025-11-12 16:48:49 +00:00
Cyber MacGeddon
d624247dbd Fix crash 2025-11-12 16:15:22 +00:00
Cyber MacGeddon
dfd7ad3a56 Refactor to use config event queue 2025-11-12 16:05:10 +00:00
Cyber MacGeddon
ef0f2b6837 Fix a missing definition, register ontology extractor endpoint 2025-11-12 15:59:23 +00:00
Cyber MacGeddon
3f183b3c7b Onto-rag tech spec + first pass implementation 2025-11-12 13:05:50 +00:00
cybermaggedon
4c3db4dbbe
MCP auth for the simple case (#557)
* MCP auth token header

* Mention limitations

* Fix AgentStep schema error by converting argument values to strings.

* Added tests for MCP auth and agent step parsing
2025-11-11 12:28:53 +00:00
cybermaggedon
d9d4c91363
Dynamic embeddings model (#556)
* Dynamic embeddings model selection

* Added tests

* HF embeddings are skipped, tests don't run with that package currently tests
2025-11-10 20:38:01 +00:00
cybermaggedon
6129bb68c1
Fix hard coded vector size (#555)
* Fixed hard-coded embeddings store size

* Vector store lazy-creates collections, different collections for
  different dimension lengths.

* Added tech spec for vector store lifecycle

* Fixed some tests for the new spec
2025-11-10 16:56:51 +00:00
cybermaggedon
05b9063fea
Feature/python3.13 (#553)
* Python to 3.13

* cassandra-driver -> scylla-driver
  (cassandra-driver doesn't work with Python 3.13)
2025-10-11 12:19:26 +01:00
cybermaggedon
51107008fd
master -> 1.5 (README updates) (#552) 2025-10-11 11:46:03 +01:00
cybermaggedon
ad35656811
Prepare 1.5 release branch (#550) 2025-10-11 11:44:00 +01:00
cybermaggedon
77fdec2c2d
Fix chunk params not converted (#549) 2025-10-07 00:04:34 +01:00
cybermaggedon
09930bdb86
Fix deletion error in Cassandra object store (#546)
* Iteration algorithm modified to look for tables using schema definitions rather than iterate over all tables
2025-10-06 17:45:02 +01:00
cybermaggedon
35ef9bd71c
Apply fix, incorrect statement invocation (#545) 2025-10-06 14:24:46 +01:00
cybermaggedon
3e23d3c3ed
Fix collection management sync prob (#544)
* Address creation/deletion sync problems

* Fix object writer management

* Get Milvus to use ANN
2025-09-30 23:04:28 +01:00
cybermaggedon
52b133fc86
Collection delete pt. 3 (#542)
* Fixing collection deletion

* Fixing collection management param error

* Always test for collections

* Add Cassandra collection table

* Updated tech spec for explicit creation/deletion

* Remove implicit collection creation

* Fix up collection tracking in all processors
2025-09-30 16:02:33 +01:00
cybermaggedon
dc79b10552
Feaature/flow default params (#541)
* Flow creation uses parameter defaults in API and CLI

* Submit strings for flow parameters
2025-09-30 14:06:08 +01:00
cybermaggedon
8929a680a1
Chunking dynamic params (#536)
* Chunking params are dynamic

* Update tests
2025-09-26 10:53:32 +01:00
cybermaggedon
6f4f7ce6b4
Flow temperature parameter (#533)
* Add temperature parameter to LlmService and roll out to all LLMs
2025-09-25 21:26:11 +01:00
cybermaggedon
7a3bfad826
LLM dynamic settings, using the llm-model and llm-rag-model paramters to a flow (#531)
* Ported LLMs to dynamic models
2025-09-24 16:36:25 +01:00
cybermaggedon
9a34ab1b93
Complete remaining parameter work (#530)
* Fix CLI typo

* Complete flow parameters work, still needs implementation in LLMs
2025-09-24 13:58:34 +01:00
cybermaggedon
dc2fa1f31e
flow parameters (#526)
* Flow parameter tech spec

* Flow configurable parameters implemented
2025-09-23 23:18:04 +01:00
cybermaggedon
45a14b5958
Graph rag optimisations (#527)
* Tech spec for GraphRAG optimisation

* Implement GraphRAG optimisation and update tests
2025-09-23 21:05:51 +01:00
cybermaggedon
fcd15d1833
Collection management part 2 (#522)
* Plumb collection manager into librarian

* Test end-to-end
2025-09-19 16:08:47 +01:00
cybermaggedon
d378db9370
Cassandra performance enhancement (#521)
* Tech spec

* Tech spec complete

* Cassandra multi-table for performance
2025-09-18 19:52:05 +01:00
cybermaggedon
13ff7d765d
Collection management (#520)
* Tech spec

* Refactored Cassanda knowledge graph for single table

* Collection management, librarian services to manage metadata and collection deletion
2025-09-18 15:57:52 +01:00
cybermaggedon
48016d8fb2
Added XML, JSON, CSV detection (#519)
* Improved XML detect, added schema selection

* Add schema select + tests

* API additions

* More tests

* Fixed tests
2025-09-16 23:53:43 +01:00
cybermaggedon
3d783f4bd4
Structure data diagnosis service (#518)
* Import flow tech spec

* Structured diag service

* Plumbed into API gateway

* Type detector

* Diag service

* Added entry point
2025-09-16 21:43:23 +01:00
cybermaggedon
d73af56690
Fix/websocket close await (1.4) (#517)
* Vector stores will create collections on query (#511)

* Return empty embeddings list as empty list through gateway (#513)

* Await async websocket closure
2025-09-11 15:56:22 +01:00
cybermaggedon
0f1d3ce8cf
Vector stores will create collections on query (#512) 2025-09-11 00:15:46 +01:00
cybermaggedon
7f57bc6a0a
Feature/memgraph user collection isolation (#510)
* User/collection processing in memgraph

* Update tests
2025-09-10 22:11:35 +01:00
cybermaggedon
c694b12e9c
Feature/neo4j user collection isolation (#509)
* Tech spec

* User/collection separation

* Update tests
2025-09-10 22:11:21 +01:00
cybermaggedon
0b59f0c828
Maint/open 1.4 release branch (#508)
* Change pyproject files for 1.4

* Fix tests to track 1.4
2025-09-10 22:11:03 +01:00
cybermaggedon
314ce76b81
Feature/fix milvus (#507)
- Remove object embeddings, were currently broken and not used
- Fixed Milvus collection names

* Updating tests

* Remove unused entrypoint
2025-09-09 21:44:55 +01:00
cybermaggedon
6ac8a7c2d9
Fix/document rag (#506)
* Fix missing document RAG user/collection params

* Added test
2025-09-09 15:30:11 +01:00
cybermaggedon
f22bf13aa6
Extend use of user + collection fields (#503)
* Collection+user fields in structured query

* User/collection in structured query & agent
2025-09-08 18:28:38 +01:00
cybermaggedon
a92050c411
Fix Prometheus incorrect metric name (#502)
* Fix Prometheus incorrect metric name

* Remove unnecessary changes
2025-09-06 18:37:01 +01:00
cybermaggedon
0b7620bc04
Object batching (#499)
* Object batching

* Update tests
2025-09-05 15:59:06 +01:00
cybermaggedon
257a7951a7
Object import (#497)
* Object import dispatcher

* Add object import gateway test
2025-09-05 14:06:01 +01:00
cybermaggedon
50c37407c5
Fix/sys integration issues (#494)
* Fix integration issues

* Fix query defaults

* Fix tests
2025-09-05 08:38:15 +01:00
cybermaggedon
ed0e02791d
Feature/structured query tool integration (#493)
* Agent integration to structured query

* Update tests
2025-09-04 16:23:43 +01:00