cybermaggedon
c69f5207a4
OntoRAG: Ontology-Based Knowledge Extraction and Query Technical Specification ( #523 )
...
* Onto-rag tech spec
* New processor kg-extract-ontology, use 'ontology' objects from config to guide triple extraction
* Also entity contexts
* Integrate with ontology extractor from workbench
This is first phase, the extraction is tested and working, also GraphRAG with the extracted knowledge works
2025-11-12 20:38:08 +00:00
cybermaggedon
4c3db4dbbe
MCP auth for the simple case ( #557 )
...
* MCP auth token header
* Mention limitations
* Fix AgentStep schema error by converting argument values to strings.
* Added tests for MCP auth and agent step parsing
2025-11-11 12:28:53 +00:00
cybermaggedon
d9d4c91363
Dynamic embeddings model ( #556 )
...
* Dynamic embeddings model selection
* Added tests
* HF embeddings are skipped, tests don't run with that package currently tests
2025-11-10 20:38:01 +00:00
cybermaggedon
6129bb68c1
Fix hard coded vector size ( #555 )
...
* Fixed hard-coded embeddings store size
* Vector store lazy-creates collections, different collections for
different dimension lengths.
* Added tech spec for vector store lifecycle
* Fixed some tests for the new spec
2025-11-10 16:56:51 +00:00
cybermaggedon
05b9063fea
Feature/python3.13 ( #553 )
...
* Python to 3.13
* cassandra-driver -> scylla-driver
(cassandra-driver doesn't work with Python 3.13)
2025-10-11 12:19:26 +01:00
cybermaggedon
51107008fd
master -> 1.5 (README updates) ( #552 )
2025-10-11 11:46:03 +01:00
cybermaggedon
ad35656811
Prepare 1.5 release branch ( #550 )
2025-10-11 11:44:00 +01:00
cybermaggedon
77fdec2c2d
Fix chunk params not converted ( #549 )
2025-10-07 00:04:34 +01:00
cybermaggedon
09930bdb86
Fix deletion error in Cassandra object store ( #546 )
...
* Iteration algorithm modified to look for tables using schema definitions rather than iterate over all tables
2025-10-06 17:45:02 +01:00
cybermaggedon
35ef9bd71c
Apply fix, incorrect statement invocation ( #545 )
2025-10-06 14:24:46 +01:00
cybermaggedon
3e23d3c3ed
Fix collection management sync prob ( #544 )
...
* Address creation/deletion sync problems
* Fix object writer management
* Get Milvus to use ANN
2025-09-30 23:04:28 +01:00
cybermaggedon
52b133fc86
Collection delete pt. 3 ( #542 )
...
* Fixing collection deletion
* Fixing collection management param error
* Always test for collections
* Add Cassandra collection table
* Updated tech spec for explicit creation/deletion
* Remove implicit collection creation
* Fix up collection tracking in all processors
2025-09-30 16:02:33 +01:00
cybermaggedon
dc79b10552
Feaature/flow default params ( #541 )
...
* Flow creation uses parameter defaults in API and CLI
* Submit strings for flow parameters
2025-09-30 14:06:08 +01:00
cybermaggedon
8929a680a1
Chunking dynamic params ( #536 )
...
* Chunking params are dynamic
* Update tests
2025-09-26 10:53:32 +01:00
cybermaggedon
6f4f7ce6b4
Flow temperature parameter ( #533 )
...
* Add temperature parameter to LlmService and roll out to all LLMs
2025-09-25 21:26:11 +01:00
cybermaggedon
7a3bfad826
LLM dynamic settings, using the llm-model and llm-rag-model paramters to a flow ( #531 )
...
* Ported LLMs to dynamic models
2025-09-24 16:36:25 +01:00
cybermaggedon
9a34ab1b93
Complete remaining parameter work ( #530 )
...
* Fix CLI typo
* Complete flow parameters work, still needs implementation in LLMs
2025-09-24 13:58:34 +01:00
cybermaggedon
dc2fa1f31e
flow parameters ( #526 )
...
* Flow parameter tech spec
* Flow configurable parameters implemented
2025-09-23 23:18:04 +01:00
cybermaggedon
45a14b5958
Graph rag optimisations ( #527 )
...
* Tech spec for GraphRAG optimisation
* Implement GraphRAG optimisation and update tests
2025-09-23 21:05:51 +01:00
cybermaggedon
fcd15d1833
Collection management part 2 ( #522 )
...
* Plumb collection manager into librarian
* Test end-to-end
2025-09-19 16:08:47 +01:00
cybermaggedon
d378db9370
Cassandra performance enhancement ( #521 )
...
* Tech spec
* Tech spec complete
* Cassandra multi-table for performance
2025-09-18 19:52:05 +01:00
cybermaggedon
13ff7d765d
Collection management ( #520 )
...
* Tech spec
* Refactored Cassanda knowledge graph for single table
* Collection management, librarian services to manage metadata and collection deletion
2025-09-18 15:57:52 +01:00
cybermaggedon
48016d8fb2
Added XML, JSON, CSV detection ( #519 )
...
* Improved XML detect, added schema selection
* Add schema select + tests
* API additions
* More tests
* Fixed tests
2025-09-16 23:53:43 +01:00
cybermaggedon
3d783f4bd4
Structure data diagnosis service ( #518 )
...
* Import flow tech spec
* Structured diag service
* Plumbed into API gateway
* Type detector
* Diag service
* Added entry point
2025-09-16 21:43:23 +01:00
cybermaggedon
d73af56690
Fix/websocket close await (1.4) ( #517 )
...
* Vector stores will create collections on query (#511 )
* Return empty embeddings list as empty list through gateway (#513 )
* Await async websocket closure
2025-09-11 15:56:22 +01:00
cybermaggedon
0f1d3ce8cf
Vector stores will create collections on query ( #512 )
2025-09-11 00:15:46 +01:00
cybermaggedon
7f57bc6a0a
Feature/memgraph user collection isolation ( #510 )
...
* User/collection processing in memgraph
* Update tests
2025-09-10 22:11:35 +01:00
cybermaggedon
c694b12e9c
Feature/neo4j user collection isolation ( #509 )
...
* Tech spec
* User/collection separation
* Update tests
2025-09-10 22:11:21 +01:00
cybermaggedon
0b59f0c828
Maint/open 1.4 release branch ( #508 )
...
* Change pyproject files for 1.4
* Fix tests to track 1.4
2025-09-10 22:11:03 +01:00
cybermaggedon
314ce76b81
Feature/fix milvus ( #507 )
...
- Remove object embeddings, were currently broken and not used
- Fixed Milvus collection names
* Updating tests
* Remove unused entrypoint
2025-09-09 21:44:55 +01:00
cybermaggedon
6ac8a7c2d9
Fix/document rag ( #506 )
...
* Fix missing document RAG user/collection params
* Added test
2025-09-09 15:30:11 +01:00
cybermaggedon
f22bf13aa6
Extend use of user + collection fields ( #503 )
...
* Collection+user fields in structured query
* User/collection in structured query & agent
2025-09-08 18:28:38 +01:00
cybermaggedon
a92050c411
Fix Prometheus incorrect metric name ( #502 )
...
* Fix Prometheus incorrect metric name
* Remove unnecessary changes
2025-09-06 18:37:01 +01:00
cybermaggedon
0b7620bc04
Object batching ( #499 )
...
* Object batching
* Update tests
2025-09-05 15:59:06 +01:00
cybermaggedon
257a7951a7
Object import ( #497 )
...
* Object import dispatcher
* Add object import gateway test
2025-09-05 14:06:01 +01:00
cybermaggedon
50c37407c5
Fix/sys integration issues ( #494 )
...
* Fix integration issues
* Fix query defaults
* Fix tests
2025-09-05 08:38:15 +01:00
cybermaggedon
ed0e02791d
Feature/structured query tool integration ( #493 )
...
* Agent integration to structured query
* Update tests
2025-09-04 16:23:43 +01:00
cybermaggedon
a6d9f5e849
Structured query support ( #492 )
...
* Tweak the structured query schema
* Structure query service
* Gateway support for nlp-query and structured-query
* API support
* Added CLI
* Update tests
* More tests
2025-09-04 16:06:18 +01:00
cybermaggedon
8d4aa0069c
NLP query to GraphQL service ( #491 )
2025-09-04 13:39:47 +01:00
cybermaggedon
c078ca45cd
Refactor more Cassandra stuff to use the helper ( #490 )
2025-09-04 12:54:58 +01:00
cybermaggedon
27d657c58d
Remove graphql collection param ( #489 )
...
* Remove GraphQL collection parameter
* Update tech spec to mark query service complete
2025-09-04 10:04:09 +01:00
cybermaggedon
85e669c763
Fixing more Cassandra consistency issues ( #488 )
...
* Fixing more Cassandra work
* Fix tests
2025-09-04 00:58:11 +01:00
cybermaggedon
ccaec88a72
Feature/consolidate cassandra config ( #483 )
...
* Cassandra consolidation of parameters
* New Cassandra configuration helper
* Implemented Cassanda config refactor
* New tests
2025-09-03 23:41:22 +01:00
cybermaggedon
e74eb5d1ff
Feature/tool group ( #484 )
...
* Tech spec for tool group
* Partial tool group implementation
* Tool group tests
2025-09-03 23:39:49 +01:00
cybermaggedon
672e358b2f
Feature/graphql table query ( #486 )
...
* Tech spec
* Object query service for Cassandra
* Gateway support for objects-query
* GraphQL query utility
* Filters, ordering
2025-09-03 23:39:11 +01:00
cybermaggedon
5139c6ad5d
Bump pyproject.toml constraints ( #477 )
2025-08-28 13:45:58 +01:00
cybermaggedon
96c2b73457
Fix import export graceful shutdown ( #476 )
...
* Tech spec for graceful shutdown
* Graceful shutdown of importers/exporters
* Update socket to include graceful shutdown orchestration
* Adding tests for conditions tracked in this PR
2025-08-28 13:39:28 +01:00
cybermaggedon
3e5d6ed3e4
Use collection field from request when loading a knowledge core ( #472 )
...
* Use collection field from request when loading a knowledge core
* Test core collection
2025-08-27 09:08:06 +01:00
cybermaggedon
e5b9b4976a
Fix agent knowledge query initialisation failure ( #469 )
...
* Back out agent change
* Fixed broken tests
2025-08-26 19:41:04 +01:00
cybermaggedon
6e9e2a11b1
Fix knowledge query ignoring the collection ( #467 )
...
* Fix knowledge query ignoring the collection
* Updated the agent_manager.py to properly pass config parameters when instantiating tool implementations
* Added tests for agent collection parameter
2025-08-26 19:05:48 +01:00
