cybermaggedon
cf0daedefa
Changed schema for Value -> Term, majorly breaking change ( #622 )
...
* Changed schema for Value -> Term, majorly breaking change
* Following the schema change, Value -> Term into all processing
* Updated Cassandra for g, p, s, o index patterns (7 indexes)
* Reviewed and updated all tests
* Neo4j, Memgraph and FalkorDB remain broken, will look at once settled down
2026-01-27 13:48:08 +00:00
cybermaggedon
2baf21c5e1
Collection deletion batch error fixed ( #559 )
...
Collection deletion caused a batch error, this reduces batch size on deletion
2025-11-13 16:29:40 +00:00
cybermaggedon
6129bb68c1
Fix hard coded vector size ( #555 )
...
* Fixed hard-coded embeddings store size
* Vector store lazy-creates collections, different collections for
different dimension lengths.
* Added tech spec for vector store lifecycle
* Fixed some tests for the new spec
2025-11-10 16:56:51 +00:00
cybermaggedon
35ef9bd71c
Apply fix, incorrect statement invocation ( #545 )
2025-10-06 14:24:46 +01:00
cybermaggedon
3e23d3c3ed
Fix collection management sync prob ( #544 )
...
* Address creation/deletion sync problems
* Fix object writer management
* Get Milvus to use ANN
2025-09-30 23:04:28 +01:00
cybermaggedon
52b133fc86
Collection delete pt. 3 ( #542 )
...
* Fixing collection deletion
* Fixing collection management param error
* Always test for collections
* Add Cassandra collection table
* Updated tech spec for explicit creation/deletion
* Remove implicit collection creation
* Fix up collection tracking in all processors
2025-09-30 16:02:33 +01:00
cybermaggedon
fcd15d1833
Collection management part 2 ( #522 )
...
* Plumb collection manager into librarian
* Test end-to-end
2025-09-19 16:08:47 +01:00
cybermaggedon
d378db9370
Cassandra performance enhancement ( #521 )
...
* Tech spec
* Tech spec complete
* Cassandra multi-table for performance
2025-09-18 19:52:05 +01:00
cybermaggedon
13ff7d765d
Collection management ( #520 )
...
* Tech spec
* Refactored Cassanda knowledge graph for single table
* Collection management, librarian services to manage metadata and collection deletion
2025-09-18 15:57:52 +01:00
cybermaggedon
314ce76b81
Feature/fix milvus ( #507 )
...
- Remove object embeddings, were currently broken and not used
- Fixed Milvus collection names
* Updating tests
* Remove unused entrypoint
2025-09-09 21:44:55 +01:00
cybermaggedon
dd70aade11
Implement logging strategy ( #444 )
...
* Logging strategy and convert all prints() to logging invocations
2025-07-30 23:18:38 +01:00
cybermaggedon
f37decea2b
Increase storage test coverage ( #435 )
...
* Fixing storage and adding tests
* PR pipeline only runs quick tests
2025-07-15 09:33:35 +01:00
Tyler Oliver
fe422b2b95
Add support for Cassandra auth with SSL check ( #318 )
...
Following recommended approach in Datastax documenation I've added the necessary TLS/SSL check
https://docs.datastax.com/en/developer/python-driver/3.17/security/index.html
2025-03-20 22:25:23 +00:00
Tyler Oliver
41ccb6c976
Add user and password auth for Cassandra ( #301 )
2025-02-08 11:42:14 +00:00
cybermaggedon
7a64385a57
Fix graph query in Cassandra ( #168 )
2024-11-21 18:02:49 +00:00
cybermaggedon
b0f4c58200
Feature / collections ( #96 )
...
* Update schema defs for source -> metadata
* Migrate to use metadata part of schema, also add metadata to triples & vecs
* Add user/collection metadata to query
* Use user/collection in RAG
* Write and query working on triples
2024-10-02 18:14:29 +01:00
cybermaggedon
9b91d5eee3
Feature/pkgsplit ( #83 )
...
* Starting to spawn base package
* More package hacking
* Bedrock and VertexAI
* Parquet split
* Updated templates
* Utils
2024-09-30 19:36:09 +01:00
