cybermaggedon
7501db01f1
Reconcile master with 1.6 ( #563 )
...
- Reconcile all master changes (documentation) to the 1.6 release branch
2025-11-24 10:02:30 +00:00
cybermaggedon
3580e7a7ae
Remove some 'unnecessary' parameters from OpenAI invocation ( #561 )
...
* Remove some 'unnecessary' parameters from OpenAI invocation. The OpenAI
API is getting complicated with the API and SDK changing on OpenAI's end,
but this not getting mapped through to other services which are 'compatible'
with OpenAI.
* Update OpenAI test for this change
* Trying running tests with Python 3.13
2025-11-20 17:56:31 +00:00
cybermaggedon
6c85038c75
Ontology extraction tests ( #560 )
2025-11-13 20:02:12 +00:00
cybermaggedon
2baf21c5e1
Collection deletion batch error fixed ( #559 )
...
Collection deletion caused a batch error, this reduces batch size on deletion
2025-11-13 16:29:40 +00:00
cybermaggedon
db4e842df3
Update tech spec ( #558 )
2025-11-13 16:29:20 +00:00
cybermaggedon
c69f5207a4
OntoRAG: Ontology-Based Knowledge Extraction and Query Technical Specification ( #523 )
...
* Onto-rag tech spec
* New processor kg-extract-ontology, use 'ontology' objects from config to guide triple extraction
* Also entity contexts
* Integrate with ontology extractor from workbench
This is first phase, the extraction is tested and working, also GraphRAG with the extracted knowledge works
2025-11-12 20:38:08 +00:00
cybermaggedon
4c3db4dbbe
MCP auth for the simple case ( #557 )
...
* MCP auth token header
* Mention limitations
* Fix AgentStep schema error by converting argument values to strings.
* Added tests for MCP auth and agent step parsing
2025-11-11 12:28:53 +00:00
cybermaggedon
d9d4c91363
Dynamic embeddings model ( #556 )
...
* Dynamic embeddings model selection
* Added tests
* HF embeddings are skipped, tests don't run with that package currently tests
2025-11-10 20:38:01 +00:00
cybermaggedon
6129bb68c1
Fix hard coded vector size ( #555 )
...
* Fixed hard-coded embeddings store size
* Vector store lazy-creates collections, different collections for
different dimension lengths.
* Added tech spec for vector store lifecycle
* Fixed some tests for the new spec
2025-11-10 16:56:51 +00:00
cybermaggedon
05b9063fea
Feature/python3.13 ( #553 )
...
* Python to 3.13
* cassandra-driver -> scylla-driver
(cassandra-driver doesn't work with Python 3.13)
2025-10-11 12:19:26 +01:00
cybermaggedon
51107008fd
master -> 1.5 (README updates) ( #552 )
2025-10-11 11:46:03 +01:00
cybermaggedon
ad35656811
Prepare 1.5 release branch ( #550 )
2025-10-11 11:44:00 +01:00
cybermaggedon
77fdec2c2d
Fix chunk params not converted ( #549 )
2025-10-07 00:04:34 +01:00
cybermaggedon
09930bdb86
Fix deletion error in Cassandra object store ( #546 )
...
* Iteration algorithm modified to look for tables using schema definitions rather than iterate over all tables
2025-10-06 17:45:02 +01:00
cybermaggedon
35ef9bd71c
Apply fix, incorrect statement invocation ( #545 )
2025-10-06 14:24:46 +01:00
cybermaggedon
3e23d3c3ed
Fix collection management sync prob ( #544 )
...
* Address creation/deletion sync problems
* Fix object writer management
* Get Milvus to use ANN
2025-09-30 23:04:28 +01:00
cybermaggedon
b7bf7388aa
Reduce log spam ( #543 )
2025-09-30 16:04:07 +01:00
cybermaggedon
52b133fc86
Collection delete pt. 3 ( #542 )
...
* Fixing collection deletion
* Fixing collection management param error
* Always test for collections
* Add Cassandra collection table
* Updated tech spec for explicit creation/deletion
* Remove implicit collection creation
* Fix up collection tracking in all processors
2025-09-30 16:02:33 +01:00
cybermaggedon
dc79b10552
Feaature/flow default params ( #541 )
...
* Flow creation uses parameter defaults in API and CLI
* Submit strings for flow parameters
2025-09-30 14:06:08 +01:00
cybermaggedon
d1456e547c
Fix label issue in metrics ( #540 )
2025-09-26 14:13:22 +01:00
cybermaggedon
10806caac2
Fix label names ( #539 )
2025-09-26 12:34:40 +01:00
cybermaggedon
209d0de0b8
Add missing file ( #538 )
2025-09-26 11:28:15 +01:00
cybermaggedon
8354ea1276
Update flow parameter tech spec for advanced params ( #537 )
...
* Add advanced mode to tech spec, fix enum description in tech spec
* Updated tech-spec for controlled-by relationship between parameters
* Update tg-show-flows CLI
* Update tg-show-flows, tg-show-flow-classes, tg-start-flow CLI
* Add tg-show-parameter-types
2025-09-26 10:55:10 +01:00
cybermaggedon
8929a680a1
Chunking dynamic params ( #536 )
...
* Chunking params are dynamic
* Update tests
2025-09-26 10:53:32 +01:00
cybermaggedon
43cfcb18a0
More LLM param test coverage ( #535 )
...
* More LLM tests
* Fixing tests
2025-09-26 01:00:30 +01:00
cybermaggedon
b0a3716b0e
Tests are failing ( #534 )
...
* Fix tests, update to new model parameter usage
2025-09-25 21:32:19 +01:00
cybermaggedon
6f4f7ce6b4
Flow temperature parameter ( #533 )
...
* Add temperature parameter to LlmService and roll out to all LLMs
2025-09-25 21:26:11 +01:00
cybermaggedon
aa8e422e8c
Flow configurable parameters ( #532 )
...
* Fix pyproject.toml missing requests dep
* parameters is now parameter-types
* Update flow parameters tech spec for recent changes (no impact on this repo)
2025-09-25 19:11:40 +01:00
cybermaggedon
7a3bfad826
LLM dynamic settings, using the llm-model and llm-rag-model paramters to a flow ( #531 )
...
* Ported LLMs to dynamic models
2025-09-24 16:36:25 +01:00
cybermaggedon
9a34ab1b93
Complete remaining parameter work ( #530 )
...
* Fix CLI typo
* Complete flow parameters work, still needs implementation in LLMs
2025-09-24 13:58:34 +01:00
cybermaggedon
72c9acad30
Fix CLI typo ( #529 )
2025-09-23 23:34:36 +01:00
cybermaggedon
dc2fa1f31e
flow parameters ( #526 )
...
* Flow parameter tech spec
* Flow configurable parameters implemented
2025-09-23 23:18:04 +01:00
cybermaggedon
3b0b13d74d
Remove excessive request/response logging ( #528 )
2025-09-23 21:07:00 +01:00
cybermaggedon
45a14b5958
Graph rag optimisations ( #527 )
...
* Tech spec for GraphRAG optimisation
* Implement GraphRAG optimisation and update tests
2025-09-23 21:05:51 +01:00
cybermaggedon
fcd15d1833
Collection management part 2 ( #522 )
...
* Plumb collection manager into librarian
* Test end-to-end
2025-09-19 16:08:47 +01:00
cybermaggedon
d378db9370
Cassandra performance enhancement ( #521 )
...
* Tech spec
* Tech spec complete
* Cassandra multi-table for performance
2025-09-18 19:52:05 +01:00
cybermaggedon
13ff7d765d
Collection management ( #520 )
...
* Tech spec
* Refactored Cassanda knowledge graph for single table
* Collection management, librarian services to manage metadata and collection deletion
2025-09-18 15:57:52 +01:00
cybermaggedon
48016d8fb2
Added XML, JSON, CSV detection ( #519 )
...
* Improved XML detect, added schema selection
* Add schema select + tests
* API additions
* More tests
* Fixed tests
2025-09-16 23:53:43 +01:00
cybermaggedon
3d783f4bd4
Structure data diagnosis service ( #518 )
...
* Import flow tech spec
* Structured diag service
* Plumbed into API gateway
* Type detector
* Diag service
* Added entry point
2025-09-16 21:43:23 +01:00
cybermaggedon
d73af56690
Fix/websocket close await (1.4) ( #517 )
...
* Vector stores will create collections on query (#511 )
* Return empty embeddings list as empty list through gateway (#513 )
* Await async websocket closure
2025-09-11 15:56:22 +01:00
cybermaggedon
f6bccd7438
Parallel contain builds ( #515 )
2025-09-11 12:32:04 +01:00
cybermaggedon
0e4fcb87de
Return empty embeddings list as empty list through gateway ( #514 )
2025-09-11 00:34:45 +01:00
cybermaggedon
0f1d3ce8cf
Vector stores will create collections on query ( #512 )
2025-09-11 00:15:46 +01:00
cybermaggedon
7f57bc6a0a
Feature/memgraph user collection isolation ( #510 )
...
* User/collection processing in memgraph
* Update tests
2025-09-10 22:11:35 +01:00
cybermaggedon
c694b12e9c
Feature/neo4j user collection isolation ( #509 )
...
* Tech spec
* User/collection separation
* Update tests
2025-09-10 22:11:21 +01:00
cybermaggedon
0b59f0c828
Maint/open 1.4 release branch ( #508 )
...
* Change pyproject files for 1.4
* Fix tests to track 1.4
2025-09-10 22:11:03 +01:00
cybermaggedon
314ce76b81
Feature/fix milvus ( #507 )
...
- Remove object embeddings, were currently broken and not used
- Fixed Milvus collection names
* Updating tests
* Remove unused entrypoint
2025-09-09 21:44:55 +01:00
cybermaggedon
6ac8a7c2d9
Fix/document rag ( #506 )
...
* Fix missing document RAG user/collection params
* Added test
2025-09-09 15:30:11 +01:00
cybermaggedon
266454e75f
Feature/group state cli ( #505 )
2025-09-08 21:44:57 +01:00
cybermaggedon
5867f45c3a
Fix/agent groups broken ( #504 )
...
* Fix non-backward-compatible agent changes
* Fix broken agents
2025-09-08 21:17:18 +01:00
