Commit graph

934 commits

Author SHA1 Message Date
Cyber MacGeddon
f2e2793339 Improved, mapped from classes to properties 2025-11-12 19:32:43 +00:00
Cyber MacGeddon
e3289243bb Fixed missing URIs from ontology 2025-11-12 17:55:10 +00:00
Cyber MacGeddon
828540aebc Refactored URI stuff 2025-11-12 17:40:57 +00:00
Cyber MacGeddon
bf067e1d2d Update ontology prompt 2025-11-12 17:19:50 +00:00
Cyber MacGeddon
2356fce876 Fixing prompt invocation 2025-11-12 17:17:25 +00:00
Cyber MacGeddon
3ff16fdcf6 Ontology matching not working, debug 2025-11-12 17:03:22 +00:00
Cyber MacGeddon
e00d69fb82 Fix dimension stuff 2025-11-12 16:59:18 +00:00
Cyber MacGeddon
92647cf088 Ontology fix 2025-11-12 16:56:23 +00:00
Cyber MacGeddon
4fb602242d Fix nltk stuff 2025-11-12 16:50:47 +00:00
Cyber MacGeddon
0410e7dc9d Fix flow lifetimes 2025-11-12 16:48:49 +00:00
Cyber MacGeddon
d624247dbd Fix crash 2025-11-12 16:15:22 +00:00
Cyber MacGeddon
dfd7ad3a56 Refactor to use config event queue 2025-11-12 16:05:10 +00:00
Cyber MacGeddon
ef0f2b6837 Fix a missing definition, register ontology extractor endpoint 2025-11-12 15:59:23 +00:00
Cyber MacGeddon
3f183b3c7b Onto-rag tech spec + first pass implementation 2025-11-12 13:05:50 +00:00
cybermaggedon
4c3db4dbbe
MCP auth for the simple case (#557)
* MCP auth token header

* Mention limitations

* Fix AgentStep schema error by converting argument values to strings.

* Added tests for MCP auth and agent step parsing
2025-11-11 12:28:53 +00:00
cybermaggedon
d9d4c91363
Dynamic embeddings model (#556)
* Dynamic embeddings model selection

* Added tests

* HF embeddings are skipped, tests don't run with that package currently tests
2025-11-10 20:38:01 +00:00
cybermaggedon
6129bb68c1
Fix hard coded vector size (#555)
* Fixed hard-coded embeddings store size

* Vector store lazy-creates collections, different collections for
  different dimension lengths.

* Added tech spec for vector store lifecycle

* Fixed some tests for the new spec
2025-11-10 16:56:51 +00:00
cybermaggedon
05b9063fea
Feature/python3.13 (#553)
* Python to 3.13

* cassandra-driver -> scylla-driver
  (cassandra-driver doesn't work with Python 3.13)
2025-10-11 12:19:26 +01:00
cybermaggedon
51107008fd
master -> 1.5 (README updates) (#552) 2025-10-11 11:46:03 +01:00
cybermaggedon
ad35656811
Prepare 1.5 release branch (#550) 2025-10-11 11:44:00 +01:00
cybermaggedon
77fdec2c2d
Fix chunk params not converted (#549) 2025-10-07 00:04:34 +01:00
cybermaggedon
09930bdb86
Fix deletion error in Cassandra object store (#546)
* Iteration algorithm modified to look for tables using schema definitions rather than iterate over all tables
2025-10-06 17:45:02 +01:00
cybermaggedon
35ef9bd71c
Apply fix, incorrect statement invocation (#545) 2025-10-06 14:24:46 +01:00
cybermaggedon
3e23d3c3ed
Fix collection management sync prob (#544)
* Address creation/deletion sync problems

* Fix object writer management

* Get Milvus to use ANN
2025-09-30 23:04:28 +01:00
cybermaggedon
b7bf7388aa
Reduce log spam (#543) 2025-09-30 16:04:07 +01:00
cybermaggedon
52b133fc86
Collection delete pt. 3 (#542)
* Fixing collection deletion

* Fixing collection management param error

* Always test for collections

* Add Cassandra collection table

* Updated tech spec for explicit creation/deletion

* Remove implicit collection creation

* Fix up collection tracking in all processors
2025-09-30 16:02:33 +01:00
cybermaggedon
dc79b10552
Feaature/flow default params (#541)
* Flow creation uses parameter defaults in API and CLI

* Submit strings for flow parameters
2025-09-30 14:06:08 +01:00
cybermaggedon
d1456e547c
Fix label issue in metrics (#540) 2025-09-26 14:13:22 +01:00
cybermaggedon
10806caac2
Fix label names (#539) 2025-09-26 12:34:40 +01:00
cybermaggedon
209d0de0b8
Add missing file (#538) 2025-09-26 11:28:15 +01:00
cybermaggedon
8354ea1276
Update flow parameter tech spec for advanced params (#537)
* Add advanced mode to tech spec,  fix enum description in tech spec

* Updated tech-spec for controlled-by relationship between parameters

* Update tg-show-flows CLI

* Update tg-show-flows, tg-show-flow-classes, tg-start-flow CLI

* Add tg-show-parameter-types
2025-09-26 10:55:10 +01:00
cybermaggedon
8929a680a1
Chunking dynamic params (#536)
* Chunking params are dynamic

* Update tests
2025-09-26 10:53:32 +01:00
cybermaggedon
43cfcb18a0
More LLM param test coverage (#535)
* More LLM tests

* Fixing tests
2025-09-26 01:00:30 +01:00
cybermaggedon
b0a3716b0e
Tests are failing (#534)
* Fix tests, update to new model parameter usage
2025-09-25 21:32:19 +01:00
cybermaggedon
6f4f7ce6b4
Flow temperature parameter (#533)
* Add temperature parameter to LlmService and roll out to all LLMs
2025-09-25 21:26:11 +01:00
cybermaggedon
aa8e422e8c
Flow configurable parameters (#532)
* Fix pyproject.toml missing requests dep

* parameters is now parameter-types

* Update flow parameters tech spec for recent changes (no impact on this repo)
2025-09-25 19:11:40 +01:00
cybermaggedon
7a3bfad826
LLM dynamic settings, using the llm-model and llm-rag-model paramters to a flow (#531)
* Ported LLMs to dynamic models
2025-09-24 16:36:25 +01:00
cybermaggedon
9a34ab1b93
Complete remaining parameter work (#530)
* Fix CLI typo

* Complete flow parameters work, still needs implementation in LLMs
2025-09-24 13:58:34 +01:00
cybermaggedon
72c9acad30
Fix CLI typo (#529) 2025-09-23 23:34:36 +01:00
cybermaggedon
dc2fa1f31e
flow parameters (#526)
* Flow parameter tech spec

* Flow configurable parameters implemented
2025-09-23 23:18:04 +01:00
cybermaggedon
3b0b13d74d
Remove excessive request/response logging (#528) 2025-09-23 21:07:00 +01:00
cybermaggedon
45a14b5958
Graph rag optimisations (#527)
* Tech spec for GraphRAG optimisation

* Implement GraphRAG optimisation and update tests
2025-09-23 21:05:51 +01:00
cybermaggedon
fcd15d1833
Collection management part 2 (#522)
* Plumb collection manager into librarian

* Test end-to-end
2025-09-19 16:08:47 +01:00
cybermaggedon
d378db9370
Cassandra performance enhancement (#521)
* Tech spec

* Tech spec complete

* Cassandra multi-table for performance
2025-09-18 19:52:05 +01:00
cybermaggedon
13ff7d765d
Collection management (#520)
* Tech spec

* Refactored Cassanda knowledge graph for single table

* Collection management, librarian services to manage metadata and collection deletion
2025-09-18 15:57:52 +01:00
cybermaggedon
48016d8fb2
Added XML, JSON, CSV detection (#519)
* Improved XML detect, added schema selection

* Add schema select + tests

* API additions

* More tests

* Fixed tests
2025-09-16 23:53:43 +01:00
cybermaggedon
3d783f4bd4
Structure data diagnosis service (#518)
* Import flow tech spec

* Structured diag service

* Plumbed into API gateway

* Type detector

* Diag service

* Added entry point
2025-09-16 21:43:23 +01:00
cybermaggedon
d73af56690
Fix/websocket close await (1.4) (#517)
* Vector stores will create collections on query (#511)

* Return empty embeddings list as empty list through gateway (#513)

* Await async websocket closure
2025-09-11 15:56:22 +01:00
cybermaggedon
f6bccd7438
Parallel contain builds (#515) 2025-09-11 12:32:04 +01:00
cybermaggedon
0e4fcb87de
Return empty embeddings list as empty list through gateway (#514) 2025-09-11 00:34:45 +01:00