cybermaggedon
f79d0603f7
Update to add streaming tests ( #600 )
2026-01-06 21:48:05 +00:00
cybermaggedon
f0c95a4c5e
Fix streaming API niggles ( #599 )
...
* Fix end-of-stream anomally with some graph-rag and document-rag
* Fix gateway translators dropping responses
2026-01-06 16:41:35 +00:00
cybermaggedon
3c675b8cfc
Fix doc embedding schema messages ( #598 )
2026-01-05 17:46:08 +00:00
cybermaggedon
fe2dd704a2
Fix optionality in objects-query schema ( #596 )
2026-01-05 15:40:53 +00:00
cybermaggedon
ae13190093
Address legacy issues in storage management ( #595 )
...
* Removed legacy storage management cruft. Tidied tech specs.
* Fix deletion of last collection
* Storage processor ignores data on the queue which is for a deleted collection
* Updated tests
2026-01-05 13:45:14 +00:00
cybermaggedon
5304f96fe6
Fix tests ( #593 )
...
* Fix unit/integration/contract tests which were broken by messaging fabric work
2025-12-19 08:53:21 +00:00
cybermaggedon
34eb083836
Messaging fabric plugins ( #592 )
...
* Plugin architecture for messaging fabric
* Schemas use a technology neutral expression
* Schemas strictness has uncovered some incorrect schema use which is fixed
2025-12-17 21:40:43 +00:00
cybermaggedon
727b6bc9d6
Add service ID to log entry instead of module name ( #588 )
2025-12-10 11:07:43 +00:00
cybermaggedon
f12fcc2652
Loki logging ( #586 )
...
* Consolidate logging into a single module
* Added Loki logging
* Update tech spec
* Add processor label
* Fix recursive log entries, logging Loki"s internals
2025-12-09 23:24:41 +00:00
cybermaggedon
39f6a8b940
Fix/queue configurations ( #585 )
...
* Fix config-svc startup dupe CLI args
* Fix missing params on collection service
* Fix collection management handling
2025-12-06 14:54:47 +00:00
cybermaggedon
7d07f802a8
Basic multitenant support ( #583 )
...
* Tech spec
* Address multi-tenant queue option problems in CLI
* Modified collection service to use config
* Changed storage management to use the config service definition
2025-12-05 21:45:30 +00:00
cybermaggedon
664bce6182
Fix Python streaming SDK issues ( #580 )
...
* Fix verify CLI issues
* Fixing content mechanisms in API
* Fixing error handling
* Fixing invoke_prompt, invoke_llm, invoke_agent
2025-12-04 20:42:25 +00:00
cybermaggedon
01aeede78b
Python API implements streaming interfaces ( #577 )
...
* Tech spec
* Python CLI utilities updated to use the API including streaming features
* Added type safety to Python API
* Completed missing auth token support in CLI
2025-12-04 17:38:57 +00:00
cybermaggedon
1948edaa50
Streaming rag responses ( #568 )
...
* Tech spec for streaming RAG
* Support for streaming Graph/Doc RAG
2025-11-26 19:47:39 +00:00
cybermaggedon
b1cc724f7d
Streaming LLM part 2 ( #567 )
...
* Updates for agent API with streaming support
* Added tg-dump-queues tool to dump Pulsar queues to a log
* Updated tg-invoke-agent, incremental output
* Queue dumper CLI - might be useful for debug
* Updating for tests
2025-11-26 15:16:17 +00:00
cybermaggedon
310a2deb06
Feature/streaming llm phase 1 ( #566 )
...
* Tidy up duplicate tech specs in doc directory
* Streaming LLM text-completion service tech spec.
* text-completion and prompt interfaces
* streaming change applied to all LLMs, so far tested with VertexAI
* Skip Pinecone unit tests, upstream module issue is affecting things, tests are passing again
* Added agent streaming, not working and has broken tests
2025-11-26 09:59:10 +00:00
cybermaggedon
c69f5207a4
OntoRAG: Ontology-Based Knowledge Extraction and Query Technical Specification ( #523 )
...
* Onto-rag tech spec
* New processor kg-extract-ontology, use 'ontology' objects from config to guide triple extraction
* Also entity contexts
* Integrate with ontology extractor from workbench
This is first phase, the extraction is tested and working, also GraphRAG with the extracted knowledge works
2025-11-12 20:38:08 +00:00
cybermaggedon
d9d4c91363
Dynamic embeddings model ( #556 )
...
* Dynamic embeddings model selection
* Added tests
* HF embeddings are skipped, tests don't run with that package currently tests
2025-11-10 20:38:01 +00:00
cybermaggedon
d1456e547c
Fix label issue in metrics ( #540 )
2025-09-26 14:13:22 +01:00
cybermaggedon
10806caac2
Fix label names ( #539 )
2025-09-26 12:34:40 +01:00
cybermaggedon
8929a680a1
Chunking dynamic params ( #536 )
...
* Chunking params are dynamic
* Update tests
2025-09-26 10:53:32 +01:00
cybermaggedon
6f4f7ce6b4
Flow temperature parameter ( #533 )
...
* Add temperature parameter to LlmService and roll out to all LLMs
2025-09-25 21:26:11 +01:00
cybermaggedon
aa8e422e8c
Flow configurable parameters ( #532 )
...
* Fix pyproject.toml missing requests dep
* parameters is now parameter-types
* Update flow parameters tech spec for recent changes (no impact on this repo)
2025-09-25 19:11:40 +01:00
cybermaggedon
7a3bfad826
LLM dynamic settings, using the llm-model and llm-rag-model paramters to a flow ( #531 )
...
* Ported LLMs to dynamic models
2025-09-24 16:36:25 +01:00
cybermaggedon
9a34ab1b93
Complete remaining parameter work ( #530 )
...
* Fix CLI typo
* Complete flow parameters work, still needs implementation in LLMs
2025-09-24 13:58:34 +01:00
cybermaggedon
dc2fa1f31e
flow parameters ( #526 )
...
* Flow parameter tech spec
* Flow configurable parameters implemented
2025-09-23 23:18:04 +01:00
cybermaggedon
3b0b13d74d
Remove excessive request/response logging ( #528 )
2025-09-23 21:07:00 +01:00
cybermaggedon
fcd15d1833
Collection management part 2 ( #522 )
...
* Plumb collection manager into librarian
* Test end-to-end
2025-09-19 16:08:47 +01:00
cybermaggedon
13ff7d765d
Collection management ( #520 )
...
* Tech spec
* Refactored Cassanda knowledge graph for single table
* Collection management, librarian services to manage metadata and collection deletion
2025-09-18 15:57:52 +01:00
cybermaggedon
48016d8fb2
Added XML, JSON, CSV detection ( #519 )
...
* Improved XML detect, added schema selection
* Add schema select + tests
* API additions
* More tests
* Fixed tests
2025-09-16 23:53:43 +01:00
cybermaggedon
3d783f4bd4
Structure data diagnosis service ( #518 )
...
* Import flow tech spec
* Structured diag service
* Plumbed into API gateway
* Type detector
* Diag service
* Added entry point
2025-09-16 21:43:23 +01:00
cybermaggedon
0e4fcb87de
Return empty embeddings list as empty list through gateway ( #514 )
2025-09-11 00:34:45 +01:00
cybermaggedon
5867f45c3a
Fix/agent groups broken ( #504 )
...
* Fix non-backward-compatible agent changes
* Fix broken agents
2025-09-08 21:17:18 +01:00
cybermaggedon
f22bf13aa6
Extend use of user + collection fields ( #503 )
...
* Collection+user fields in structured query
* User/collection in structured query & agent
2025-09-08 18:28:38 +01:00
cybermaggedon
0b7620bc04
Object batching ( #499 )
...
* Object batching
* Update tests
2025-09-05 15:59:06 +01:00
cybermaggedon
ed0e02791d
Feature/structured query tool integration ( #493 )
...
* Agent integration to structured query
* Update tests
2025-09-04 16:23:43 +01:00
cybermaggedon
a6d9f5e849
Structured query support ( #492 )
...
* Tweak the structured query schema
* Structure query service
* Gateway support for nlp-query and structured-query
* API support
* Added CLI
* Update tests
* More tests
2025-09-04 16:06:18 +01:00
cybermaggedon
8d4aa0069c
NLP query to GraphQL service ( #491 )
2025-09-04 13:39:47 +01:00
cybermaggedon
85e669c763
Fixing more Cassandra consistency issues ( #488 )
...
* Fixing more Cassandra work
* Fix tests
2025-09-04 00:58:11 +01:00
cybermaggedon
ccaec88a72
Feature/consolidate cassandra config ( #483 )
...
* Cassandra consolidation of parameters
* New Cassandra configuration helper
* Implemented Cassanda config refactor
* New tests
2025-09-03 23:41:22 +01:00
cybermaggedon
e74eb5d1ff
Feature/tool group ( #484 )
...
* Tech spec for tool group
* Partial tool group implementation
* Tool group tests
2025-09-03 23:39:49 +01:00
cybermaggedon
672e358b2f
Feature/graphql table query ( #486 )
...
* Tech spec
* Object query service for Cassandra
* Gateway support for objects-query
* GraphQL query utility
* Filters, ordering
2025-09-03 23:39:11 +01:00
cybermaggedon
38826c7de1
trustgraph-base .chunks / .documents confusion in the API ( #481 )
...
* trustgraph-base .chunks / .documents confusion in the API
* Added tests, fixed test failures in code
* Fix file dup error
* Fix contract error
2025-09-02 17:58:53 +01:00
cybermaggedon
96c2b73457
Fix import export graceful shutdown ( #476 )
...
* Tech spec for graceful shutdown
* Graceful shutdown of importers/exporters
* Update socket to include graceful shutdown orchestration
* Adding tests for conditions tracked in this PR
2025-08-28 13:39:28 +01:00
cybermaggedon
97cfbb5ea4
Always return flow-ids when empty list ( #464 )
2025-08-21 23:52:08 +01:00
cybermaggedon
83f0c1e7f3
Structure data mvp ( #452 )
...
* Structured data tech spec
* Architecture principles
* New schemas
* Updated schemas and specs
* Object extractor
* Add .coveragerc
* New tests
* Cassandra object storage
* Trying to object extraction working, issues exist
2025-08-07 20:47:20 +01:00
cybermaggedon
5de56c5dbc
Schema structure refactor ( #451 )
...
* Write schema refactor spec
* Implemented schema refactor spec
2025-08-04 21:42:57 +01:00
cybermaggedon
8f0828c9a6
Fix logging startup problems ( #447 )
2025-07-31 00:16:42 +01:00
cybermaggedon
069bae7e77
Fix logging startup problems ( #446 )
2025-07-31 00:01:08 +01:00
cybermaggedon
444d205251
Fix/startup failure ( #445 )
...
* Fix loggin startup problems
2025-07-30 23:42:11 +01:00
