apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-28 18:06:21 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
832 commits 77 branches 498 tags 113 MiB
Commit graph

47 commits

Author SHA1 Message Date
cybermaggedon
444d205251
Fix/startup failure (#445) 
* Fix loggin startup problems
 2025-07-30 23:42:11 +01:00
cybermaggedon
dd70aade11
Implement logging strategy (#444) 
* Logging strategy and convert all prints() to logging invocations
 2025-07-30 23:18:38 +01:00
cybermaggedon
e56186054a
MCP client support (#427) 
- MCP client service
- Tool request/response schema
- API gateway support for mcp-tool
- Message translation for tool request & response
- Make mcp-tool using configuration service for information
  about where the MCP services are.
 2025-07-07 23:52:23 +01:00
cybermaggedon
f08e3c1b27
Feature/reverse gateway (#416) 
* Created reverse gateway

* Dispatched invoke message translations

* Added config receiver

* Provide a script to start rev-gateway
 2025-06-24 11:19:20 +01:00
cybermaggedon
a4e2f67cb1
Feature/translator classes (#414) 
Pull the JSON/Pulsar message translation into a separate module, will be useful for other comms channels
 2025-06-20 16:59:55 +01:00
cybermaggedon
8fc8880d51
Update kg core endpoint methods (#406) 2025-06-02 13:49:29 +01:00
cybermaggedon
2e577e900a
KG core upload/download uses query params (#405) 2025-05-29 19:56:04 +01:00
cybermaggedon
6f964e478e
Core stream in/out (#404) 2025-05-29 16:33:21 +01:00
cybermaggedon
3ed9274d84
Remove much logging output in gateway (#393) 2025-05-24 12:10:05 +01:00
Cyber MacGeddon
0507f10373 Entity contexts import/export 2025-05-17 13:25:09 +01:00
Cyber MacGeddon
410636b409 Fix missing queue initialisation 2025-05-17 13:01:52 +01:00
cybermaggedon
31b7ade44d
Feature/knowledge load (#372) 
* Switch off retry in Cassandra until we can differentiate retryable errors

* Fix config getvalues

* Loading knowledge cores works
 2025-05-08 00:41:45 +01:00
cybermaggedon
f7123ac57f
tg-put-kg-core command (#369) 2025-05-07 11:13:21 +01:00
cybermaggedon
807c19fd22
knowledge service (#367) 
* Write knowledge core elements to Cassandra

* Store service works, building management service

* kg-manager
 2025-05-06 23:44:10 +01:00
cybermaggedon
9e4eb634a4
Fix/chunking not enabled (#364) 
* Enable chunking by default in producer

* Fix some issues including uploading large docs
 2025-05-06 00:28:20 +01:00
cybermaggedon
ff28d26f4d
Feature/flow librarian (#361) 
* Update librarian to new API

* Implementing new schema with document + processing objects
 2025-05-04 22:26:19 +01:00
cybermaggedon
3b8b9ea866
Feature/flow api 3 (#358) 
* Working mux socket

* Change API to incorporate flow

* Add Flow ID to all relevant CLIs, not completely implemented

* Change tg-processor-state to use API gateway

* Updated all CLIs

* New tg-show-flow-state command

* tg-show-flow-state shows classes too
 2025-05-03 10:39:53 +01:00
cybermaggedon
a70ae9793a
Flow API - update gateway (#357) 
* Altered API to incorporate Flow IDs, refactored for dynamic start/stop of flows
* Gateway: Split endpoint / dispatcher for maintainability
 2025-05-02 21:11:50 +01:00
cybermaggedon
450f664b1b
Feature/flow enable api gateway (#356) 
* Tweak timeouts, reduce stop time for publishers / subscribers

* More APIs working as flow endpoint
 2025-04-29 23:34:41 +01:00
cybermaggedon
3b021720c5
Feature/flow management cli (#346) 
Flow management API + various flow management commands

trustgraph-cli/scripts/tg-delete-flow-class
trustgraph-cli/scripts/tg-get-flow-class
trustgraph-cli/scripts/tg-put-flow-class
trustgraph-cli/scripts/tg-show-flow-classes
trustgraph-cli/scripts/tg-show-flows
trustgraph-cli/scripts/tg-start-flow
trustgraph-cli/scripts/tg-stop-flow
 2025-04-24 18:57:33 +01:00
cybermaggedon
a9197d11ee
Feature/configure flows (#345) 
- Keeps processing in different flows separate so that data can go to different stores / collections etc.
- Potentially supports different processing flows
- Tidies the processing API with common base-classes for e.g. LLMs, and automatic configuration of 'clients' to use the right queue names in a flow
 2025-04-22 20:21:38 +01:00
cybermaggedon
88eae0a9f0
Fix no version/config at startup (#333) 2025-04-01 20:54:59 +01:00
cybermaggedon
fa09dc319e
Feature/config service (#332) 
Configuration service provides an API to change configuration. Complete configuration is pushed down a config queue so that users have a complete copy of config object.
 2025-04-01 19:47:05 +01:00
cybermaggedon
a922852017
Fix async/sync load issues with knowledge streaming APIs (#315) 2025-03-15 12:38:10 +00:00
cybermaggedon
ef845d6c9b
Feature/rag parameters (#311) 
* Change document-rag and graph-rag processing so that the user can
specify parameters.  Changes in Pulsar services, Pulsar message
schemas, gateway and command-line tools.  User-visible changes in
new parameters on command-line tools.

* Fix bugs, graph-rag working

* Get subgraph truncation in the right place

* Graph RAG and document RAG working and configurable

* Multi-hop path traversal GraphRAG

* Add safety valve for path_size set too high
 2025-03-13 00:38:18 +00:00
cybermaggedon
f1559c5944
Feature/librarian (#310) 
* Add fields to library schema

* Added list function, incomplete

* Librarian list operation
 2025-03-11 16:52:59 +00:00
cybermaggedon
5575e885e5
Fix merge issues with api-key, conflicts with librarian changes (#309) 2025-02-15 12:25:26 +00:00
cybermaggedon
617eb7efd5
Feature/pulsar api key support (#308) 
* Add pulsar API token check

* Added missing api_key references

---------

Co-authored-by: Tyler O <4535788+toliver38@users.noreply.github.com>
 2025-02-15 11:22:48 +00:00
cybermaggedon
f7df2df266
Feature/librarian (#307) 
* Bring QDrant up-to-date

* Tables for data from queue outputs

- Pass single Pulsar client to everything in gateway & librarian
- Pulsar listener-name support in gateway
- PDF and text load working in librarian

* Complete Cassandra schema

* Add librarian support to templates
 2025-02-12 23:39:24 +00:00
cybermaggedon
f350abb415
Maint/asyncio (#305) 
* Move to asyncio services, even though everything is largely sync
 2025-02-11 23:24:46 +00:00
cybermaggedon
a0bf2362f6
Librarian (#304) 2025-02-11 16:01:03 +00:00
cybermaggedon
bed7423c26
- Added load/save API for document embeddings (#269) 
- tg-load-doc-embeds and tg-save-doc-embeds command line utils
 2025-01-16 00:00:59 +00:00
cybermaggedon
1280af3eff
Fix/kg core save (#267) 
* Add a 'localhost' Pulsar endpoint for docker env

* - Fix broken socket endpoint streamers
- Add unused listener endpoints for publisher/subscriber
- Fix graph embedding serialisation

* Fix GE load

* Remove Gossip settling delay, this is single-node Cassandra.
 2025-01-13 14:42:33 +00:00
cybermaggedon
dbdf65b84d
Added a metrics endpoint /api/v1/metrics/X which proxies to Prometheus (#251) 2025-01-05 19:24:43 +00:00
cybermaggedon
ae00831e39
Added missing file (#249) 2025-01-04 22:08:24 +00:00
cybermaggedon
6aa212061d
Fix/document embeddings (#247) 
* Update schema for doc embeddings

* Rename embeddings-vectorize to graph-embeddings

* Added document-embeddings processor (broken, needs fixing)

* Added scripts

* Fixed DE queue schema

* Add missing DE process

* Fix doc RAG processing, put graph-rag and doc-rag in appropriate component files.
 2025-01-04 21:51:28 +00:00
cybermaggedon
9a71ff6521
Fix ingested metadata (#231) 2024-12-29 20:02:12 +00:00
cybermaggedon
187b0e6581
Fix/websocket capacity increase (#230) 
* Fix invalid variable name invocation
* Fix error responses in websockets
* Increase websocket limits to 50MB max message.  Turn on Pulsar chunking by default.
 2024-12-29 18:08:12 +00:00
cybermaggedon
21e7b856c4
- Added missing document-load / text-load response on websocket (#228) 2024-12-29 11:32:10 +00:00
Cyber MacGeddon
e4fdde541e - Refactor doc load and text load to use a new ServiceSender class, 
similar to ServiceRequestor, but one-way.
- This means these two services are now available over websocket with
  document-load and text-load service IDs.
 2024-12-28 19:50:50 +00:00
cybermaggedon
7f5296feca
Refactor socket threading (#219) 
* Multiple requests can be handled in parallel.
* Refactor to fix timeout issue.
 2024-12-27 10:34:16 +00:00
cybermaggedon
317ae3186a
Rename /api/v1/mux to /api/v1/socket (#215) 2024-12-19 21:29:53 +00:00
cybermaggedon
8c1b468eb0
Fix async error (#212) 2024-12-17 12:43:16 +00:00
cybermaggedon
cd8d0c8cbc
Graph embedding query exposed through gateway (#208) 2024-12-10 22:15:56 +00:00
cybermaggedon
656dcb22a9
Feature/general websocket (#199) 
* Split API endpoint into endpoint and requestor
* Service/endpoint separation
* Call out to multiple services working
* Add ID field
* Add mux service on websocket, calls out to all services
 2024-12-06 23:56:10 +00:00
cybermaggedon
55c5c398b6
Fix relative imports (#197) 2024-12-06 13:37:44 +00:00
cybermaggedon
67d69b5285
Fixed a problem with the packages, api/__init__.py appeared in both (#196) 
trustgraph-flow and trustgraph-base, moved the gateway stuff into a
different directory.
 2024-12-06 13:05:56 +00:00