mirror of
https://github.com/trustgraph-ai/trustgraph.git
synced 2026-04-25 00:16:23 +02:00
d35473f7f7
Introduces `workspace` as the isolation boundary for config, flows,
library, and knowledge data. Removes `user` as a schema-level field
throughout the code, API specs, and tests; workspace provides the
same separation more cleanly at the trusted flow.workspace layer
rather than through client-supplied message fields.
Design
------
- IAM tech spec (docs/tech-specs/iam.md) documents current state,
proposed auth/access model, and migration direction.
- Data ownership model (docs/tech-specs/data-ownership-model.md)
captures the workspace/collection/flow hierarchy.
Schema + messaging
------------------
- Drop `user` field from AgentRequest/Step, GraphRagQuery,
DocumentRagQuery, Triples/Graph/Document/Row EmbeddingsRequest,
Sparql/Rows/Structured QueryRequest, ToolServiceRequest.
- Keep collection/workspace routing via flow.workspace at the
service layer.
- Translators updated to not serialise/deserialise user.
API specs
---------
- OpenAPI schemas and path examples cleaned of user fields.
- Websocket async-api messages updated.
- Removed the unused parameters/User.yaml.
Services + base
---------------
- Librarian, collection manager, knowledge, config: all operations
scoped by workspace. Config client API takes workspace as first
positional arg.
- `flow.workspace` set at flow start time by the infrastructure;
no longer pass-through from clients.
- Tool service drops user-personalisation passthrough.
CLI + SDK
---------
- tg-init-workspace and workspace-aware import/export.
- All tg-* commands drop user args; accept --workspace.
- Python API/SDK (flow, socket_client, async_*, explainability,
library) drop user kwargs from every method signature.
MCP server
----------
- All tool endpoints drop user parameters; socket_manager no longer
keyed per user.
Flow service
------------
- Closure-based topic cleanup on flow stop: only delete topics
whose blueprint template was parameterised AND no remaining
live flow (across all workspaces) still resolves to that topic.
Three scopes fall out naturally from template analysis:
* {id} -> per-flow, deleted on stop
* {blueprint} -> per-blueprint, kept while any flow of the
same blueprint exists
* {workspace} -> per-workspace, kept while any flow in the
workspace exists
* literal -> global, never deleted (e.g. tg.request.librarian)
Fixes a bug where stopping a flow silently destroyed the global
librarian exchange, wedging all library operations until manual
restart.
RabbitMQ backend
----------------
- heartbeat=60, blocked_connection_timeout=300. Catches silently
dead connections (broker restart, orphaned channels, network
partitions) within ~2 heartbeat windows, so the consumer
reconnects and re-binds its queue rather than sitting forever
on a zombie connection.
Tests
-----
- Full test refresh: unit, integration, contract, provenance.
- Dropped user-field assertions and constructor kwargs across
~100 test files.
- Renamed user-collection isolation tests to workspace-collection.
103 lines
3.2 KiB
YAML
103 lines
3.2 KiB
YAML
type: object
|
|
description: |
|
|
Librarian service request for document library management.
|
|
|
|
Operations: add-document, remove-document, list-documents,
|
|
get-document-metadata, stream-document, add-child-document,
|
|
list-children, begin-upload, upload-chunk, complete-upload,
|
|
abort-upload, get-upload-status, list-uploads,
|
|
start-processing, stop-processing, list-processing
|
|
required:
|
|
- operation
|
|
properties:
|
|
operation:
|
|
type: string
|
|
enum:
|
|
- add-document
|
|
- remove-document
|
|
- list-documents
|
|
- get-document-metadata
|
|
- get-document-content
|
|
- stream-document
|
|
- add-child-document
|
|
- list-children
|
|
- begin-upload
|
|
- upload-chunk
|
|
- complete-upload
|
|
- abort-upload
|
|
- get-upload-status
|
|
- list-uploads
|
|
- start-processing
|
|
- stop-processing
|
|
- list-processing
|
|
description: |
|
|
Library operation:
|
|
- `add-document`: Add document to library
|
|
- `remove-document`: Remove document from library
|
|
- `list-documents`: List documents in library
|
|
- `get-document-metadata`: Get document metadata
|
|
- `get-document-content`: Get full document content in a single response.
|
|
**Deprecated** — use `stream-document` instead. Fails for documents
|
|
exceeding the broker's max message size.
|
|
- `stream-document`: Stream document content in chunks. Each response
|
|
includes `chunk_index` and `is_final`. Preferred over `get-document-content`
|
|
for all document sizes.
|
|
- `add-child-document`: Add a child document (e.g. page, chunk)
|
|
- `list-children`: List child documents of a parent
|
|
- `begin-upload`: Start a chunked upload session
|
|
- `upload-chunk`: Upload a chunk of data
|
|
- `complete-upload`: Finalize a chunked upload
|
|
- `abort-upload`: Cancel a chunked upload
|
|
- `get-upload-status`: Check upload progress
|
|
- `list-uploads`: List active upload sessions
|
|
- `start-processing`: Start processing library documents
|
|
- `stop-processing`: Stop library processing
|
|
- `list-processing`: List processing status
|
|
flow:
|
|
type: string
|
|
description: Flow ID
|
|
example: my-flow
|
|
collection:
|
|
type: string
|
|
description: Collection identifier
|
|
default: default
|
|
example: default
|
|
document-id:
|
|
type: string
|
|
description: Document identifier
|
|
example: doc-123
|
|
processing-id:
|
|
type: string
|
|
description: Processing task identifier
|
|
example: proc-456
|
|
document-metadata:
|
|
$ref: '../common/DocumentMetadata.yaml'
|
|
processing-metadata:
|
|
$ref: '../common/ProcessingMetadata.yaml'
|
|
content:
|
|
type: string
|
|
description: Document content (for add-document with inline content)
|
|
example: This is the document content...
|
|
criteria:
|
|
type: array
|
|
description: Search criteria for filtering documents
|
|
items:
|
|
type: object
|
|
required:
|
|
- key
|
|
- value
|
|
- operator
|
|
properties:
|
|
key:
|
|
type: string
|
|
description: Metadata field name
|
|
example: author
|
|
value:
|
|
type: string
|
|
description: Value to match
|
|
example: John Doe
|
|
operator:
|
|
type: string
|
|
enum: [eq, ne, gt, lt, contains]
|
|
description: Comparison operator
|
|
example: eq
|