Change MinIO integration options in librarian to be more generic - to support a Garage integration (#594)

* Tweak object store parameters to be more generic for other S3-type store integration

* Update librarian to have region & SSL params

* Update MinIO migration tech spec
This commit is contained in:
cybermaggedon 2025-12-27 18:01:51 +00:00 committed by GitHub
parent 5304f96fe6
commit 25563bae3c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 333 additions and 44 deletions

View file

@ -1,8 +1,8 @@
# TrustGraph Librarian API
This API provides document library management for TrustGraph. It handles document storage,
metadata management, and processing orchestration using hybrid storage (MinIO for content,
Cassandra for metadata) with multi-user support.
This API provides document library management for TrustGraph. It handles document storage,
metadata management, and processing orchestration using hybrid storage (S3-compatible object
storage for content, Cassandra for metadata) with multi-user support.
## Request/response
@ -374,13 +374,14 @@ await client.add_processing(
## Features
- **Hybrid Storage**: MinIO for content, Cassandra for metadata
- **Hybrid Storage**: S3-compatible object storage (MinIO, Ceph RGW, AWS S3, etc.) for content, Cassandra for metadata
- **Multi-user Support**: User-based document ownership and access control
- **Rich Metadata**: RDF-style metadata triples and tagging system
- **Processing Integration**: Automatic triggering of document processing workflows
- **Content Types**: Support for multiple document formats (PDF, text, etc.)
- **Collection Management**: Optional document grouping by collection
- **Metadata Search**: Query documents by metadata criteria
- **Flexible Storage Backend**: Works with any S3-compatible storage (MinIO, Ceph RADOS Gateway, AWS S3, Cloudflare R2, etc.)
## Use Cases