apunkt/trustgraph
1
0
Fork 0
mirror of https://github.com/trustgraph-ai/trustgraph.git synced 2026-04-25 16:36:21 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Sample docs loader (#365)

Browse source
This commit is contained in:
cybermaggedon 2025-05-06 13:43:17 +01:00 • committed by GitHub
parent 9e4eb634a4
commit 54e475fa3a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
34 changed files with 818 additions and 56 deletions
Download patch file Download diff file Expand all files Collapse all files

10
trustgraph-cli/scripts/tg-save-doc-embeds
View file

@ -2,11 +2,11 @@
"""
This utility connects to a running TrustGraph through the API and creates
a knowledge core from the data streaming through the processing queues.
For completeness of data, tg-save-kg-core should be initiated before data
loading takes place. The default output format, msgpack should be used.
JSON output format is also available - msgpack produces a more compact
representation, which is also more performant to load.
a document embeddings core from the data streaming through the processing
queues. For completeness of data, tg-save-doc-embeds should be initiated
before data loading takes place. The default output format, msgpack
should be used. JSON output format is also available - msgpack produces
a more compact representation, which is also more performant to load.
"""
import aiohttp