Feature: document metadata (#123)

* Rework metadata structure in processing messages to be a subgraph
* Add subgraph creation for tg-load-pdf and tg-load-text based on command-line passing of doc attributes
* Document metadata is added to knowledge graph with subjectOf linkage to extracted entities

trustgraph-flow/trustgraph/chunking/token/chunker.py

@@ -62,16 +62,8 @@ class Processor(ConsumerProducer):
 
         for ix, chunk in enumerate(texts):
 
-            id = v.metadata.id + "-c" + str(ix)
-
             r = Chunk(
-                metadata=Metadata(
-                    source=v.metadata.source,
-                    id=id,
-                    title=v.metadata.title,
-                    user=v.metadata.user,
-                    collection=v.metadata.collection,
-                ),
+                metadata=v.metadata,
                 chunk=chunk.page_content.encode("utf-8"),
             )