5 commits

Author	SHA1	Message	Date
cybermaggedon	a9197d11ee	Feature/configure flows (#345) ... - Keeps processing in different flows separate so that data can go to different stores / collections etc. - Potentially supports different processing flows - Tidies the processing API with common base-classes for e.g. LLMs, and automatic configuration of 'clients' to use the right queue names in a flow	2025-04-22 20:21:38 +01:00
cybermaggedon	f350abb415	Maint/asyncio (#305) ... * Move to asyncio services, even though everything is largely sync	2025-02-11 23:24:46 +00:00
cybermaggedon	7954e863cc	Feature: document metadata (#123) ... * Rework metadata structure in processing messages to be a subgraph * Add subgraph creation for tg-load-pdf and tg-load-text based on command-line passing of doc attributes * Document metadata is added to knowledge graph with subjectOf linkage to extracted entities	2024-10-23 18:04:04 +01:00
cybermaggedon	b0f4c58200	Feature / collections (#96) ... * Update schema defs for source -> metadata * Migrate to use metadata part of schema, also add metadata to triples & vecs * Add user/collection metadata to query * Use user/collection in RAG * Write and query working on triples	2024-10-02 18:14:29 +01:00
cybermaggedon	9b91d5eee3	Feature/pkgsplit (#83) ... * Starting to spawn base package * More package hacking * Bedrock and VertexAI * Parquet split * Updated templates * Utils	2024-09-30 19:36:09 +01:00