trustgraph/trustgraph-flow/trustgraph
Cyber MacGeddon 4f7351f285 Pub/sub abstraction: decouple from Pulsar
Remove Pulsar-specific concepts from application code so that
the pub/sub backend is swappable via configuration.

Rename translators:
- to_pulsar/from_pulsar → decode/encode across all translator
  classes, dispatch handlers, and tests (55+ files)
- from_response_with_completion → encode_with_completion
- Remove pulsar.schema.Record from translator base class

Queue naming (CLASS:TOPICSPACE:TOPIC):
- Replace topic() helper with queue() using new format:
  flow:tg:name, request:tg:name, response:tg:name, state:tg:name
- Queue class implies persistence/TTL (no QoS in names)
- Update Pulsar backend map_topic() to parse new format
- Librarian queues use flow class (persistent, for chunking)
- Config push uses state class (persistent, last-value)
- Remove 15 dead topic imports from schema files
- Update init_trustgraph.py namespace: config → state

Confine Pulsar to pulsar_backend.py:
- Delete legacy PulsarClient class from pubsub.py
- Move add_args to add_pubsub_args() with standalone flag
  for CLI tools (defaults to localhost)
- PulsarBackendConsumer.receive() catches _pulsar.Timeout,
  raises standard TimeoutError
- Remove Pulsar imports from: async_processor, flow_processor,
  log_level, all 11 client files, 4 storage writers, gateway
  service, gateway config receiver
- Remove log_level/LoggerLevel from client API
- Rewrite tg-monitor-prompts to use backend abstraction
- Update tg-dump-queues to use add_pubsub_args

Also: pubsub-abstraction.md tech spec covering problem statement,
design goals, as-is requirements, candidate broker assessment,
approach, and implementation order.
2026-04-01 20:11:13 +01:00
..
agent Wire message_id on all answer chunks, fix DAG structure (#748) 2026-04-01 13:27:41 +01:00
chunking Use UUID-based URNs for page and chunk IDs (#703) 2026-03-21 21:17:03 +00:00
config/service Fix config inconsistency (#609) 2026-01-14 12:31:40 +00:00
cores Fixed flows/flow key issue in config (#616) 2026-01-16 00:10:44 +00:00
decoding Fix stray log messages caused by librarian messages (#706) 2026-03-23 13:16:39 +00:00
direct Fix Cassandra schema and graph filter semantics (#680) 2026-03-10 12:52:51 +00:00
embeddings Embeddings API scores (#671) 2026-03-09 10:53:44 +00:00
external Implement logging strategy (#444) 2025-07-30 23:18:38 +01:00
extract Pub/sub abstraction: decouple from Pulsar 2026-04-01 20:11:13 +01:00
gateway Pub/sub abstraction: decouple from Pulsar 2026-04-01 20:11:13 +01:00
librarian Add universal document decoder with multi-format support (#705) 2026-03-23 12:56:35 +00:00
metering Fix config inconsistency (#609) 2026-01-14 12:31:40 +00:00
model Fix OpenAI compatibility issues for newer models and Azure config (#727) 2026-03-28 11:19:45 +00:00
processing Fix/startup failure (#445) 2025-07-30 23:42:11 +01:00
prompt Feature/streaming llm phase 1 (#566) 2025-11-26 09:59:10 +00:00
query Fix ontology RAG pipeline + add query concurrency (#691) 2026-03-12 11:34:42 +00:00
retrieval Split Analysis into Analysis+ToolUse and Observation, add message_id (#747) 2026-03-31 17:51:22 +01:00
rev_gateway Messaging fabric plugins (#592) 2025-12-17 21:40:43 +00:00
storage Pub/sub abstraction: decouple from Pulsar 2026-04-01 20:11:13 +01:00
tables The id field in pipeline Metadata was being overwritten at each processing (#686) 2026-03-11 12:16:39 +00:00
template Feature/prompts jsonl (#619) 2026-01-26 17:38:00 +00:00
tool_service Tool services - dynamically pluggable tool implementations for agent frameworks (#658) 2026-03-04 14:51:32 +00:00
__init__.py Feature/pkgsplit (#83) 2024-09-30 19:36:09 +01:00