3 commits

Author	SHA1	Message	Date
cybermaggedon	1948edaa50	Streaming rag responses (#568) ... * Tech spec for streaming RAG * Support for streaming Graph/Doc RAG	2025-11-26 19:47:39 +00:00
cybermaggedon	b1cc724f7d	Streaming LLM part 2 (#567) ... * Updates for agent API with streaming support * Added tg-dump-queues tool to dump Pulsar queues to a log * Updated tg-invoke-agent, incremental output * Queue dumper CLI - might be useful for debug * Updating for tests	2025-11-26 15:16:17 +00:00
cybermaggedon	310a2deb06	Feature/streaming llm phase 1 (#566) ... * Tidy up duplicate tech specs in doc directory * Streaming LLM text-completion service tech spec. * text-completion and prompt interfaces * streaming change applied to all LLMs, so far tested with VertexAI * Skip Pinecone unit tests, upstream module issue is affecting things, tests are passing again * Added agent streaming, not working and has broken tests	2025-11-26 09:59:10 +00:00