* Updates for agent API with streaming support
* Added tg-dump-queues tool to dump Pulsar queues to a log
* Updated tg-invoke-agent, incremental output
* Queue dumper CLI - might be useful for debug
* Updating for tests
* Tidy up duplicate tech specs in doc directory
* Streaming LLM text-completion service tech spec.
* text-completion and prompt interfaces
* streaming change applied to all LLMs, so far tested with VertexAI
* Skip Pinecone unit tests, upstream module issue is affecting things, tests are passing again
* Added agent streaming, not working and has broken tests
* Onto-rag tech spec
* New processor kg-extract-ontology, use 'ontology' objects from config to guide triple extraction
* Also entity contexts
* Integrate with ontology extractor from workbench
This is first phase, the extraction is tested and working, also GraphRAG with the extracted knowledge works
* Fix pyproject.toml missing requests dep
* parameters is now parameter-types
* Update flow parameters tech spec for recent changes (no impact on this repo)
* Tweak the structured query schema
* Structure query service
* Gateway support for nlp-query and structured-query
* API support
* Added CLI
* Update tests
* More tests
* Tech spec for graceful shutdown
* Graceful shutdown of importers/exporters
* Update socket to include graceful shutdown orchestration
* Adding tests for conditions tracked in this PR
* Implement KG extraction agent (kg-extract-agent)
* Using ReAct framework (agent-manager-react)
* ReAct manager had an issue when emitting JSON, which conflicts which ReAct manager's own JSON messages, so refactored ReAct manager to use traditional ReAct messages, non-JSON structure.
* Minor refactor to take the prompt template client out of prompt-template so it can be more readily used by other modules. kg-extract-agent uses this framework.
Key Features
- MCP Tool Integration: Added core MCP tool support with ToolClientSpec and ToolClient classes
- API Enhancement: New mcp_tool method for flow-specific tool invocation
- CLI Tooling: New tg-invoke-mcp-tool command for testing MCP integration
- React Agent Enhancement: Fixed and improved multi-tool invocation capabilities
- Tool Management: Enhanced CLI for tool configuration and management
Changes
- Added MCP tool invocation to API with flow-specific integration
- Implemented ToolClientSpec and ToolClient for tool call handling
- Updated agent-manager-react to invoke MCP tools with configurable types
- Enhanced CLI with new commands and improved help text
- Added comprehensive documentation for new CLI commands
- Improved tool configuration management
Testing
- Added tg-invoke-mcp-tool CLI command for isolated MCP integration testing
- Enhanced agent capability to invoke multiple tools simultaneously
- MCP client service
- Tool request/response schema
- API gateway support for mcp-tool
- Message translation for tool request & response
- Make mcp-tool using configuration service for information
about where the MCP services are.