2025-11-26 19:47:39 +00:00
|
|
|
"""Test utilities for TrustGraph tests"""
|
|
|
|
|
|
|
|
|
|
from .streaming_assertions import (
|
|
|
|
|
assert_streaming_chunks_valid,
|
|
|
|
|
assert_streaming_sequence,
|
|
|
|
|
assert_agent_streaming_chunks,
|
|
|
|
|
assert_rag_streaming_chunks,
|
|
|
|
|
assert_streaming_completion,
|
|
|
|
|
assert_streaming_content_matches,
|
|
|
|
|
assert_no_empty_chunks,
|
|
|
|
|
assert_streaming_error_handled,
|
Add agent explainability instrumentation and unify envelope field naming (#795)
Addresses recommendations from the UX developer's agent experience report.
Adds provenance predicates, DAG structure changes, error resilience, and
a published OWL ontology.
Explainability additions:
- Tool candidates: tg:toolCandidate on Analysis events lists the tools
visible to the LLM for each iteration (names only, descriptions in config)
- Termination reason: tg:terminationReason on Conclusion/Synthesis events
(final-answer, plan-complete, subagents-complete)
- Step counter: tg:stepNumber on iteration events
- Pattern decision: new tg:PatternDecision entity in the DAG between
session and first iteration, carrying tg:pattern and tg:taskType
- Latency: tg:llmDurationMs on Analysis events, tg:toolDurationMs on
Observation events
- Token counts on events: tg:inToken/tg:outToken/tg:llmModel on
Grounding, Focus, Synthesis, and Analysis events
- Tool/parse errors: tg:toolError on Observation events with tg:Error
mixin type. Parse failures return as error observations instead of
crashing the agent, giving it a chance to retry.
Envelope unification:
- Rename chunk_type to message_type across AgentResponse schema,
translator, SDK types, socket clients, CLI, and all tests.
Agent and RAG services now both use message_type on the wire.
Ontology:
- specs/ontology/trustgraph.ttl — OWL vocabulary covering all 26 classes,
7 object properties, and 36+ datatype properties including new predicates.
DAG structure tests:
- tests/unit/test_provenance/test_dag_structure.py verifies the
wasDerivedFrom chain for GraphRAG, DocumentRAG, and all three agent
patterns (react, plan, supervisor) including the pattern-decision link.
2026-04-13 16:16:42 +01:00
|
|
|
assert_message_types_valid,
|
2025-11-26 19:47:39 +00:00
|
|
|
assert_streaming_latency_acceptable,
|
|
|
|
|
assert_callback_invoked,
|
|
|
|
|
)
|
|
|
|
|
|
|
|
|
|
__all__ = [
|
|
|
|
|
"assert_streaming_chunks_valid",
|
|
|
|
|
"assert_streaming_sequence",
|
|
|
|
|
"assert_agent_streaming_chunks",
|
|
|
|
|
"assert_rag_streaming_chunks",
|
|
|
|
|
"assert_streaming_completion",
|
|
|
|
|
"assert_streaming_content_matches",
|
|
|
|
|
"assert_no_empty_chunks",
|
|
|
|
|
"assert_streaming_error_handled",
|
Add agent explainability instrumentation and unify envelope field naming (#795)
Addresses recommendations from the UX developer's agent experience report.
Adds provenance predicates, DAG structure changes, error resilience, and
a published OWL ontology.
Explainability additions:
- Tool candidates: tg:toolCandidate on Analysis events lists the tools
visible to the LLM for each iteration (names only, descriptions in config)
- Termination reason: tg:terminationReason on Conclusion/Synthesis events
(final-answer, plan-complete, subagents-complete)
- Step counter: tg:stepNumber on iteration events
- Pattern decision: new tg:PatternDecision entity in the DAG between
session and first iteration, carrying tg:pattern and tg:taskType
- Latency: tg:llmDurationMs on Analysis events, tg:toolDurationMs on
Observation events
- Token counts on events: tg:inToken/tg:outToken/tg:llmModel on
Grounding, Focus, Synthesis, and Analysis events
- Tool/parse errors: tg:toolError on Observation events with tg:Error
mixin type. Parse failures return as error observations instead of
crashing the agent, giving it a chance to retry.
Envelope unification:
- Rename chunk_type to message_type across AgentResponse schema,
translator, SDK types, socket clients, CLI, and all tests.
Agent and RAG services now both use message_type on the wire.
Ontology:
- specs/ontology/trustgraph.ttl — OWL vocabulary covering all 26 classes,
7 object properties, and 36+ datatype properties including new predicates.
DAG structure tests:
- tests/unit/test_provenance/test_dag_structure.py verifies the
wasDerivedFrom chain for GraphRAG, DocumentRAG, and all three agent
patterns (react, plan, supervisor) including the pattern-decision link.
2026-04-13 16:16:42 +01:00
|
|
|
"assert_message_types_valid",
|
2025-11-26 19:47:39 +00:00
|
|
|
"assert_streaming_latency_acceptable",
|
|
|
|
|
"assert_callback_invoked",
|
|
|
|
|
]
|