mirror of
https://github.com/trustgraph-ai/trustgraph.git
synced 2026-06-12 16:25:14 +02:00
4930bc4d2b
- New TextCompletionResult dataclass: text: Optional[str], in_token, out_token, model. - text_completion(system, prompt, timeout=600) — non-streaming only. Returns TextCompletionResult with text set and tokens/model populated from the response. - New text_completion_stream(system, prompt, handler, timeout=600) — streaming. Invokes handler(chunk) with each TextCompletionResponse as it arrives (including the final one, so the caller can see end_of_stream). Raises on resp.error. Returns a TextCompletionResult with text=None and in_token/out_token/model pulled from the final message. - Old streaming= kwarg on text_completion() is gone. trustgraph-base/trustgraph/base/__init__.py - Export TextCompletionClient and TextCompletionResult alongside the spec. trustgraph-flow/trustgraph/prompt/template/service.py - Non-streaming path now uses await ...text_completion(system=..., prompt=...) and reads result.text. The llm() callback still returns a plain string to PromptManager, preserving its contract. - Streaming path collapsed onto text_completion_stream(..., handler=forward_chunks). Removed the hand-rolled client.request(...) + TextCompletionRequest plumbing. The is_final / resp.error behavior is preserved (forward_chunks still checks end_of_stream; errors are now raised centrally by the client). - Dropped the now-unused TextCompletionRequest, TextCompletionResponse import. Token counts are now available to any TextCompletionClient caller - result.in_token / result.out_token / result.model — in both modes. Nothing in the prompt service consumes them yet; that's the next step on this branch. |
||
|---|---|---|
| .. | ||
| trustgraph | ||
| pyproject.toml | ||
| README.md | ||