Updated Streaming Service to efficently stream content\

Browse source

\
- Earlier for each chunk, whole message (with all annotations included)
  were streamed. Leading to extremely large data length.
- Fixed to only stream new chunk.
- Updated ANSWER part to be streamed as message content (following
  Vercel's Stream Protocol)\
- Fixed yield typo

...

This commit is contained in:

Utkarsh-Patel-13 2025-07-18 17:43:07 -07:00

parent d5aae6b229

commit 92781e726c

4 changed files with 638 additions and 256 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

696

surfsense_backend/app/agents/researcher/nodes.py

View file

File diff suppressed because it is too large Load diff