SurfSense/surfsense_backend/app/tasks/chat/streaming
DESKTOP-RTLN3BA\$punk 5c36cd3071 feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration
- Standardized the web crawler to use Scrapling exclusively, removing Firecrawl entirely.
- Updated the crawler's location to `app/proprietary/web_crawler/connector.py` under a non-Apache-2 license boundary.
- Refactored the `WebCrawlerConnector` to eliminate the Firecrawl API key dependency, simplifying the interface for crawling URLs.
- Adjusted related components to accommodate the new structure and ensure successful crawl outcomes are properly handled.
- Updated documentation to reflect these changes and the new implementation status.
2026-06-29 20:37:56 -07:00
..
agent feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration 2026-06-29 20:37:56 -07:00
context refactor: remove search_surfsense_docs tool and related references 2026-05-28 22:35:14 -07:00
contract refactor(chat): add streaming/contract/ for file-write contract enforcement 2026-05-25 21:48:14 +02:00
errors refactor(backend): rename search_space -> workspace across app bulk (Phase 2 Wave D) 2026-06-26 18:30:47 +02:00
flows feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration 2026-06-29 20:37:56 -07:00
graph_stream refactor: remove memory extraction functions and related components from the new chat agent 2026-05-20 14:03:28 +05:30
handlers chore: linting 2026-06-11 15:31:43 -07:00
helpers chat/stream_new_chat: emit one SSE frame per pending interrupt 2026-05-13 20:59:48 +02:00
relay refactor: remove memory extraction functions and related components from the new chat agent 2026-05-20 14:03:28 +05:30
shared citations: conversation-scoped registry with finalize-time [n] resolution 2026-06-25 15:26:25 +02:00
__init__.py refactor(chat): drop alternate streaming entry path; use graph_stream 2026-05-07 19:25:20 +02:00