SurfSense/surfsense_backend/app/tasks/chat/streaming/handlers
DESKTOP-RTLN3BA\$punk 80927a2872 feat(billing): meter platform scrapers per item; consolidate web scraping onto web.crawl
Add per-item, per-platform billing for the platform-native connectors (Reddit, Google Search, Google Maps places/reviews, YouTube videos/comments) through the capability gate/charge seam. Rates are config-driven with a shared wallet-credit module (wallet_credit) and a dedicated PlatformScrapeCreditService; agent and REST capability runs now record cost_micros. Google Maps scrape dual-meters places and attached reviews.

Remove the main-agent scrape_webpage tool now that the web.crawl capability covers single-page (maxCrawlDepth=0) and site crawling. The main agent now reaches crawling via task(web_crawler, ...). Update prompts, tool catalog, receipts, skills, proprietary docs, and tests; drop the obsolete chat-turn crawl fold path.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-05 17:08:01 -07:00
..
tools feat(billing): meter platform scrapers per item; consolidate web scraping onto web.crawl 2026-07-05 17:08:01 -07:00
__init__.py Add LangGraph handlers for chat model, chain, tool, and custom events. 2026-05-06 20:08:48 +02:00
chain_end.py Add LangGraph handlers for chat model, chain, tool, and custom events. 2026-05-06 20:08:48 +02:00
chat_model_stream.py Mint pending span id when the task tool registers from chunks. 2026-05-08 22:47:08 +02:00
custom_event_dispatch.py Forward span metadata from report_progress thinking updates. 2026-05-08 22:47:50 +02:00
custom_events.py feat: improved document, folder mentions rendering 2026-05-09 22:15:51 -07:00
tool_end.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
tool_output_frame.py Clear spans after task completion and pass span id on tool output. 2026-05-08 22:47:38 +02:00
tool_start.py Pass thinkingStepId through tool-input start and available metadata. 2026-05-08 23:17:05 +02:00