SurfSense/surfsense_backend/tests/unit/agents/new_chat
DESKTOP-RTLN3BA\$punk 80927a2872 feat(billing): meter platform scrapers per item; consolidate web scraping onto web.crawl
Add per-item, per-platform billing for the platform-native connectors (Reddit, Google Search, Google Maps places/reviews, YouTube videos/comments) through the capability gate/charge seam. Rates are config-driven with a shared wallet-credit module (wallet_credit) and a dedicated PlatformScrapeCreditService; agent and REST capability runs now record cost_micros. Google Maps scrape dual-meters places and attached reviews.

Remove the main-agent scrape_webpage tool now that the web.crawl capability covers single-page (maxCrawlDepth=0) and site crawling. The main agent now reaches crawling via task(web_crawler, ...). Update prompts, tool catalog, receipts, skills, proprietary docs, and tests; drop the obsolete chat-turn crawl fold path.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-05 17:08:01 -07:00
..
middleware refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
prompts prompts: remove orphaned system_prompt_composer surface 2026-06-25 18:37:04 +02:00
tools test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F) 2026-06-26 18:36:46 +02:00
__init__.py feat: updated agent harness 2026-04-28 09:22:19 -07:00
test_action_log.py test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F) 2026-06-26 18:36:46 +02:00
test_agent_cache.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_busy_mutex.py refactor(agents): move busy_mutex middleware into main_agent (owner) 2026-06-05 14:08:45 +02:00
test_compaction.py agent: retire eager KB priority/planner path and its dead flags 2026-06-25 18:37:14 +02:00
test_context_editing.py feat(runs): introduce Run and ToolOutputSpill models for logging scraper invocations 2026-07-04 22:55:55 -07:00
test_dedup_tool_calls.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_default_permissions_layering.py feat(billing): meter platform scrapers per item; consolidate web scraping onto web.crawl 2026-07-05 17:08:01 -07:00
test_desktop_safety_rules.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_doom_loop.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_feature_flags.py agent: retire eager KB priority/planner path and its dead flags 2026-06-25 18:37:14 +02:00
test_hitl_auto_approve.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_memory_response_content.py feat: refine private and team memory protocols 2026-05-20 02:02:10 +05:30
test_mention_resolver.py test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F) 2026-06-26 18:36:46 +02:00
test_noop_injection.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_otel_span.py feat(agents): consolidate connectors under mcp_discovery; route web search through google_search 2026-07-04 21:06:04 -07:00
test_path_resolver.py test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F) 2026-06-26 18:36:46 +02:00
test_permissions.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_plugin_loader.py test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F) 2026-06-26 18:36:46 +02:00
test_prompt_caching.py refactor(agents): consolidate chat runtime infra under chat/runtime 2026-06-05 13:19:24 +02:00
test_retry_after.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00
test_skills_backends.py test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F) 2026-06-26 18:36:46 +02:00
test_state_reducers.py agent: retire eager KB priority/planner path and its dead flags 2026-06-25 18:37:14 +02:00
test_tool_call_repair.py refactor(agents): introduce chat/ category; dissolve top-level agents/shared 2026-06-05 12:54:02 +02:00