DESKTOP-RTLN3BA\$punk c600a2920b feat(crawler): harden web crawler and agent tooling for real-world research tasks ... Crawler engine: escalate thin JS-shell pages past static fetch, repair currency-lossy extractions, emit categorized link records with anchor provenance, and decode percent-encoded mailto:/tel: contacts; site crawls reuse the connector ladder via Scrapling's spider engine with URL pattern filters. Agent layer: read_run gains char_offset paging, search_run gains match excerpts, new export_run turns stored runs into CSV workspace docs; reddit search fair-shares the item budget across queries and dedupes cross-query hits. Subagent prompts and routing teach crawl-after-search, full-run coverage before summarizing, and executing own-tool next steps instead of returning partial.		2026-07-05 03:51:16 -07:00
..
access	feat(runs): introduce Run and ToolOutputSpill models for logging scraper invocations	2026-07-04 22:55:55 -07:00
google_maps	feat(google_maps): add scrape + reviews capability verbs	2026-07-03 17:56:43 +02:00
reddit	feat(reddit): implement Reddit scraping subagent and associated capabilities	2026-07-04 17:31:11 -07:00
web	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00
youtube	Merge upstream/ci_mvp (google maps scrapers) into feature-ci_phase-4-7	2026-07-03 12:37:12 +02:00
__init__.py	Merge upstream/ci_mvp (google maps scrapers) into feature-ci_phase-4-7	2026-07-03 12:37:12 +02:00
test_billing.py	feat(capabilities): replace web.scrape/web.discover with unified web.crawl	2026-07-03 10:51:05 +02:00
test_registry.py	feat(capabilities): replace web.scrape/web.discover with unified web.crawl	2026-07-03 10:51:05 +02:00
test_run_truncation.py	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00