DESKTOP-RTLN3BA\$punk c600a2920b feat(crawler): harden web crawler and agent tooling for real-world research tasks ... Crawler engine: escalate thin JS-shell pages past static fetch, repair currency-lossy extractions, emit categorized link records with anchor provenance, and decode percent-encoded mailto:/tel: contacts; site crawls reuse the connector ladder via Scrapling's spider engine with URL pattern filters. Agent layer: read_run gains char_offset paging, search_run gains match excerpts, new export_run turns stored runs into CSV workspace docs; reddit search fair-shares the item budget across queries and dedupes cross-query hits. Subagent prompts and routing teach crawl-after-search, full-run coverage before summarizing, and executing own-tool next steps instead of returning partial.		2026-07-05 03:51:16 -07:00
..
crawl	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00
proxy	feat(proxy): refactor proxy configuration and add DataImpulse provider	2026-07-04 17:18:40 -07:00
__init__.py	refactor: implement file type classification for supported extensions across Dropbox, Google Drive, and OneDrive connectors, enhancing file handling and error management	2026-04-06 22:03:47 +05:30
test_async_retry.py	test: add unit tests for async_retry.raise_for_status	2026-06-20 17:05:57 +05:30
test_blocknote_to_markdown.py	test: add unit tests for blocknote_to_markdown	2026-06-23 01:42:10 +02:00
test_captcha_config.py	feat(crawler): captcha solving + per-attempt billing (Phase 3d)	2026-06-29 22:58:21 -07:00
test_content_utils.py	chore: fix linting	2026-06-25 04:31:22 +05:30
test_crawl_classifier.py	feat: completed init mvp of phase 3	2026-06-30 03:02:40 -07:00
test_file_extensions.py	Route uploaded images to vision LLM with document-parser fallback	2026-04-09 14:33:33 +02:00
test_oauth_security.py	test(backend): add OAuth state security unit tests	2026-05-06 17:18:31 +05:30
test_validators.py	feat(agents): consolidate connectors under mcp_discovery; route web search through google_search	2026-07-04 21:06:04 -07:00