DESKTOP-RTLN3BA\$punk c600a2920b feat(crawler): harden web crawler and agent tooling for real-world research tasks ... Crawler engine: escalate thin JS-shell pages past static fetch, repair currency-lossy extractions, emit categorized link records with anchor provenance, and decode percent-encoded mailto:/tel: contacts; site crawls reuse the connector ladder via Scrapling's spider engine with URL pattern filters. Agent layer: read_run gains char_offset paging, search_run gains match excerpts, new export_run turns stored runs into CSV workspace docs; reddit search fair-shares the item budget across queries and dedupes cross-query hits. Subagent prompts and routing teach crawl-after-search, full-run coverage before summarizing, and executing own-tool next steps instead of returning partial.		2026-07-05 03:51:16 -07:00
..
adapters	test: bootstrap pytest environment for backend	2026-02-24 18:19:56 +02:00
agents	feat(runs): introduce Run and ToolOutputSpill models for logging scraper invocations	2026-07-04 22:55:55 -07:00
automations	Merge upstream/ci_mvp (google maps scrapers) into feature-ci_phase-4-7	2026-07-03 12:37:12 +02:00
capabilities	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00
connector_indexers	refactor(connectors): remove legacy web-crawler KB indexer paths (keep enums)	2026-07-03 11:53:33 +02:00
connectors	chore: ran linting	2026-04-07 05:55:39 +05:30
db	feat: improved agent streaming	2026-04-29 07:20:31 -07:00
e2e_fakes	test(backend): enhance Drive file filtering and add unit tests for _drive_list_files	2026-05-06 17:58:58 +05:30
etl_pipeline	test(etl-cache): cover over-budget eviction selection	2026-06-12 11:50:52 +02:00
event_bus	test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F)	2026-06-26 18:36:46 +02:00
gateway	test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F)	2026-06-26 18:36:46 +02:00
google_unification	chore: ran linting	2026-05-09 05:28:09 +05:30
indexing_pipeline	feat(native-connector): added google maps places & reviews scrapers	2026-07-02 21:58:24 -07:00
middleware	test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F)	2026-06-26 18:36:46 +02:00
notifications	test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F)	2026-06-26 18:36:46 +02:00
observability	feat(agents): consolidate connectors under mcp_discovery; route web search through google_search	2026-07-04 21:06:04 -07:00
platforms	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00
podcasts	test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F)	2026-06-26 18:36:46 +02:00
proprietary	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00
routes	test: rename SearchSpace -> Workspace across tests + fixtures (Phase 2 Wave F)	2026-06-26 18:36:46 +02:00
services	feat(crawler): captcha solving + per-attempt billing (Phase 3d)	2026-06-29 22:58:21 -07:00
tasks	feat(agents): consolidate connectors under mcp_discovery; route web search through google_search	2026-07-04 21:06:04 -07:00
utils	feat(crawler): harden web crawler and agent tooling for real-world research tasks	2026-07-05 03:51:16 -07:00
__init__.py	test: bootstrap pytest environment for backend	2026-02-24 18:19:56 +02:00
test_error_contract.py	chore: linting	2026-04-22 01:05:31 -07:00
test_obsidian_plugin_indexer.py	chore: linting	2026-04-27 14:04:50 -07:00
test_pat_fail_closed_static.py	feat(native-connector): added google maps places & reviews scrapers	2026-07-02 21:58:24 -07:00
test_zero_authz_static.py	fix(authz):add zero context authorization checks	2026-06-23 12:55:25 +05:30