SurfSense/surfsense_backend/tests/unit/utils
DESKTOP-RTLN3BA\$punk 62260125f7 feat(03b): add BYO custom proxy provider + bounded crawler rotation-retry
Add CustomProxyProvider (single endpoint or rotating pool via Scrapling ProxyRotator), registered as 'custom' alongside anonymous_proxies and selectable via PROXY_PROVIDER. Adds is_pool_backed to the ProxyProvider ABC + a zero-arg package helper. The web crawler does a bounded one-per-tier is_proxy_error rotation-retry gated on is_pool_backed() (single-endpoint providers no-op). Config/.env.example gain CUSTOM_PROXY_URL(S). Zero-arg getter contract unchanged for all consumers. Documents the proprietary boundary test (generic proxy infra stays Apache-2). Tests: provider, registry, crawler rotation (16).

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-29 21:03:34 -07:00
..
proxy feat(03b): add BYO custom proxy provider + bounded crawler rotation-retry 2026-06-29 21:03:34 -07:00
__init__.py refactor: implement file type classification for supported extensions across Dropbox, Google Drive, and OneDrive connectors, enhancing file handling and error management 2026-04-06 22:03:47 +05:30
test_async_retry.py test: add unit tests for async_retry.raise_for_status 2026-06-20 17:05:57 +05:30
test_blocknote_to_markdown.py test: add unit tests for blocknote_to_markdown 2026-06-23 01:42:10 +02:00
test_content_utils.py chore: fix linting 2026-06-25 04:31:22 +05:30
test_file_extensions.py Route uploaded images to vision LLM with document-parser fallback 2026-04-09 14:33:33 +02:00
test_oauth_security.py test(backend): add OAuth state security unit tests 2026-05-06 17:18:31 +05:30
test_validators.py feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration 2026-06-29 20:37:56 -07:00