apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-07-08 22:22:17 +02:00
Code Issues Projects Releases Packages Wiki Activity
SurfSense/surfsense_backend/tests/unit/proprietary/web_crawler
History
DESKTOP-RTLN3BA\$punk 701f888b9e feat(proxy): refactor proxy configuration and add DataImpulse provider 
- Updated proxy configuration in `.env.example` files to use `PROXY_URL` and `PROXY_URLS` instead of `CUSTOM_PROXY_URL` and `CUSTOM_PROXY_URLS`.
- Introduced `DataImpulseProvider` for proxy management, replacing the deprecated `AnonymousProxiesProvider`.
- Enhanced documentation to reflect changes in proxy setup and usage.
- Adjusted related code in the proxy registry and configuration files to support the new provider structure.
2026-07-04 17:18:40 -07:00
..
__init__.py feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration 2026-06-29 20:37:56 -07:00
test_captcha.py feat(native-connector): added google maps places & reviews scrapers 2026-07-02 21:58:24 -07:00
test_connector.py feat(native-connector): added google maps places & reviews scrapers 2026-07-02 21:58:24 -07:00
test_connector_links.py feat(web-crawler): add site_crawler spider + url_policy over the fetch engine 2026-07-03 10:50:41 +02:00
test_site_crawler.py feat(web-crawler): add site_crawler spider + url_policy over the fetch engine 2026-07-03 10:50:41 +02:00
test_stealth.py feat(proxy): refactor proxy configuration and add DataImpulse provider 2026-07-04 17:18:40 -07:00
test_url_policy.py feat(web-crawler): add site_crawler spider + url_policy over the fetch engine 2026-07-03 10:50:41 +02:00