SurfSense/surfsense_backend/app/connectors
DESKTOP-RTLN3BA\$punk 5c36cd3071 feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration
- Standardized the web crawler to use Scrapling exclusively, removing Firecrawl entirely.
- Updated the crawler's location to `app/proprietary/web_crawler/connector.py` under a non-Apache-2 license boundary.
- Refactored the `WebCrawlerConnector` to eliminate the Firecrawl API key dependency, simplifying the interface for crawling URLs.
- Adjusted related components to accommodate the new structure and ensure successful crawl outcomes are properly handled.
- Updated documentation to reflect these changes and the new implementation status.
2026-06-29 20:37:56 -07:00
..
dropbox
google_drive
onedrive
airtable_connector.py
airtable_history.py
bookstack_connector.py
clickup_connector.py
clickup_history.py
composio_connector.py
confluence_connector.py
confluence_history.py
discord_connector.py
elasticsearch_connector.py
exceptions.py
github_connector.py
google_calendar_connector.py
google_gmail_connector.py
linear_connector.py
luma_connector.py
notion_history.py
slack_history.py
teams_connector.py
teams_history.py