mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-07-06 22:12:12 +02:00
5c36cd3071
- Standardized the web crawler to use Scrapling exclusively, removing Firecrawl entirely. - Updated the crawler's location to `app/proprietary/web_crawler/connector.py` under a non-Apache-2 license boundary. - Refactored the `WebCrawlerConnector` to eliminate the Firecrawl API key dependency, simplifying the interface for crawling URLs. - Adjusted related components to accommodate the new structure and ensure successful crawl outcomes are properly handled. - Updated documentation to reflect these changes and the new implementation status. |
||
|---|---|---|
| .. | ||
| dropbox | ||
| google_drive | ||
| onedrive | ||
| airtable_connector.py | ||
| airtable_history.py | ||
| bookstack_connector.py | ||
| clickup_connector.py | ||
| clickup_history.py | ||
| composio_connector.py | ||
| confluence_connector.py | ||
| confluence_history.py | ||
| discord_connector.py | ||
| elasticsearch_connector.py | ||
| exceptions.py | ||
| github_connector.py | ||
| google_calendar_connector.py | ||
| google_gmail_connector.py | ||
| linear_connector.py | ||
| luma_connector.py | ||
| notion_history.py | ||
| slack_history.py | ||
| teams_connector.py | ||
| teams_history.py | ||