mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-07-06 22:12:12 +02:00
- Standardized the web crawler to use Scrapling exclusively, removing Firecrawl entirely. - Updated the crawler's location to `app/proprietary/web_crawler/connector.py` under a non-Apache-2 license boundary. - Refactored the `WebCrawlerConnector` to eliminate the Firecrawl API key dependency, simplifying the interface for crawling URLs. - Adjusted related components to accommodate the new structure and ensure successful crawl outcomes are properly handled. - Updated documentation to reflect these changes and the new implementation status. |
||
|---|---|---|
| .. | ||
| agent | ||
| context | ||
| contract | ||
| errors | ||
| flows | ||
| graph_stream | ||
| handlers | ||
| helpers | ||
| relay | ||
| shared | ||
| __init__.py | ||