mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-07-06 22:12:12 +02:00
5c36cd3071
- Standardized the web crawler to use Scrapling exclusively, removing Firecrawl entirely. - Updated the crawler's location to `app/proprietary/web_crawler/connector.py` under a non-Apache-2 license boundary. - Refactored the `WebCrawlerConnector` to eliminate the Firecrawl API key dependency, simplifying the interface for crawling URLs. - Adjusted related components to accommodate the new structure and ensure successful crawl outcomes are properly handled. - Updated documentation to reflect these changes and the new implementation status.
10 lines
487 B
Python
10 lines
487 B
Python
"""SurfSense proprietary packages (non-Apache-2 license boundary).
|
|
|
|
Everything under ``app.proprietary`` is licensed **separately** from the
|
|
Apache-2.0 project root — see ``app/proprietary/LICENSE``. This package holds
|
|
the in-house undetectable crawler engine and (future) platform-specific actors
|
|
that form the product's moat.
|
|
|
|
Apache-2.0 code elsewhere in the app may *import from* this package, but code
|
|
placed *inside* it is not covered by the repository's Apache-2.0 license.
|
|
"""
|