mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-07-08 22:22:17 +02:00
10 lines
589 B
Text
10 lines
589 B
Text
---
|
|
title: Web Crawler
|
|
description: The web crawler connector is deprecated
|
|
---
|
|
|
|
# Web Crawler
|
|
|
|
<Callout type="warn" title="Deprecated">
|
|
The web crawler connector is **deprecated** and can no longer be connected (the backend refuses new connections with HTTP 410). Crawling is now built into the platform as the [Web Crawl native scraper](/docs/connectors/native/web-crawl). To save individual webpages, you can also use the [SurfSense browser extension](https://github.com/MODSetter/SurfSense/tree/main/surfsense_browser_extension), which captures pages behind authentication.
|
|
</Callout>
|