apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-07-10 22:32:16 +02:00
Code Issues Projects Releases Packages Wiki Activity

refactor(capabilities): drop Apify references from web/youtube docstrings

Browse source
This commit is contained in:
CREDO23 2026-07-03 17:57:13 +02:00
parent b5d221c19c
commit 7691e95e36
5 changed files with 12 additions and 13 deletions
Download patch file Download diff file Expand all files Collapse all files

9
surfsense_backend/app/capabilities/web/crawl/schemas.py
View file

@ -1,13 +1,12 @@
# ruff: noqa: N815 - public field names intentionally mirror the Apify camelCase spec
# ruff: noqa: N815 - public field names intentionally use camelCase
"""``web.crawl`` I/O contracts.
An Apify *Website Content Crawler*-style surface (see apify.com/apify/website-
content-crawler and docs.firecrawl.dev): one verb that either scrapes the given
A Website Content Crawler-style surface: one verb that either scrapes the given
URLs (``maxCrawlDepth == 0``) or spiders their site (``maxCrawlDepth > 0``),
bounded by ``maxCrawlPages`` and kept on the seed's site.
Fields are trimmed to what the proprietary engine honors today. Apify knobs the
engine handles automatically (crawler type, proxy, dynamic-render waits) are
Fields are trimmed to what the proprietary engine honors today. Knobs the engine
handles automatically (crawler type, proxy, dynamic-render waits) are
intentionally omitted, as are features we haven't built (URL globs, output
formats, click actions, PII handling).
"""