apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-07-10 22:32:16 +02:00
Code Issues Projects Releases Packages Wiki Activity

feat(capabilities): replace web.scrape/web.discover with unified web.crawl

Browse source 
web.crawl scrapes a single URL (maxCrawlDepth=0) or spiders a whole site,
backed by the proprietary site_crawler engine. Rewires the scraping subagent
tools and capability tests onto the new verb.
This commit is contained in:
CREDO23 2026-07-03 10:51:05 +02:00
parent f82fae3973
commit 9fe9c5b71d
31 changed files with 411 additions and 950 deletions
Download patch file Download diff file Expand all files Collapse all files

5
surfsense_backend/app/capabilities/web/__init__.py
View file

@ -1,6 +1,5 @@
"""``web.*`` namespace: the generic web scraping + discovery verbs."""
"""``web.*`` namespace: the unified web content crawler verb."""
from __future__ import annotations
from app.capabilities.web.discover import definition as _discover # noqa: F401
from app.capabilities.web.scrape import definition as _scrape # noqa: F401
from app.capabilities.web.crawl import definition as _crawl # noqa: F401