apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-07-08 22:22:17 +02:00
Code Issues Projects Releases Packages Wiki Activity
SurfSense/surfsense_backend/app/capabilities/web/__init__.py

6 lines
176 B
Python
Raw Normal View History

feat(capabilities): replace web.scrape/web.discover with unified web.crawl web.crawl scrapes a single URL (maxCrawlDepth=0) or spiders a whole site, backed by the proprietary site_crawler engine. Rewires the scraping subagent tools and capability tests onto the new verb.
2026-07-03 10:51:05 +02:00
"""``web.*`` namespace: the unified web content crawler verb."""
feat(capabilities): add web.scrape schemas
2026-07-01 16:42:47 +02:00
from __future__ import annotations
feat(capabilities): replace web.scrape/web.discover with unified web.crawl web.crawl scrapes a single URL (maxCrawlDepth=0) or spiders a whole site, backed by the proprietary site_crawler engine. Rewires the scraping subagent tools and capability tests onto the new verb.
2026-07-03 10:51:05 +02:00
from app.capabilities.web.crawl import definition as _crawl # noqa: F401
Reference in a new issue Copy permalink