SurfSense/surfsense_backend/app/proprietary/scrapers
DESKTOP-RTLN3BA\$punk 0445c646c6 refactor(native-connector): relocate youtube scraper under app/proprietary + parallelize playlists
Move app/scrapers -> app/proprietary/scrapers/youtube to sit alongside the existing proprietary web_crawler/platforms namespace, updating all external imports (routes, tests, e2e script, README). Internal imports were relative so are unchanged.

Also parallelize playlist per-video resolution: page video ids sequentially, then resolve the heavy watch-page fetches concurrently via fan_out (~150 videos ~70s, down from a few minutes). Items stream in completion order; sort by the order field for playlist order.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-02 02:34:04 -07:00
..
youtube refactor(native-connector): relocate youtube scraper under app/proprietary + parallelize playlists 2026-07-02 02:34:04 -07:00
__init__.py refactor(native-connector): relocate youtube scraper under app/proprietary + parallelize playlists 2026-07-02 02:34:04 -07:00