SurfSense/surfsense_backend/tests/unit/platforms
CREDO23 7723b5b8b6 feat(tiktok): add tiktok.comments verb for public comment scraping
Comments load over a signed /api/comment/list XHR that TikTok serves to
anonymous sessions once the comments panel is opened (unlike profile-video and
general-search feeds), so this is a reliable verb. Given video URLs it returns
CommentItems (text, author, likes, reply counts; replies carry repliesToId),
deduped per video, capped, and degraded to an ErrorItem for empty/withheld
videos or a bad_url ErrorItem for non-video inputs.

Generalizes the browser capture over a pluggable interaction step so the
comments flow (open panel, scroll the panel to paginate) reuses the same
warm+capture scaffolding as listing/user-search. Billed per comment on a new
TIKTOK_COMMENT meter (TIKTOK_MICROS_PER_COMMENT, matching the per-comment
market), surfaced on the chat subagent alongside tiktok.scrape/user_search.
2026-07-09 18:35:26 +02:00
..
google_maps Merge upstream/ci_mvp (google maps scrapers) into feature-ci_phase-4-7 2026-07-03 12:37:12 +02:00
google_search refactor: improve session management and concurrency in Google Search fetcher 2026-07-06 22:33:40 -07:00
reddit chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00
tiktok feat(tiktok): add tiktok.comments verb for public comment scraping 2026-07-09 18:35:26 +02:00
youtube feat: api playground, other tweaks 2026-07-06 16:45:04 -07:00
__init__.py refactor(proprietary): move scrapers/ -> platforms/ (one subpackage per platform) 2026-07-03 11:01:58 +02:00