SurfSense/surfsense_backend
CREDO23 7723b5b8b6 feat(tiktok): add tiktok.comments verb for public comment scraping
Comments load over a signed /api/comment/list XHR that TikTok serves to
anonymous sessions once the comments panel is opened (unlike profile-video and
general-search feeds), so this is a reliable verb. Given video URLs it returns
CommentItems (text, author, likes, reply counts; replies carry repliesToId),
deduped per video, capped, and degraded to an ErrorItem for empty/withheld
videos or a bad_url ErrorItem for non-video inputs.

Generalizes the browser capture over a pluggable interaction step so the
comments flow (open panel, scroll the panel to paginate) reuses the same
warm+capture scaffolding as listing/user-search. Billed per comment on a new
TIKTOK_COMMENT meter (TIKTOK_MICROS_PER_COMMENT, matching the per-comment
market), surfaced on the chat subagent alongside tiktok.scrape/user_search.
2026-07-09 18:35:26 +02:00
..
alembic refactor: improve session management and concurrency in Google Search fetcher 2026-07-06 22:33:40 -07:00
app feat(tiktok): add tiktok.comments verb for public comment scraping 2026-07-09 18:35:26 +02:00
scripts feat(tiktok): emit graceful ErrorItem for blocked/empty listings 2026-07-08 23:14:50 +02:00
tests feat(tiktok): add tiktok.comments verb for public comment scraping 2026-07-09 18:35:26 +02:00
.dockerignore chore(backend): exclude tests/ from production Docker image 2026-05-06 17:16:22 +05:30
.env.example feat(tiktok): add tiktok.comments verb for public comment scraping 2026-07-09 18:35:26 +02:00
.gitignore fix(gitignore): anchor data/ rule; track podcast voice catalogs 2026-06-12 00:06:37 +02:00
.python-version feat: SurfSense v0.0.6 init 2025-03-14 18:53:14 -07:00
alembic.ini add github connector, add alembic for db migrations, fix bug updating connectors 2025-04-13 13:56:22 -07:00
celery_worker.py fix: celery_app path and gmail indexing 2025-10-21 21:11:41 -07:00
Dockerfile feat: completed init mvp of phase 3 2026-06-30 03:02:40 -07:00
main.py feat: api playground, other tweaks 2026-07-06 16:45:04 -07:00
pyproject.toml chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00
uv.lock chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00