SurfSense/surfsense_backend/app/tasks/celery_tasks
Claude 3d5ace7a79
Add Mastodon/ActivityPub connector for social media data indexing
Implement a read-only connector for Mastodon-compatible instances (Mastodon,
Pixelfed, BookWyrm) that indexes user's statuses, favourites, and bookmarks.

Features:
- MastodonConnector API client with pagination support
- HTML content cleaning and markdown formatting
- Incremental indexing using since_id tracking
- Authentication route for adding/testing connectors
- Search integration in researcher agent nodes
- Celery background task for non-blocking indexing
2025-11-19 00:11:29 +00:00
..
__init__.py feat: added celery and removed background_tasks for MQ's 2025-10-20 00:30:00 -07:00
connector_tasks.py Add Mastodon/ActivityPub connector for social media data indexing 2025-11-19 00:11:29 +00:00
document_tasks.py feat: added file limit tracking for a user 2025-10-30 14:58:08 -07:00
podcast_tasks.py inject user instruction in the podcast generation task 2025-11-11 20:08:32 +02:00
schedule_checker_task.py feat: added meta-scheduler for running periodic tasks 2025-10-22 19:49:44 -07:00