SurfSense/surfsense_backend/app
Anish Sarkar a0b388a5c5 refactor(instagram): enhance batch processing for access block handling
Updated the fan_out function to allow partial results when encountering blocked targets. Instead of aborting the entire batch on a hard login wall, the function now tracks blocked statuses and raises InstagramAccessBlockedError only if all targets are blocked. This change improves the scraper's resilience and efficiency in handling Instagram's access restrictions.
2026-07-09 19:56:41 +05:30
..
agents feat(chat): add Instagram builtin subagent 2026-07-09 16:02:05 +05:30
auth chore: fix linting 2026-06-25 04:31:22 +05:30
automations Merge upstream/ci_mvp (google maps scrapers) into feature-ci_phase-4-7 2026-07-03 12:37:12 +02:00
capabilities feat(instagram): register instagram.* capability namespace 2026-07-09 16:01:49 +05:30
config feat(config): add Instagram per-item and per-comment scrape rates 2026-07-09 14:57:59 +05:30
connectors feat(03a): implement Scrapling-only web crawler and remove Firecrawl integration 2026-06-29 20:37:56 -07:00
etl_pipeline chore: linting 2026-06-17 22:31:36 -07:00
event_bus feat(workspace): remove AI file sorting feature and related components 2026-07-06 10:50:20 +05:30
file_storage refactor(backend): rename search_space -> workspace across app bulk (Phase 2 Wave D) 2026-06-26 18:30:47 +02:00
gateway refactor(backend): rename search_space -> workspace across app bulk (Phase 2 Wave D) 2026-06-26 18:30:47 +02:00
indexing_pipeline feat(workspace): remove AI file sorting feature and related components 2026-07-06 10:50:20 +05:30
notifications refactor(backend): rename search_space -> workspace across app bulk (Phase 2 Wave D) 2026-06-26 18:30:47 +02:00
observability feat(rename): complete searchSpace to workspace transition across frontend and backend 2026-07-06 15:12:40 +05:30
podcasts feat(native-connector): added google maps places & reviews scrapers 2026-07-02 21:58:24 -07:00
prompts prompts: remove orphaned system_prompt_composer surface 2026-06-25 18:37:04 +02:00
proprietary refactor(instagram): enhance batch processing for access block handling 2026-07-09 19:56:41 +05:30
retriever refactor(backend): rename search_space -> workspace across app bulk (Phase 2 Wave D) 2026-06-26 18:30:47 +02:00
routes feat(instagram): register instagram.* capability namespace 2026-07-09 16:01:49 +05:30
schemas feat(workspace): remove AI file sorting feature and related components 2026-07-06 10:50:20 +05:30
services chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00
tasks Merge pull request #1570 from pelazas/fix/scheduler-task-map-bookstack 2026-07-08 15:07:38 -07:00
templates feat: update report generation and export capabilities to support multiple formats (PDF, DOCX, HTML, LaTeX, EPUB, ODT, plain text) across documentation and backend 2026-03-09 18:41:21 -07:00
utils chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00
__init__.py feat: SurfSense v0.0.6 init 2025-03-14 18:53:14 -07:00
app.py chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00
celery_app.py refactor(connectors): remove legacy web-crawler KB indexer paths (keep enums) 2026-07-03 11:53:33 +02:00
db.py chore: bumped version to 0.0.31 2026-07-06 21:43:15 -07:00
exceptions.py feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux 2026-04-14 21:26:00 -07:00
rate_limiter.py try: ip fix for cludflare 2026-04-16 02:13:52 -07:00
session_events.py refactor(backend): rename search_space -> workspace across app bulk (Phase 2 Wave D) 2026-06-26 18:30:47 +02:00
users.py feat(native-connector): added google maps places & reviews scrapers 2026-07-02 21:58:24 -07:00
zero_publication.py feat: implement ensure_publication for zero_publication management 2026-07-05 23:17:13 -07:00