SurfSense/surfsense_backend/app/tasks
Anish Sarkar c016962064 feat: implement parallel file downloading and indexing in Google Drive indexer
- Added `_download_files_parallel` function to enable concurrent downloading of files from Google Drive, improving efficiency in document processing.
- Introduced `_download_and_index` function to handle the parallel downloading and indexing phases, streamlining the overall workflow.
- Updated `_index_full_scan` and `_index_with_delta_sync` methods to utilize the new parallel downloading functionality, enhancing performance.
- Added unit tests to validate the new parallel downloading and indexing logic, ensuring robustness and error handling during document processing.
2026-03-26 23:53:26 +05:30
..
celery_tasks merge upstream/dev into feat/migrate-electric-to-zero 2026-03-24 17:40:34 +02:00
chat refactor: remove link_preview tool and associated components to streamline agent functionality 2026-03-24 17:15:29 +05:30
connector_indexers feat: implement parallel file downloading and indexing in Google Drive indexer 2026-03-26 23:53:26 +05:30
document_processors chore: ran linting 2026-03-21 13:20:13 +05:30
__init__.py feat: SurfSense v0.0.6 init 2025-03-14 18:53:14 -07:00
composio_indexer.py chore: ran frontend and backend linting 2026-02-01 22:54:25 +05:30
surfsense_docs_indexer.py chore: ran linting 2026-03-17 04:40:46 +05:30