mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-05-29 19:35:20 +02:00
- Added `_download_files_parallel` function to enable concurrent downloading of files from Google Drive, improving efficiency in document processing. - Introduced `_download_and_index` function to handle the parallel downloading and indexing phases, streamlining the overall workflow. - Updated `_index_full_scan` and `_index_with_delta_sync` methods to utilize the new parallel downloading functionality, enhancing performance. - Added unit tests to validate the new parallel downloading and indexing logic, ensuring robustness and error handling during document processing. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| airtable_indexer.py | ||
| base.py | ||
| bookstack_indexer.py | ||
| clickup_indexer.py | ||
| confluence_indexer.py | ||
| discord_indexer.py | ||
| elasticsearch_indexer.py | ||
| github_indexer.py | ||
| google_calendar_indexer.py | ||
| google_drive_indexer.py | ||
| google_gmail_indexer.py | ||
| jira_indexer.py | ||
| linear_indexer.py | ||
| luma_indexer.py | ||
| notion_indexer.py | ||
| obsidian_indexer.py | ||
| slack_indexer.py | ||
| teams_indexer.py | ||
| webcrawler_indexer.py | ||