SurfSense/surfsense_backend/app/tasks/connector_indexers
Anish Sarkar 0bc1c766ff feat: migrate Confluence and Jira indexers to unified parallel pipeline
- Refactored Confluence and Jira indexers to utilize the shared IndexingPipelineService for improved document processing.
- Updated the `_build_connector_doc` function in both indexers to create ConnectorDocument instances with enhanced metadata and fallback summaries.
- Modified the `index_confluence_pages` and `index_jira_issues` functions to return a tuple of (indexed_count, skipped_count, warning_or_error_message) for better error handling and reporting.
- Added unit tests for both indexers to validate the new parallel processing logic and ensure correct document creation and indexing behavior.
2026-03-27 16:02:09 +05:30
..
__init__.py refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
airtable_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
base.py chore: ran linting 2026-03-17 04:40:46 +05:30
bookstack_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
clickup_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
confluence_indexer.py feat: migrate Confluence and Jira indexers to unified parallel pipeline 2026-03-27 16:02:09 +05:30
discord_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
elasticsearch_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
github_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
google_calendar_indexer.py feat: implement parallel indexing for Google Calendar and Gmail connectors 2026-03-26 19:34:04 +05:30
google_drive_indexer.py feat: implement batch indexing for selected Google Drive files 2026-03-27 00:17:07 +05:30
google_gmail_indexer.py feat: implement parallel indexing for Google Calendar and Gmail connectors 2026-03-26 19:34:04 +05:30
jira_indexer.py feat: migrate Confluence and Jira indexers to unified parallel pipeline 2026-03-27 16:02:09 +05:30
linear_indexer.py feat: migrate Linear and Notion indexers to unified parallel pipeline 2026-03-27 11:19:32 +05:30
luma_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
notion_indexer.py feat: migrate Linear and Notion indexers to unified parallel pipeline 2026-03-27 11:19:32 +05:30
obsidian_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
slack_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
teams_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
webcrawler_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00