apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-07-22 23:31:12 +02:00
Code Issues Projects Releases Packages Wiki Activity
SurfSense/surfsense_backend/app/tasks/connector_indexers
History
DESKTOP-RTLN3BA\$punk e65d74f2e2 refactor: added batch commits and Increased task time limits in celery_app.py 
- Increased task time limits in celery_app.py for longer processing times.
- Enhanced pagination logic in NotionHistoryConnector to handle large result sets.
- Implemented batch commits every 10 documents across various indexers (Airtable, ClickUp, Confluence, Discord, GitHub, Google Calendar, Gmail, JIRA, Linear, Luma, Notion, Slack) to improve performance and reduce database load.
- Updated final commit logging for clarity on total documents processed.
2025-11-03 15:57:19 -08:00
..
__init__.py feat: added elasticsearch connector 2025-10-12 09:39:04 +05:30
airtable_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
base.py feat: add unique identifier hash for documents to prevent duplicates across various connectors 2025-10-14 21:11:19 -07:00
clickup_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
confluence_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
discord_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
elasticsearch_indexer.py feat: bumped version to v0.0.8 2025-10-16 22:44:12 -07:00
github_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
google_calendar_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
google_gmail_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
jira_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
linear_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
luma_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
notion_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00
slack_indexer.py refactor: added batch commits and Increased task time limits in celery_app.py 2025-11-03 15:57:19 -08:00