apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-06-24 21:38:09 +02:00
Code Issues Projects Releases Packages Wiki Activity
SurfSense/surfsense_backend/app/tasks/connector_indexers
History
Anish Sarkar ce40da80ea feat: implement page limit estimation and enforcement in file based connector indexers 
- Added a static method `estimate_pages_from_metadata` to `PageLimitService` for estimating page counts based on file metadata.
- Integrated page limit checks in Google Drive, Dropbox, and OneDrive indexers to prevent exceeding user quotas during file indexing.
- Updated relevant indexing methods to utilize the new page estimation logic and enforce limits accordingly.
- Enhanced tests for page limit functionality, ensuring accurate estimation and enforcement across different file types.
2026-04-04 02:51:28 +05:30
..
__init__.py refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
airtable_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
base.py feat: implement page limit estimation and enforcement in file based connector indexers 2026-04-04 02:51:28 +05:30
bookstack_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
clickup_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
confluence_indexer.py feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
discord_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
dropbox_indexer.py feat: implement page limit estimation and enforcement in file based connector indexers 2026-04-04 02:51:28 +05:30
elasticsearch_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
github_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
google_calendar_indexer.py feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
google_drive_indexer.py feat: implement page limit estimation and enforcement in file based connector indexers 2026-04-04 02:51:28 +05:30
google_gmail_indexer.py feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
jira_indexer.py feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
linear_indexer.py feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
luma_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
notion_indexer.py feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
obsidian_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
onedrive_indexer.py feat: implement page limit estimation and enforcement in file based connector indexers 2026-04-04 02:51:28 +05:30
slack_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
teams_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00
webcrawler_indexer.py fix: critical timestamp parsing and audit fixes 2026-03-23 19:49:28 +02:00