Commit graph

1875 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
c19d300c9d feat: added circleback connector 2025-12-30 09:00:59 -08:00
Rohan Verma
23870042f3
Merge pull request #640 from CREDO23/google-drive-connector
[Feat] Add Google drive connector
2025-12-29 20:51:34 -08:00
Rohan Verma
c20cb7e056
Merge pull request #644 from CREDO23/fix-logs-page
[Fix] Logs page showing only 5 items
2025-12-29 20:50:19 -08:00
CREDO23
c3054809ee chore: update env example 2025-12-29 20:39:36 +02:00
CREDO23
7618662e70 refactor: rename GOOGLE_DRIVE_CONNECTOR to GOOGLE_DRIVE_FILE document type 2025-12-29 20:38:26 +02:00
CREDO23
16bc991b13 feat: add Google Drive connector to knowledge base search 2025-12-29 18:13:27 +02:00
CREDO23
4425fbbc31 fix: lint error in logs api service 2025-12-29 17:24:10 +02:00
CREDO23
6b1317435a fix: remove hardcoded limit in query params 2025-12-29 17:23:31 +02:00
DESKTOP-RTLN3BA\$punk
3ec2d46051 feat: Invalidate logs summary and enable refetch on mount for fresh processing tasks display 2025-12-28 16:02:56 -08:00
DESKTOP-RTLN3BA\$punk
35904ba0c8 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2025-12-28 15:54:10 -08:00
DESKTOP-RTLN3BA\$punk
46eb63fa11 hotpatch: remove consitent 2 sec interval api call to logs summary endpoint 2025-12-28 15:52:58 -08:00
Rohan Verma
876266366c
Merge pull request #642 from AnishSarkar22/fix/chatpage-ux
Fix for `write_todo` tool & UI Improvements
2025-12-28 15:50:54 -08:00
Anish Sarkar
747b6f23c7 fix: red background appeared when blocknote editor is being loaded 2025-12-29 01:42:08 +05:30
Anish Sarkar
8b534c9b68 style: Refine UI element sizes, spacing, and responsiveness across settings components for improved user experience 2025-12-29 01:22:22 +05:30
Anish Sarkar
2715f6d10f chore: ran linting 2025-12-29 01:09:21 +05:30
Anish Sarkar
7a852f0ea5 feat: Enhance todo status normalization and update schema for improved task management 2025-12-29 01:08:18 +05:30
Anish Sarkar
ed6470525a feat: Enhance mobile navbar animations and responsiveness across various components 2025-12-29 00:24:49 +05:30
Anish Sarkar
5bd26ab669 style: enhance responsive layout, add UI transitions, and refine form elements on authentication pages 2025-12-29 00:11:21 +05:30
Anish Sarkar
dee18233c5 feat: Implement responsive design for dashboard layout and user dropdown, and remove unused imports. 2025-12-29 00:06:38 +05:30
Anish Sarkar
1d5ee45bd9 style: Adjust UI element and text sizes for improved responsiveness and visual consistency across various components. 2025-12-28 23:59:01 +05:30
CREDO23
27beac4f62 fix: Google Drive folder handling and connector page updates 2025-12-28 19:57:10 +02:00
Anish Sarkar
3bea989868 feat: implement responsive row action dropdowns and enhance mobile sidebar navigation 2025-12-28 23:25:22 +05:30
CREDO23
10c98745cd refactor(web): use React Query for Google Drive folder operations
- Fix errors in connectors-api.service (use .issues instead of .errors)
- Create useGoogleDriveFolders hook with proper React Query integration
- Add Google Drive folders cache keys with proper query invalidation
- Refactor GoogleDriveFolderTree to use React Query hook for root data
- Remove manual state management (isInitialized, setRootItems, loadRootItems)
- Remove unused state (driveFolders, isLoadingFolders) from manage page
- Simplify handleOpenDriveFolderDialog function
- Automatic loading, caching, error handling, and refetching via React Query
- Better performance with proper caching and state management
2025-12-28 19:17:37 +02:00
CREDO23
c5c61a2c6b Merge branch 'dev' into google-drive-connector
Merge in dev
2025-12-28 19:00:09 +02:00
CREDO23
0b006de32d refactor(web): clean up Google Drive folder tree component
- Replace inline comments with JSDoc multiline comments for main functions
- Remove obvious/noisy inline comments from JSX
- Simplify component documentation while keeping it clear
- Improve readability by reducing comment clutter
2025-12-28 18:59:30 +02:00
CREDO23
acf47e3b0c refactor(connectors): remove verbose docstrings and obvious comments
- Simplify module docstrings (remove meta-commentary about 'small focused modules')
- Remove redundant inline comments (e.g., 'Log task start', 'Get connector from database')
- Trim verbose function docstrings to essential information only
- Remove over-explanatory comments that restate what code does
- Keep necessary documentation, remove noise for better readability
2025-12-28 18:53:13 +02:00
CREDO23
506a9297a9 fix(connectors): track delta sync tokens per folder for Google Drive
- Store tokens in folder_tokens dict instead of single global token
- Each folder now tracks its own sync state independently
- Fixes issue where indexing folder 2 incorrectly used delta sync after folder 1 was indexed
- First-time indexing now correctly uses full scan for each new folder
2025-12-28 18:32:59 +02:00
CREDO23
a5935bc677 feat(connectors): add connector parameter to file processor for source tracking
- Add optional 'connector' parameter with 'type' and 'metadata' fields
- Create helper function _update_document_from_connector
- Use document_metadata column (not metadata) for JSON field
- Merge metadata with existing using dict spread operator
- Google Drive documents now marked as GOOGLE_DRIVE_CONNECTOR
- Backward compatible - no changes to existing logic
- Simple and clean implementation
2025-12-28 18:01:39 +02:00
Anish Sarkar
a10bfe32cd feat: Adjust document mention picker max height and refine thread header shimmer display logic. 2025-12-28 21:29:28 +05:30
Anish Sarkar
446abc239b fix: now document processing UI banner does not show for periodic reindexing documents 2025-12-28 21:19:20 +05:30
CREDO23
8da58be9e0 fix(connectors): refresh document from DB before updating type
- Query document from database to ensure it's attached to session
- Prevents detached instance errors after process_file_in_background commits
- Properly updates document_type and metadata with session management
2025-12-28 17:21:44 +02:00
CREDO23
b2b891e4d7 fix(connectors): properly commit Google Drive document type changes
- Return file metadata from content_extractor for indexer to use
- Update document type and metadata in indexer after processing
- Explicitly commit changes to database
- Ensures documents are properly marked as GOOGLE_DRIVE_CONNECTOR type
2025-12-28 17:15:29 +02:00
CREDO23
9f1fd20944 feat(connectors): mark Google Drive documents with GOOGLE_DRIVE_CONNECTOR type
- Change document_type from file type (PDF, DOCX) to GOOGLE_DRIVE_CONNECTOR
- Store original file type in metadata for reference
- Add Google Drive specific metadata (file_id, mime_type, source)
- Include export format info for Google Workspace files
- Enables proper source tracking and bulk management
2025-12-28 16:55:14 +02:00
CREDO23
c9815fd6fb feat(celery): update Google Drive task for multiple folders
- Accept comma-separated folder_ids and folder_names parameters
- Pass through to indexing function for batch processing
2025-12-28 16:49:47 +02:00
CREDO23
634eeb887e feat(routes): support multiple Google Drive folder indexing
- Accept comma-separated folder_ids and folder_names
- Loop through each folder and index sequentially
- Collect total indexed count and errors
- Update timestamp only on full success
2025-12-28 16:49:20 +02:00
CREDO23
27a4bcdfc2 feat(ui): support multiple folder selection in Google Drive indexing
- Update manage page to handle array of selected folders
- Add info icon with clear description about folder-level indexing
- Display list of all selected folders before indexing
- Remove unnecessary file type details section
- Pass comma-separated folder IDs and names to backend
2025-12-28 16:48:56 +02:00
CREDO23
e0edfef5fc feat(ui): add multiple folder selection with checkboxes to Google Drive tree
- Replace single folder selection with multi-select checkboxes
- Remove cascading auto-select for clearer UX
- Each folder must be selected individually
- Visual indicators for selected folders
2025-12-28 16:48:34 +02:00
CREDO23
c4a95ecc02 feat(ui): integrate Google Drive folder selection into manage connectors page
- Add folder selection dialog for Google Drive indexing
- Hide date picker and quick index for Google Drive
- Show folder tree browser in modal
- Pass selected folder to indexing API
- Adjust modal size to prevent overflow
2025-12-28 16:04:58 +02:00
CREDO23
5df04c3caa feat(ui): add hierarchical Google Drive folder tree browser
- Display folders and files with lazy loading
- Show different icons for file types (docs, sheets, slides, etc)
- Expandable folder tree with proper indentation
- Selectable folders for indexing
- Handle overflow with proper truncation
- Full pagination support for large folder structures
2025-12-28 16:04:58 +02:00
CREDO23
ad4d424d38 feat(ui): add Google Drive OAuth connection page
- Handle OAuth flow similar to Gmail/Calendar
- Show connection status and redirect to manage page
- Display connector features and file type support
- No folder selection at connection time (done at index time)
2025-12-28 16:04:58 +02:00
CREDO23
90b3474b47 feat(hooks): add folder parameters to indexConnector function
- Accept folderId and folderName for Google Drive indexing
- Pass folder parameters to backend API
2025-12-28 16:04:58 +02:00
CREDO23
48112f66df feat(ui): add Google Drive connector card to Productivity category 2025-12-28 16:04:58 +02:00
CREDO23
bfbd813f42 feat(i18n): add Google Drive connector translation keys 2025-12-28 16:04:58 +02:00
CREDO23
11d94e0ea6 feat(ui): add Google Drive icon to connector icons mapping 2025-12-28 16:04:58 +02:00
CREDO23
2d24f9ac79 feat(types): add GOOGLE_DRIVE_CONNECTOR to frontend enum 2025-12-28 16:04:58 +02:00
CREDO23
1c83327fc7 feat(celery): add Google Drive indexing Celery task
- Create async task for Google Drive folder indexing
- Accept folder_id and folder_name parameters
- Call indexing wrapper to avoid circular imports
2025-12-28 15:56:11 +02:00
CREDO23
358abdf02f feat(routes): add Google Drive indexing support with folder selection
- Accept folder_id and folder_name as indexing parameters
- Hide date range for Google Drive connectors
- Create wrapper function to avoid circular imports
- Trigger Google Drive indexing Celery task
2025-12-28 15:55:57 +02:00
CREDO23
7b8900d51f feat(indexer): export Google Drive indexer function 2025-12-28 15:55:46 +02:00
CREDO23
501d08f2f4 feat(routes): register Google Drive OAuth router 2025-12-28 15:55:38 +02:00
CREDO23
1696c7056a feat(indexer): add Google Drive folder indexing with delta sync
- Full folder scan on first index
- Delta sync using change tracking for subsequent indexes
- Process files in parallel batches
- Handle file additions, modifications, and deletions
- Store change tracking token for efficient re-indexing
2025-12-28 15:55:25 +02:00