Commit graph

72 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
Oscar Zhou
d37417cbe9 refactor: move pure utility functions out of UI components (#1194) 2026-04-14 17:39:11 +09:30
Anish Sarkar
56c5809170 chore: ran linting 2026-04-08 18:23:03 +05:30
Anish Sarkar
b76a6babc1 refactor: update terminology in AllConnectorsTab and enhance styling in FolderTreeView 2026-04-08 16:20:41 +05:30
Anish Sarkar
6038f6dfc0 Merge remote-tracking branch 'upstream/dev' into feat/azure-ocr 2026-04-08 05:00:32 +05:30
Anish Sarkar
fcba577575 refactor: remove unused document management components and types, consolidating document-related functionality 2026-04-07 23:01:47 +05:30
DESKTOP-RTLN3BA\$punk
82b5c7f19e Merge commit '056fc0e7ff' into dev_mod 2026-04-07 02:56:46 -07:00
DESKTOP-RTLN3BA\$punk
49441233e7 feat: enhance keyboard shortcut management and improve app responsiveness
- Updated the development script to include a build step before launching the app.
- Refactored the registration of quick ask and autocomplete functionalities to be asynchronous, ensuring proper initialization.
- Introduced IPC channels for getting and setting keyboard shortcuts, allowing users to customize their experience.
- Enhanced the platform module to support better interaction with the Electron API for clipboard operations.
- Improved the user interface for managing keyboard shortcuts in the settings dialog, providing a more intuitive experience.
2026-04-07 00:43:40 -07:00
Anish Sarkar
8259fab254 refactor: update connector tabs to include search feedback and improve icon usage for better user experience 2026-04-06 13:27:49 +05:30
Anish Sarkar
e2f946b7c0 feat: add support for Local Folder connector in UI components and configuration 2026-04-02 11:38:40 +05:30
DESKTOP-RTLN3BA\$punk
5c8769508f chore: linting 2026-03-31 21:42:03 -07:00
DESKTOP-RTLN3BA\$punk
d8f403efba feat: re arranged connectors list 2026-03-31 20:38:43 -07:00
Anish Sarkar
936bd70682 refactor: simplify dashboard layout by removing unused navigation props and implementing a new DocumentsSidebar for better document management 2026-03-05 20:34:02 +05:30
Anish Sarkar
2d17d1a1b6 feat: replace Loader2 with Spinner component for consistent loading indicators 2026-01-25 15:23:45 +05:30
Anish Sarkar
12f45e1bd3 feat: streamline Composio connector configurations and enhance UI interactions
- Refactored Composio connector configuration components to improve modularity and maintainability.
- Simplified the ComposioCalendarConfig, ComposioGmailConfig, and ComposioDriveConfig components by removing unnecessary state management and UI elements.
- Added functionality to remove selected folders and files in the Google Drive and Composio Drive configurations, enhancing user experience.
- Updated connector display names for better clarity in the UI.
- Improved the overall structure of the connector edit view for better readability and usability.
2026-01-23 20:19:04 +05:30
Anish Sarkar
29382070aa feat: enhance Composio connector functionality with Google Drive delta sync support
- Added methods to retrieve the starting page token and list changes in Google Drive, enabling delta sync capabilities.
- Updated Composio service to handle file download directory configuration.
- Modified indexing tasks to support delta sync, improving efficiency by processing only changed files.
- Adjusted date handling in connector tasks to allow optional start and end dates.
- Improved error handling and logging throughout the Composio indexing process.
2026-01-23 18:37:09 +05:30
Anish Sarkar
fae52345f8 Merge remote-tracking branch 'upstream/dev' into feat/composio 2026-01-23 14:35:17 +05:30
Manoj Aggarwal
49d51ba569 merge 2026-01-22 20:57:48 -08:00
DESKTOP-RTLN3BA\$punk
8b81507739 refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
DESKTOP-RTLN3BA\$punk
eb509810f1 fix(temp-hotpatch): Disabling composio until fixed. 2026-01-22 16:35:28 -08:00
Anish Sarkar
8a0b8346a5 chore: ran linting 2026-01-23 05:28:18 +05:30
Anish Sarkar
6139b07a66 fix: remove toolkit view 2026-01-23 03:57:02 +05:30
Manoj Aggarwal
a680759c23 explicitly remove obsidian when cloud 2026-01-22 12:01:19 -08:00
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Anish Sarkar
f0997b0a30 chore: ran frontend linting 2026-01-19 21:23:22 +05:30
Anish Sarkar
72ad558240 refactor: consolidate MCP connector handling in UI components
- Replaced MCPConnectorListView with ConnectorAccountsListView for better integration and UI consistency.
- Updated ConnectorCard to display connector counts for MCP connectors.
- Enhanced MCPConnectForm to improve connection testing feedback and error handling.
- Streamlined MCPConfig validation logic and improved user feedback for configuration errors.
- Adjusted AllConnectorsTab to count and display MCP connectors accurately.
- Removed redundant MCP-specific components to simplify the codebase.
2026-01-19 19:50:07 +05:30
Manoj Aggarwal
18ce599c81 fix electric fallback 2026-01-16 16:13:20 -08:00
Manoj Aggarwal
11b160cee9 resolve conflicts 2026-01-16 15:39:57 -08:00
Manoj Aggarwal
1ad81583c0 fix errors 2026-01-16 15:11:01 -08:00
Manoj Aggarwal
1340121d5e nit 2026-01-16 15:02:44 -08:00
Manoj Aggarwal
4c07c0fe4f change the flow of mcp connectors 2026-01-16 14:39:44 -08:00
Manoj Aggarwal
485c9dc4e4 remove active from connector tile if mcp server 2026-01-16 12:08:18 -08:00
Manoj Aggarwal
ab9565dcec make the count of connectors consistent with number of servers 2026-01-16 12:05:13 -08:00
DESKTOP-RTLN3BA\$punk
8aad15d392 Reapply "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 3418c0e026.
2026-01-16 11:32:06 -08:00
DESKTOP-RTLN3BA\$punk
3418c0e026 Revert "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 5963a1125e, reversing
changes made to 0d2a2f8ea1.
2026-01-16 00:49:33 -08:00
Anish Sarkar
4281e6f15d refactor: update ActiveConnectorsTab and ChatShareButton components for improved UI
- Adjusted styling in ActiveConnectorsTab to enhance visual clarity by modifying the Cable component's class.
- Removed unnecessary elements from ChatShareButton to streamline the UI and updated the loading text for consistency.
2026-01-15 22:44:02 +05:30
Manoj Aggarwal
c78ea98a68 Add front end logic for MCP connectors 2026-01-14 14:01:23 -08:00
Manoj Aggarwal
792548b379 feat: add MCP connector frontend UI and integration 2026-01-14 14:01:22 -08:00
Anish Sarkar
5bd6bd3d67 chore: ran both frontend and backend linting 2026-01-14 02:05:40 +05:30
Anish Sarkar
34230bdb84 refactor: Enhance connector form submission and tooltip styling
- Updated the handleSubmitConnectForm function to accept an additional parameter for indexing start notification, improving the connector form submission process.
- Adjusted tooltip styling across various components for consistency and improved visual clarity.
- Simplified conditional rendering in ActiveConnectorsTab and ConnectorAccountsListView to enhance UI responsiveness during indexing operations.
2026-01-13 21:58:11 +05:30
Anish Sarkar
0e0aec13f3 refactor: Update indexing status display in connector components
- Replaced the previous "Syncing..." text with a more concise "Syncing" in various components to enhance clarity.
- Adjusted the UI to maintain consistent styling and improve user experience during indexing operations.
- Simplified conditional rendering for indexing status across ConnectorCard, ActiveConnectorsTab, and ConnectorAccountsListView components.
2026-01-13 21:17:17 +05:30
Anish Sarkar
f250fa177a feat: Implement real-time indexing state management for connectors
- Introduced a new custom hook, useIndexingConnectors, to track indexing states of connectors without polling.
- Updated ConnectorIndicator and related components to utilize the new indexing state management, enhancing user experience with immediate feedback during indexing.
- Removed deprecated log summary references and replaced them with real-time updates from Electric SQL.
- Adjusted UI components to reflect changes in indexing status, improving clarity and responsiveness.
2026-01-13 20:53:30 +05:30
Anish Sarkar
e38e6d90e0 feat: Add notifications table and integrate Electric SQL for real-time updates
- Introduced a new notifications table in the database schema to manage user notifications.
- Implemented Electric SQL replication setup for the notifications table, ensuring real-time synchronization.
- Updated existing database functions to support real-time updates for connectors and documents using Electric SQL.
- Refactored UI components to utilize new hooks for fetching connectors and documents, enhancing performance and user experience.
2026-01-13 16:54:06 +05:30
CREDO23
b664547178 style: format web codebase 2026-01-07 15:20:36 +02:00
CREDO23
4de28152d5 fix: connector card UI improvements 2026-01-07 15:18:31 +02:00
CREDO23
3ff87a218d feat: improve connector popup with grouped OAuth connectors
Active Connectors tab:
- Group OAuth connectors by type (Gmail, Google Drive, etc.)
- Show account count badge on grouped cards
- Show most recent last indexed date across all accounts
- Show non-OAuth connectors individually with active task messages

All Connectors tab:
- Show most recent last indexed date for OAuth connector types
- Check if any account is indexing for OAuth types

Accounts List View:
- Remove document count from individual account cards
- Back button returns to previous tab (not always All Connectors)

General:
- Update handleViewAccountsList to use (connectorType, connectorTitle) signature
- Consistent behavior for viewing accounts from both tabs
2026-01-07 11:40:21 +02:00
CREDO23
2508b37f4e feat: add connector accounts list view for OAuth connectors with multiple accounts
- Create ConnectorAccountsListView component to show all connected accounts for a connector type
- Add state management in use-connector-dialog for viewing connector accounts list
- Update AllConnectorsTab to show accounts list when OAuth connector is connected
- Update connector-popup.tsx to render the new accounts list view
- Add 'accounts' view to connector popup URL schema
- Display connected accounts in 2-column grid layout
- Add 'Add Account' button with dashed border in header
2026-01-07 09:28:07 +02:00
CREDO23
93c7b83a06 feat: show identifier-only display names in connector cards 2026-01-07 08:16:27 +02:00
Anish Sarkar
645e849d93 chore: ran both frontend and backend linting 2026-01-03 00:18:17 +05:30