Commit graph

1273 commits

Author SHA1 Message Date
Anish Sarkar
a5103da3d7 chore: ran linting 2026-01-24 04:36:34 +05:30
Anish Sarkar
97d7207bd4 fix: update Google Drive indexer to use SQLAlchemy casting for metadata queries
- Modified the Google Drive indexer to use SQLAlchemy's cast function for querying document metadata, ensuring proper type handling for file IDs.
- Improved the consistency of metadata queries across the indexing functions, enhancing reliability in document retrieval and processing.
2026-01-24 04:33:10 +05:30
Anish Sarkar
5cf6fb15ed fix: improve error logging for indexing tasks across multiple connectors
- Updated error handling in the indexing functions for BookStack, Confluence, Google Calendar, Jira, Linear, and Luma connectors to log specific error messages when failures occur.
- Enhanced logging for cases where no pages or events are found, providing clearer informational messages instead of treating them as critical errors.
- Ensured consistent error reporting across all connector indexers, improving debugging and user feedback during indexing operations.
2026-01-24 03:59:17 +05:30
Anish Sarkar
f4b1192a06 feat: refine indexing success case handling and notification messaging
- Enhanced the logic for determining success cases during indexing by distinguishing between duplicate warnings and empty results.
- Updated notification messages to provide clearer feedback for empty results, improving user understanding of indexing outcomes.
- Ensured that notifications reflect accurate statuses, maintaining consistency in user feedback during the indexing process.
2026-01-24 03:51:57 +05:30
Anish Sarkar
c48ba36fa4 feat: improve indexing logic and duplicate handling in connectors
- Enhanced Google Calendar and Composio connector indexing to track and log duplicate content, preventing re-indexing of already processed events.
- Implemented robust error handling during final commits to manage integrity errors gracefully, ensuring successful indexing despite potential duplicates.
- Updated notification service to differentiate between actual errors and warnings for duplicate content, improving user feedback.
- Refactored date handling to ensure valid date ranges and adjusted end dates when necessary for better indexing accuracy.
2026-01-23 23:36:14 +05:30
CREDO23
3a8a9734d6 refactor migration to use op.execute pattern 2026-01-23 20:02:42 +02:00
CREDO23
68dc7723af make migration idempotent 2026-01-23 20:00:18 +02:00
CREDO23
a627cc709e add index on public_share_enabled 2026-01-23 19:59:12 +02:00
CREDO23
036104e4c8 add unique index on public_share_token 2026-01-23 19:58:34 +02:00
CREDO23
b61d96fb85 add public_share_enabled column to migration 2026-01-23 19:57:53 +02:00
CREDO23
87183d1eb7 add public_share_token column to migration 2026-01-23 19:57:08 +02:00
CREDO23
f42a11023f create migration skeleton for public chat sharing 2026-01-23 19:55:53 +02:00
CREDO23
d16b086ada add public_share_enabled column to NewChatThread 2026-01-23 19:53:02 +02:00
CREDO23
be33b8920e add public_share_token column to NewChatThread 2026-01-23 19:52:15 +02:00
Anish Sarkar
d20bb385b5 feat: enhance date handling and indexing logic across connectors
- Added normalization for "undefined" strings to None in date parameters to prevent parsing errors.
- Improved date range validation to ensure start_date is strictly before end_date, adjusting end_date if necessary.
- Updated Google Calendar and Composio connector indexing logic to handle duplicate content more effectively, logging warnings for skipped events.
- Enhanced error handling during final commits to manage integrity errors gracefully.
- Refactored date handling in various connector indexers for consistency and reliability.
2026-01-23 23:03:29 +05:30
Anish Sarkar
08f16b43d7 feat: enhance Composio connector naming logic and improve UI focus
- Updated the Composio connector naming logic to dynamically generate user-friendly names based on existing connectors.
- Introduced new utility functions for counting connectors and retrieving base names for specific connector types.
- Enhanced the UI components to improve accessibility and focus management, ensuring a better user experience when interacting with connector dialogs.
2026-01-23 20:36:00 +05:30
Anish Sarkar
12f45e1bd3 feat: streamline Composio connector configurations and enhance UI interactions
- Refactored Composio connector configuration components to improve modularity and maintainability.
- Simplified the ComposioCalendarConfig, ComposioGmailConfig, and ComposioDriveConfig components by removing unnecessary state management and UI elements.
- Added functionality to remove selected folders and files in the Google Drive and Composio Drive configurations, enhancing user experience.
- Updated connector display names for better clarity in the UI.
- Improved the overall structure of the connector edit view for better readability and usability.
2026-01-23 20:19:04 +05:30
Anish Sarkar
1343fabeee feat: refactor composio connectors for modularity 2026-01-23 19:56:19 +05:30
Anish Sarkar
8d8f69545e feat: improve Google Calendar and Gmail connectors with enhanced error handling
- Added user-friendly re-authentication messages for expired or revoked tokens in both Google Calendar and Gmail connectors.
- Updated error handling in indexing tasks to log specific authentication errors and provide clearer feedback to users.
- Enhanced the connector UI to handle indexing failures more effectively, improving overall user experience.
2026-01-23 18:57:10 +05:30
Anish Sarkar
29382070aa feat: enhance Composio connector functionality with Google Drive delta sync support
- Added methods to retrieve the starting page token and list changes in Google Drive, enabling delta sync capabilities.
- Updated Composio service to handle file download directory configuration.
- Modified indexing tasks to support delta sync, improving efficiency by processing only changed files.
- Adjusted date handling in connector tasks to allow optional start and end dates.
- Improved error handling and logging throughout the Composio indexing process.
2026-01-23 18:37:09 +05:30
DESKTOP-RTLN3BA\$punk
e4490951f5 refactor(chat): improve message deletion logic in regenerate_response to prevent data loss on streaming failures 2026-01-23 02:22:18 -08:00
DESKTOP-RTLN3BA\$punk
a160f0dde3 chore: linting 2026-01-23 01:44:14 -08:00
DESKTOP-RTLN3BA\$punk
ad475397c4 feat(chat): add regenerate endpoint for chat threads to support editing and reloading responses 2026-01-23 01:42:10 -08:00
Anish Sarkar
fae52345f8 Merge remote-tracking branch 'upstream/dev' into feat/composio 2026-01-23 14:35:17 +05:30
Anish Sarkar
6a41b0f608 feat: enhance Composio and Google Drive connector functionality
- Added support for extracting connected account IDs from query parameters in the Composio callback, accommodating both camelCase and snake_case formats.
- Improved logging for received query parameters in the Composio callback to enhance debugging.
- Updated Google Drive folder listing logs to remove unnecessary emoji for consistency.
- Expanded the connector dialog to include Composio Google Drive as a recognized connector type, improving user interface clarity.
2026-01-23 14:12:57 +05:30
DESKTOP-RTLN3BA\$punk
4b19d7be8c security: CVE-2025-68664 fix 2026-01-22 22:34:49 -08:00
Manoj Aggarwal
114152ccc4 add missing migration 2026-01-22 20:58:18 -08:00
Manoj Aggarwal
49d51ba569 merge 2026-01-22 20:57:48 -08:00
DESKTOP-RTLN3BA\$punk
8b81507739 refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
DESKTOP-RTLN3BA\$punk
ed931bb404 fix: live comment sync in shared chats
- Added a method to find existing notifications by mention ID to prevent duplicate notifications.
- Updated notify_new_mention to check for existing notifications before creating a new one, ensuring idempotency.
- Implemented error handling for race conditions during notification creation, allowing retrieval of existing notifications in case of duplicate key errors.
- Improved documentation for clarity on the use of mention_id for idempotency.
2026-01-22 16:04:08 -08:00
Anish Sarkar
8a0b8346a5 chore: ran linting 2026-01-23 05:28:18 +05:30
Anish Sarkar
42752bbeab feat: improve Composio file processing and error handling
- Enhanced the handling of file content from Composio, supporting both binary and text files with appropriate processing methods.
- Introduced robust error logging and handling for file content extraction, ensuring better visibility into issues during processing.
- Updated the indexing logic to accommodate new content processing methods, improving overall reliability and user feedback on errors.
- Added temporary file handling for binary files to facilitate text extraction using the ETL service.
2026-01-23 05:28:03 +05:30
Anish Sarkar
7ec7ed5c3b feat: enhance Composio Google Drive integration with folder and file selection
- Added a new endpoint to list folders and files in a user's Composio Google Drive, supporting hierarchical structure.
- Implemented UI components for selecting specific folders and files to index, improving user control over indexing options.
- Introduced indexing options for maximum files per folder and inclusion of subfolders, allowing for customizable indexing behavior.
- Enhanced error handling and logging for Composio Drive operations, ensuring better visibility into issues during file retrieval and indexing.
- Updated the Composio configuration component to reflect new selection capabilities and indexing options.
2026-01-23 05:17:28 +05:30
Anish Sarkar
4cbf80d73a feat: enhance Composio integration with pagination and improved error handling
- Updated the list_gmail_messages method to support pagination with page tokens, allowing for more efficient message retrieval.
- Modified the return structure to include next_page_token and result_size_estimate for better client-side handling.
- Improved error handling and logging throughout the Gmail indexing process, ensuring better visibility into failures.
- Implemented batch processing for Gmail messages, committing changes incrementally to prevent data loss.
- Ensured consistent timestamp updates for connectors, even when no documents are indexed, to maintain accurate UI states.
- Refactored the indexing logic to streamline message processing and enhance overall performance.
2026-01-23 04:44:37 +05:30
Manoj Aggarwal
4b60a2b805 nit 2026-01-22 13:01:10 -08:00
CREDO23
1a2fa23916 Merge upstream/dev with live collaboration features 2026-01-22 23:00:42 +02:00
Manoj Aggarwal
b2eaf1ea94 missing migration 2026-01-22 12:01:35 -08:00
Manoj Aggarwal
a680759c23 explicitly remove obsidian when cloud 2026-01-22 12:01:19 -08:00
Manoj Aggarwal
f0760c14e9 Merge dev into feature/obsidian - resolved conflicts keeping both Obsidian and Composio connectors 2026-01-22 11:43:18 -08:00
Manoj Aggarwal
151b93b31a update prompt 2026-01-22 10:30:34 -08:00
Anish Sarkar
4bff1e8c10 Merge branch 'feat/inbox' into feat/composio 2026-01-22 23:02:00 +05:30
Anish Sarkar
076de2f3d7 feat: add unread count endpoint and update inbox logic
- Introduced a new API endpoint to fetch unread notification counts, providing both total and recent counts for better tracking.
- Updated the useInbox hook to manage separate states for older and recent unread counts, enhancing user experience with real-time updates.
- Implemented logic to handle marking notifications as read, ensuring accurate count adjustments for both recent and older items.
- Enhanced type definitions in the inbox types to support the new unread count functionality.
2026-01-22 22:56:02 +05:30
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
CREDO23
ac7d84571d Add thread_id to chat_comments for Electric sync 2026-01-22 17:27:42 +02:00
Anish Sarkar
be7ba76417 chore: ran backend and frontend linting 2026-01-22 16:07:06 +05:30
Anish Sarkar
3d4a8f981c Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 16:03:37 +05:30
Anish Sarkar
a449e7e2a6 feat: enhance notifications API and inbox functionality
- Added a new endpoint to list notifications with pagination, allowing users to fetch older notifications beyond the sync window.
- Introduced response models for notifications and improved error handling for date filtering.
- Updated the useInbox hook to support API fallback for loading older notifications when Electric SQL returns no recent items.
- Implemented deduplication and sorting logic for inbox items to prevent race conditions and ensure consistent data display.
- Enhanced loading logic for inbox items, including improved pagination and handling of loading states.
2026-01-22 16:02:25 +05:30
DESKTOP-RTLN3BA\$punk
12b825bff0 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-01-21 22:58:48 -08:00
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Manoj Aggarwal
88a9a5bef2 format 2026-01-21 22:54:09 -08:00