Commit graph

902 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
a160f0dde3 chore: linting 2026-01-23 01:44:14 -08:00
DESKTOP-RTLN3BA\$punk
ad475397c4 feat(chat): add regenerate endpoint for chat threads to support editing and reloading responses 2026-01-23 01:42:10 -08:00
Anish Sarkar
fae52345f8 Merge remote-tracking branch 'upstream/dev' into feat/composio 2026-01-23 14:35:17 +05:30
Anish Sarkar
6a41b0f608 feat: enhance Composio and Google Drive connector functionality
- Added support for extracting connected account IDs from query parameters in the Composio callback, accommodating both camelCase and snake_case formats.
- Improved logging for received query parameters in the Composio callback to enhance debugging.
- Updated Google Drive folder listing logs to remove unnecessary emoji for consistency.
- Expanded the connector dialog to include Composio Google Drive as a recognized connector type, improving user interface clarity.
2026-01-23 14:12:57 +05:30
DESKTOP-RTLN3BA\$punk
4b19d7be8c security: CVE-2025-68664 fix 2026-01-22 22:34:49 -08:00
Manoj Aggarwal
114152ccc4 add missing migration 2026-01-22 20:58:18 -08:00
Manoj Aggarwal
49d51ba569 merge 2026-01-22 20:57:48 -08:00
DESKTOP-RTLN3BA\$punk
8b81507739 refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
DESKTOP-RTLN3BA\$punk
ed931bb404 fix: live comment sync in shared chats
- Added a method to find existing notifications by mention ID to prevent duplicate notifications.
- Updated notify_new_mention to check for existing notifications before creating a new one, ensuring idempotency.
- Implemented error handling for race conditions during notification creation, allowing retrieval of existing notifications in case of duplicate key errors.
- Improved documentation for clarity on the use of mention_id for idempotency.
2026-01-22 16:04:08 -08:00
Anish Sarkar
8a0b8346a5 chore: ran linting 2026-01-23 05:28:18 +05:30
Anish Sarkar
42752bbeab feat: improve Composio file processing and error handling
- Enhanced the handling of file content from Composio, supporting both binary and text files with appropriate processing methods.
- Introduced robust error logging and handling for file content extraction, ensuring better visibility into issues during processing.
- Updated the indexing logic to accommodate new content processing methods, improving overall reliability and user feedback on errors.
- Added temporary file handling for binary files to facilitate text extraction using the ETL service.
2026-01-23 05:28:03 +05:30
Anish Sarkar
7ec7ed5c3b feat: enhance Composio Google Drive integration with folder and file selection
- Added a new endpoint to list folders and files in a user's Composio Google Drive, supporting hierarchical structure.
- Implemented UI components for selecting specific folders and files to index, improving user control over indexing options.
- Introduced indexing options for maximum files per folder and inclusion of subfolders, allowing for customizable indexing behavior.
- Enhanced error handling and logging for Composio Drive operations, ensuring better visibility into issues during file retrieval and indexing.
- Updated the Composio configuration component to reflect new selection capabilities and indexing options.
2026-01-23 05:17:28 +05:30
Anish Sarkar
4cbf80d73a feat: enhance Composio integration with pagination and improved error handling
- Updated the list_gmail_messages method to support pagination with page tokens, allowing for more efficient message retrieval.
- Modified the return structure to include next_page_token and result_size_estimate for better client-side handling.
- Improved error handling and logging throughout the Gmail indexing process, ensuring better visibility into failures.
- Implemented batch processing for Gmail messages, committing changes incrementally to prevent data loss.
- Ensured consistent timestamp updates for connectors, even when no documents are indexed, to maintain accurate UI states.
- Refactored the indexing logic to streamline message processing and enhance overall performance.
2026-01-23 04:44:37 +05:30
Manoj Aggarwal
4b60a2b805 nit 2026-01-22 13:01:10 -08:00
CREDO23
1a2fa23916 Merge upstream/dev with live collaboration features 2026-01-22 23:00:42 +02:00
Manoj Aggarwal
b2eaf1ea94 missing migration 2026-01-22 12:01:35 -08:00
Manoj Aggarwal
a680759c23 explicitly remove obsidian when cloud 2026-01-22 12:01:19 -08:00
Manoj Aggarwal
f0760c14e9 Merge dev into feature/obsidian - resolved conflicts keeping both Obsidian and Composio connectors 2026-01-22 11:43:18 -08:00
Manoj Aggarwal
151b93b31a update prompt 2026-01-22 10:30:34 -08:00
Anish Sarkar
4bff1e8c10 Merge branch 'feat/inbox' into feat/composio 2026-01-22 23:02:00 +05:30
Anish Sarkar
076de2f3d7 feat: add unread count endpoint and update inbox logic
- Introduced a new API endpoint to fetch unread notification counts, providing both total and recent counts for better tracking.
- Updated the useInbox hook to manage separate states for older and recent unread counts, enhancing user experience with real-time updates.
- Implemented logic to handle marking notifications as read, ensuring accurate count adjustments for both recent and older items.
- Enhanced type definitions in the inbox types to support the new unread count functionality.
2026-01-22 22:56:02 +05:30
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
CREDO23
ac7d84571d Add thread_id to chat_comments for Electric sync 2026-01-22 17:27:42 +02:00
Anish Sarkar
be7ba76417 chore: ran backend and frontend linting 2026-01-22 16:07:06 +05:30
Anish Sarkar
3d4a8f981c Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 16:03:37 +05:30
Anish Sarkar
a449e7e2a6 feat: enhance notifications API and inbox functionality
- Added a new endpoint to list notifications with pagination, allowing users to fetch older notifications beyond the sync window.
- Introduced response models for notifications and improved error handling for date filtering.
- Updated the useInbox hook to support API fallback for loading older notifications when Electric SQL returns no recent items.
- Implemented deduplication and sorting logic for inbox items to prevent race conditions and ensure consistent data display.
- Enhanced loading logic for inbox items, including improved pagination and handling of loading states.
2026-01-22 16:02:25 +05:30
DESKTOP-RTLN3BA\$punk
12b825bff0 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-01-21 22:58:48 -08:00
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Manoj Aggarwal
88a9a5bef2 format 2026-01-21 22:54:09 -08:00
Manoj Aggarwal
8a83424be5 Add support for obsidian to surfsense 2026-01-21 15:21:06 -08:00
Rohan Verma
cc658789e4
Merge pull request #722 from manojag115/feature/user-memory
Add user memory feature to SurfSense
2026-01-21 14:54:06 -08:00
Anish Sarkar
57baeda767 refactor: remove archived column migration for notifications 2026-01-22 02:14:46 +05:30
Anish Sarkar
200f8732f6 Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 02:13:42 +05:30
Rohan Verma
017eabe6cf
Merge pull request #718 from AnishSarkar22/feat/github-connector
feat: Integrate gitingest for GitHub connector
2026-01-21 12:28:28 -08:00
Rohan Verma
4fa71d2cd6
Merge pull request #716 from AnishSarkar22/fix/chat-ui
fix: Simiplify UI for chat
2026-01-21 12:21:46 -08:00
Manoj Aggarwal
6a8721bd17 ruff format 2026-01-21 09:55:40 -08:00
Manoj Aggarwal
ea6f6b3851 ruff 2026-01-21 09:47:17 -08:00
Anish Sarkar
112f6ec4cc refactor: remove archived functionality from notifications and related components
- Removed the archived column from the Notification model and database schema, simplifying the notification structure.
- Deleted ArchiveRequest and ArchiveResponse models, along with associated API endpoints for archiving notifications.
- Updated InboxSidebar and related components to eliminate archiving functionality, streamlining the user experience.
- Adjusted filtering logic in the InboxSidebar to focus solely on unread notifications, enhancing clarity and usability.
2026-01-21 22:47:39 +05:30
CREDO23
3765d0a868 Update migration 74 for live collaboration tables 2026-01-21 17:57:11 +02:00
Anish Sarkar
22b2d6e400 feat: add archived column to notifications and implement archiving functionality
- Introduced an archived boolean column in the notifications table to allow users to archive inbox items without deletion.
- Updated Notification model to include the archived field with default value.
- Added ArchiveRequest and ArchiveResponse models for handling archive/unarchive operations.
- Implemented API endpoint to archive or unarchive notifications, ensuring real-time updates with Electric SQL.
- Enhanced InboxSidebar to filter and display archived notifications appropriately.
2026-01-21 20:34:58 +05:30
CREDO23
0245e4bea9 Add Electric SQL replication for messages and comments 2026-01-21 15:17:23 +02:00
Manoj Aggarwal
e3fe4b86df remove debug logs 2026-01-20 17:48:40 -08:00
Manoj Aggarwal
92aa3f4eab error 2026-01-20 15:34:01 -08:00
Manoj Aggarwal
48fb38bafc Add ability to store and retreive user memory through mcp tool 2026-01-20 15:04:07 -08:00
Anish Sarkar
35888144eb refactor: Update GitHub connector to use gitingest CLI
- Refactored GitHubConnector to utilize gitingest CLI via subprocess, improving performance and avoiding async issues with Celery.
- Updated ingestion method to handle repository digests more efficiently, including error handling for subprocess execution.
- Adjusted GitHub indexer to call the new synchronous ingestion method.
- Clarified documentation regarding the optional nature of the Personal Access Token for public repositories.
2026-01-20 23:24:33 +05:30
Anish Sarkar
49b8a46d10 feat: Integrate gitingest for GitHub repository ingestion
- Added gitingest as a dependency to streamline the ingestion of GitHub repositories.
- Refactored GitHubConnector to utilize gitingest for efficient repository digest generation, reducing API calls.
- Updated GitHub indexer to process entire repository digests, enhancing performance and simplifying the indexing process.
- Modified GitHub connect form to indicate that the Personal Access Token is optional for public repositories.
2026-01-20 21:52:32 +05:30
CREDO23
dc628198ce Integrate session state into chat streaming 2026-01-20 16:40:38 +02:00
Anish Sarkar
96701a9f01 feat: enhance chat comment notifications with author details
- Added author_avatar_url and author_email to comment creation and reply functions for improved metadata.
- Updated MentionNotificationHandler to include author details in notifications.
- Enhanced NotificationPopup to display author's avatar with initials fallback for mentions.
- Updated notification types to accommodate new author fields.
2026-01-20 20:05:37 +05:30
CREDO23
d7b0b90a01 Add chat session state service 2026-01-20 16:31:40 +02:00
CREDO23
55a07c064e Add chat session state schemas 2026-01-20 16:24:37 +02:00