Commit graph

1075 commits

Author SHA1 Message Date
Manoj Aggarwal
49d51ba569 merge 2026-01-22 20:57:48 -08:00
DESKTOP-RTLN3BA\$punk
8b81507739 refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
DESKTOP-RTLN3BA\$punk
ed931bb404 fix: live comment sync in shared chats
- Added a method to find existing notifications by mention ID to prevent duplicate notifications.
- Updated notify_new_mention to check for existing notifications before creating a new one, ensuring idempotency.
- Implemented error handling for race conditions during notification creation, allowing retrieval of existing notifications in case of duplicate key errors.
- Improved documentation for clarity on the use of mention_id for idempotency.
2026-01-22 16:04:08 -08:00
Anish Sarkar
8a0b8346a5 chore: ran linting 2026-01-23 05:28:18 +05:30
Anish Sarkar
42752bbeab feat: improve Composio file processing and error handling
- Enhanced the handling of file content from Composio, supporting both binary and text files with appropriate processing methods.
- Introduced robust error logging and handling for file content extraction, ensuring better visibility into issues during processing.
- Updated the indexing logic to accommodate new content processing methods, improving overall reliability and user feedback on errors.
- Added temporary file handling for binary files to facilitate text extraction using the ETL service.
2026-01-23 05:28:03 +05:30
Anish Sarkar
7ec7ed5c3b feat: enhance Composio Google Drive integration with folder and file selection
- Added a new endpoint to list folders and files in a user's Composio Google Drive, supporting hierarchical structure.
- Implemented UI components for selecting specific folders and files to index, improving user control over indexing options.
- Introduced indexing options for maximum files per folder and inclusion of subfolders, allowing for customizable indexing behavior.
- Enhanced error handling and logging for Composio Drive operations, ensuring better visibility into issues during file retrieval and indexing.
- Updated the Composio configuration component to reflect new selection capabilities and indexing options.
2026-01-23 05:17:28 +05:30
Anish Sarkar
4cbf80d73a feat: enhance Composio integration with pagination and improved error handling
- Updated the list_gmail_messages method to support pagination with page tokens, allowing for more efficient message retrieval.
- Modified the return structure to include next_page_token and result_size_estimate for better client-side handling.
- Improved error handling and logging throughout the Gmail indexing process, ensuring better visibility into failures.
- Implemented batch processing for Gmail messages, committing changes incrementally to prevent data loss.
- Ensured consistent timestamp updates for connectors, even when no documents are indexed, to maintain accurate UI states.
- Refactored the indexing logic to streamline message processing and enhance overall performance.
2026-01-23 04:44:37 +05:30
Manoj Aggarwal
4b60a2b805 nit 2026-01-22 13:01:10 -08:00
CREDO23
1a2fa23916 Merge upstream/dev with live collaboration features 2026-01-22 23:00:42 +02:00
Manoj Aggarwal
f0760c14e9 Merge dev into feature/obsidian - resolved conflicts keeping both Obsidian and Composio connectors 2026-01-22 11:43:18 -08:00
Manoj Aggarwal
151b93b31a update prompt 2026-01-22 10:30:34 -08:00
Anish Sarkar
4bff1e8c10 Merge branch 'feat/inbox' into feat/composio 2026-01-22 23:02:00 +05:30
Anish Sarkar
076de2f3d7 feat: add unread count endpoint and update inbox logic
- Introduced a new API endpoint to fetch unread notification counts, providing both total and recent counts for better tracking.
- Updated the useInbox hook to manage separate states for older and recent unread counts, enhancing user experience with real-time updates.
- Implemented logic to handle marking notifications as read, ensuring accurate count adjustments for both recent and older items.
- Enhanced type definitions in the inbox types to support the new unread count functionality.
2026-01-22 22:56:02 +05:30
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
CREDO23
ac7d84571d Add thread_id to chat_comments for Electric sync 2026-01-22 17:27:42 +02:00
Anish Sarkar
be7ba76417 chore: ran backend and frontend linting 2026-01-22 16:07:06 +05:30
Anish Sarkar
3d4a8f981c Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 16:03:37 +05:30
Anish Sarkar
a449e7e2a6 feat: enhance notifications API and inbox functionality
- Added a new endpoint to list notifications with pagination, allowing users to fetch older notifications beyond the sync window.
- Introduced response models for notifications and improved error handling for date filtering.
- Updated the useInbox hook to support API fallback for loading older notifications when Electric SQL returns no recent items.
- Implemented deduplication and sorting logic for inbox items to prevent race conditions and ensure consistent data display.
- Enhanced loading logic for inbox items, including improved pagination and handling of loading states.
2026-01-22 16:02:25 +05:30
DESKTOP-RTLN3BA\$punk
12b825bff0 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-01-21 22:58:48 -08:00
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Manoj Aggarwal
88a9a5bef2 format 2026-01-21 22:54:09 -08:00
Manoj Aggarwal
8a83424be5 Add support for obsidian to surfsense 2026-01-21 15:21:06 -08:00
Rohan Verma
cc658789e4
Merge pull request #722 from manojag115/feature/user-memory
Add user memory feature to SurfSense
2026-01-21 14:54:06 -08:00
Rohan Verma
017eabe6cf
Merge pull request #718 from AnishSarkar22/feat/github-connector
feat: Integrate gitingest for GitHub connector
2026-01-21 12:28:28 -08:00
Manoj Aggarwal
6a8721bd17 ruff format 2026-01-21 09:55:40 -08:00
Manoj Aggarwal
ea6f6b3851 ruff 2026-01-21 09:47:17 -08:00
Manoj Aggarwal
e3fe4b86df remove debug logs 2026-01-20 17:48:40 -08:00
Manoj Aggarwal
92aa3f4eab error 2026-01-20 15:34:01 -08:00
Manoj Aggarwal
48fb38bafc Add ability to store and retreive user memory through mcp tool 2026-01-20 15:04:07 -08:00
Anish Sarkar
35888144eb refactor: Update GitHub connector to use gitingest CLI
- Refactored GitHubConnector to utilize gitingest CLI via subprocess, improving performance and avoiding async issues with Celery.
- Updated ingestion method to handle repository digests more efficiently, including error handling for subprocess execution.
- Adjusted GitHub indexer to call the new synchronous ingestion method.
- Clarified documentation regarding the optional nature of the Personal Access Token for public repositories.
2026-01-20 23:24:33 +05:30
Anish Sarkar
49b8a46d10 feat: Integrate gitingest for GitHub repository ingestion
- Added gitingest as a dependency to streamline the ingestion of GitHub repositories.
- Refactored GitHubConnector to utilize gitingest for efficient repository digest generation, reducing API calls.
- Updated GitHub indexer to process entire repository digests, enhancing performance and simplifying the indexing process.
- Modified GitHub connect form to indicate that the Personal Access Token is optional for public repositories.
2026-01-20 21:52:32 +05:30
CREDO23
dc628198ce Integrate session state into chat streaming 2026-01-20 16:40:38 +02:00
Anish Sarkar
96701a9f01 feat: enhance chat comment notifications with author details
- Added author_avatar_url and author_email to comment creation and reply functions for improved metadata.
- Updated MentionNotificationHandler to include author details in notifications.
- Enhanced NotificationPopup to display author's avatar with initials fallback for mentions.
- Updated notification types to accommodate new author fields.
2026-01-20 20:05:37 +05:30
CREDO23
d7b0b90a01 Add chat session state service 2026-01-20 16:31:40 +02:00
CREDO23
55a07c064e Add chat session state schemas 2026-01-20 16:24:37 +02:00
CREDO23
7d35419b88 Add ChatSessionState model 2026-01-20 16:17:54 +02:00
DESKTOP-RTLN3BA\$punk
e578bb9e77 chore: linting 2026-01-20 03:00:02 -08:00
DESKTOP-RTLN3BA\$punk
e163708bad feat: Refactor role permissions and access checks
- Removed the Admin role and updated the permission sets for Owner, Editor, and Viewer roles in db.py.
- Clarified access requirements for chat threads in new_chat_routes.py, ensuring ownership checks are prioritized.
- Added preset permission options for quick role creation in the CreateRoleDialog component of the team page.
2026-01-20 02:59:32 -08:00
DESKTOP-RTLN3BA\$punk
d96ae66012 chore: linting 2026-01-20 00:32:31 -08:00
DESKTOP-RTLN3BA\$punk
a41b75463f chore: enhance system prompt 2026-01-19 18:14:21 -08:00
DESKTOP-RTLN3BA\$punk
9625a24475 feat: support multiple transport types for MCP server connections, including stdio and HTTP 2026-01-19 17:44:19 -08:00
CREDO23
4d004cc1b2 fix: mention notifications and scroll-to-comment from notifications 2026-01-19 19:56:21 +02:00
CREDO23
ae4297a02f feat: add MentionNotificationHandler and create notifications on mention 2026-01-19 17:06:51 +02:00
CREDO23
47fbc83d48 Merge branch 'dev' into sur-90-feat-comments-in-chats 2026-01-19 14:49:10 +02:00
CREDO23
ba57c39556 feat(backend): add has_comments field to thread API 2026-01-19 14:36:29 +02:00
Rohan Verma
26ef83fbaa
Merge pull request #707 from AnishSarkar22/fix/mentions
feat: Revamped search in document mentions
2026-01-18 22:15:28 -08:00
Rohan Verma
87a174a1fd
Merge pull request #706 from AnishSarkar22/fix/drive-index
feat: enhance Google Drive indexing
2026-01-18 22:15:03 -08:00
Manoj Aggarwal
f78c2a685e add error handling to mcp_tool python files 2026-01-17 09:18:46 -08:00
Anish Sarkar
293de6876a feat: implement fuzzy search in mention document 2026-01-17 20:46:47 +05:30
Anish Sarkar
b001b65067 feat: add pg_trgm indexes and lightweight document title search
- Introduced pg_trgm extension and GIN trigram indexes for efficient document title searches, enhancing performance for mention picker functionality.
- Implemented a new API endpoint for lightweight document title searches, returning only essential fields.
- Updated frontend components to utilize the new title search feature with throttling for improved user experience.
- Added necessary schemas and types for the new search functionality.
2026-01-17 20:45:10 +05:30