Commit graph

763 commits

Author SHA1 Message Date
Anish Sarkar
076de2f3d7 feat: add unread count endpoint and update inbox logic
- Introduced a new API endpoint to fetch unread notification counts, providing both total and recent counts for better tracking.
- Updated the useInbox hook to manage separate states for older and recent unread counts, enhancing user experience with real-time updates.
- Implemented logic to handle marking notifications as read, ensuring accurate count adjustments for both recent and older items.
- Enhanced type definitions in the inbox types to support the new unread count functionality.
2026-01-22 22:56:02 +05:30
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
CREDO23
ac7d84571d Add thread_id to chat_comments for Electric sync 2026-01-22 17:27:42 +02:00
Anish Sarkar
be7ba76417 chore: ran backend and frontend linting 2026-01-22 16:07:06 +05:30
Anish Sarkar
3d4a8f981c Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 16:03:37 +05:30
Anish Sarkar
a449e7e2a6 feat: enhance notifications API and inbox functionality
- Added a new endpoint to list notifications with pagination, allowing users to fetch older notifications beyond the sync window.
- Introduced response models for notifications and improved error handling for date filtering.
- Updated the useInbox hook to support API fallback for loading older notifications when Electric SQL returns no recent items.
- Implemented deduplication and sorting logic for inbox items to prevent race conditions and ensure consistent data display.
- Enhanced loading logic for inbox items, including improved pagination and handling of loading states.
2026-01-22 16:02:25 +05:30
DESKTOP-RTLN3BA\$punk
12b825bff0 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-01-21 22:58:48 -08:00
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Manoj Aggarwal
88a9a5bef2 format 2026-01-21 22:54:09 -08:00
Manoj Aggarwal
8a83424be5 Add support for obsidian to surfsense 2026-01-21 15:21:06 -08:00
Rohan Verma
cc658789e4
Merge pull request #722 from manojag115/feature/user-memory
Add user memory feature to SurfSense
2026-01-21 14:54:06 -08:00
Rohan Verma
017eabe6cf
Merge pull request #718 from AnishSarkar22/feat/github-connector
feat: Integrate gitingest for GitHub connector
2026-01-21 12:28:28 -08:00
Manoj Aggarwal
6a8721bd17 ruff format 2026-01-21 09:55:40 -08:00
Manoj Aggarwal
ea6f6b3851 ruff 2026-01-21 09:47:17 -08:00
Manoj Aggarwal
e3fe4b86df remove debug logs 2026-01-20 17:48:40 -08:00
Manoj Aggarwal
92aa3f4eab error 2026-01-20 15:34:01 -08:00
Manoj Aggarwal
48fb38bafc Add ability to store and retreive user memory through mcp tool 2026-01-20 15:04:07 -08:00
Anish Sarkar
35888144eb refactor: Update GitHub connector to use gitingest CLI
- Refactored GitHubConnector to utilize gitingest CLI via subprocess, improving performance and avoiding async issues with Celery.
- Updated ingestion method to handle repository digests more efficiently, including error handling for subprocess execution.
- Adjusted GitHub indexer to call the new synchronous ingestion method.
- Clarified documentation regarding the optional nature of the Personal Access Token for public repositories.
2026-01-20 23:24:33 +05:30
Anish Sarkar
49b8a46d10 feat: Integrate gitingest for GitHub repository ingestion
- Added gitingest as a dependency to streamline the ingestion of GitHub repositories.
- Refactored GitHubConnector to utilize gitingest for efficient repository digest generation, reducing API calls.
- Updated GitHub indexer to process entire repository digests, enhancing performance and simplifying the indexing process.
- Modified GitHub connect form to indicate that the Personal Access Token is optional for public repositories.
2026-01-20 21:52:32 +05:30
CREDO23
dc628198ce Integrate session state into chat streaming 2026-01-20 16:40:38 +02:00
Anish Sarkar
96701a9f01 feat: enhance chat comment notifications with author details
- Added author_avatar_url and author_email to comment creation and reply functions for improved metadata.
- Updated MentionNotificationHandler to include author details in notifications.
- Enhanced NotificationPopup to display author's avatar with initials fallback for mentions.
- Updated notification types to accommodate new author fields.
2026-01-20 20:05:37 +05:30
CREDO23
d7b0b90a01 Add chat session state service 2026-01-20 16:31:40 +02:00
CREDO23
55a07c064e Add chat session state schemas 2026-01-20 16:24:37 +02:00
CREDO23
7d35419b88 Add ChatSessionState model 2026-01-20 16:17:54 +02:00
DESKTOP-RTLN3BA\$punk
e578bb9e77 chore: linting 2026-01-20 03:00:02 -08:00
DESKTOP-RTLN3BA\$punk
e163708bad feat: Refactor role permissions and access checks
- Removed the Admin role and updated the permission sets for Owner, Editor, and Viewer roles in db.py.
- Clarified access requirements for chat threads in new_chat_routes.py, ensuring ownership checks are prioritized.
- Added preset permission options for quick role creation in the CreateRoleDialog component of the team page.
2026-01-20 02:59:32 -08:00
DESKTOP-RTLN3BA\$punk
d96ae66012 chore: linting 2026-01-20 00:32:31 -08:00
DESKTOP-RTLN3BA\$punk
a41b75463f chore: enhance system prompt 2026-01-19 18:14:21 -08:00
DESKTOP-RTLN3BA\$punk
9625a24475 feat: support multiple transport types for MCP server connections, including stdio and HTTP 2026-01-19 17:44:19 -08:00
CREDO23
4d004cc1b2 fix: mention notifications and scroll-to-comment from notifications 2026-01-19 19:56:21 +02:00
CREDO23
ae4297a02f feat: add MentionNotificationHandler and create notifications on mention 2026-01-19 17:06:51 +02:00
CREDO23
47fbc83d48 Merge branch 'dev' into sur-90-feat-comments-in-chats 2026-01-19 14:49:10 +02:00
CREDO23
ba57c39556 feat(backend): add has_comments field to thread API 2026-01-19 14:36:29 +02:00
Rohan Verma
26ef83fbaa
Merge pull request #707 from AnishSarkar22/fix/mentions
feat: Revamped search in document mentions
2026-01-18 22:15:28 -08:00
Rohan Verma
87a174a1fd
Merge pull request #706 from AnishSarkar22/fix/drive-index
feat: enhance Google Drive indexing
2026-01-18 22:15:03 -08:00
Manoj Aggarwal
f78c2a685e add error handling to mcp_tool python files 2026-01-17 09:18:46 -08:00
Anish Sarkar
293de6876a feat: implement fuzzy search in mention document 2026-01-17 20:46:47 +05:30
Anish Sarkar
b001b65067 feat: add pg_trgm indexes and lightweight document title search
- Introduced pg_trgm extension and GIN trigram indexes for efficient document title searches, enhancing performance for mention picker functionality.
- Implemented a new API endpoint for lightweight document title searches, returning only essential fields.
- Updated frontend components to utilize the new title search feature with throttling for improved user experience.
- Added necessary schemas and types for the new search functionality.
2026-01-17 20:45:10 +05:30
Anish Sarkar
e0be1b9133 chore: ran backend and frontend linting 2026-01-17 16:30:07 +05:30
Anish Sarkar
f538d59ca3 feat: enhance Google Drive file metadata handling
- Updated Google Drive API calls to include md5Checksum in file metadata retrieval for improved content tracking.
- Added logic to check for rename-only updates based on md5Checksum, optimizing document processing by preventing unnecessary ETL operations for unchanged content.
- Enhanced existing document update logic to handle renaming and metadata updates more effectively, particularly for Google Drive files.
2026-01-17 16:24:53 +05:30
Anish Sarkar
49efc50767 feat: enhance document processing with content hash deduplication
- Added support for content hash fallback in document migration to prevent duplicate entries from different sources.
- Improved existing document update logic to handle renaming and metadata updates more effectively, particularly for Google Drive files.
- Updated functions to check for existing documents with enhanced logging for better traceability of duplicate content detection.
2026-01-17 15:39:36 +05:30
Anish Sarkar
6550c378b2 feat: enhance Google Drive document handling and UI integration
- Implemented support for both new file_id-based and legacy filename-based hash schemes in document processing.
- Added functions to generate unique identifier hashes and find existing documents with migration support.
- Improved existing document update logic to handle content changes and metadata updates, particularly for Google Drive files.
- Enhanced UI components to display appropriate file icons based on file types in the Google Drive connector.
- Updated document processing functions to accommodate the new connector structure and ensure seamless integration.
2026-01-17 14:57:31 +05:30
Anish Sarkar
7af3d1bc1a feat: improve Google Drive connector handling and UI feedback
- Added logic to refresh connector and notification attributes after indexing to ensure up-to-date information.
- Enhanced periodic sync configuration to disable the option when no folders or files are selected for Google Drive, providing user feedback through a message.
- Updated the connector edit view to reflect the new disabled state for periodic sync based on selected items.
- Implemented validation in the connector dialog to prevent enabling periodic sync without selected items, improving user experience.
2026-01-17 12:59:18 +05:30
Anish Sarkar
a3112a24fe feat: enhance Google Drive indexing with new options
- Updated the Google Drive indexing functionality to include indexing options such as max files per folder, incremental sync, and inclusion of subfolders.
- Modified the API to accept a new 'indexing_options' parameter in the request body.
- Enhanced the UI to allow users to configure these options when selecting folders and files for indexing.
- Updated related components and tasks to support the new indexing options, ensuring a more flexible and efficient indexing process.
2026-01-17 12:33:57 +05:30
Manoj Aggarwal
11b160cee9 resolve conflicts 2026-01-16 15:39:57 -08:00
Manoj Aggarwal
4c07c0fe4f change the flow of mcp connectors 2026-01-16 14:39:44 -08:00
DESKTOP-RTLN3BA\$punk
8aad15d392 Reapply "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 3418c0e026.
2026-01-16 11:32:06 -08:00
Manoj Aggarwal
aa90da602b nit 2026-01-16 11:21:01 -08:00
CREDO23
13135ec51b fix: eagerly load message relationship in get_user_mentions 2026-01-16 20:17:11 +02:00
CREDO23
985f50b683 fix: use delimited format for mention highlighting 2026-01-16 20:10:09 +02:00