Commit graph

778 commits

Author SHA1 Message Date
Anish Sarkar
6a41b0f608 feat: enhance Composio and Google Drive connector functionality
- Added support for extracting connected account IDs from query parameters in the Composio callback, accommodating both camelCase and snake_case formats.
- Improved logging for received query parameters in the Composio callback to enhance debugging.
- Updated Google Drive folder listing logs to remove unnecessary emoji for consistency.
- Expanded the connector dialog to include Composio Google Drive as a recognized connector type, improving user interface clarity.
2026-01-23 14:12:57 +05:30
Anish Sarkar
8a0b8346a5 chore: ran linting 2026-01-23 05:28:18 +05:30
Anish Sarkar
42752bbeab feat: improve Composio file processing and error handling
- Enhanced the handling of file content from Composio, supporting both binary and text files with appropriate processing methods.
- Introduced robust error logging and handling for file content extraction, ensuring better visibility into issues during processing.
- Updated the indexing logic to accommodate new content processing methods, improving overall reliability and user feedback on errors.
- Added temporary file handling for binary files to facilitate text extraction using the ETL service.
2026-01-23 05:28:03 +05:30
Anish Sarkar
7ec7ed5c3b feat: enhance Composio Google Drive integration with folder and file selection
- Added a new endpoint to list folders and files in a user's Composio Google Drive, supporting hierarchical structure.
- Implemented UI components for selecting specific folders and files to index, improving user control over indexing options.
- Introduced indexing options for maximum files per folder and inclusion of subfolders, allowing for customizable indexing behavior.
- Enhanced error handling and logging for Composio Drive operations, ensuring better visibility into issues during file retrieval and indexing.
- Updated the Composio configuration component to reflect new selection capabilities and indexing options.
2026-01-23 05:17:28 +05:30
Anish Sarkar
4cbf80d73a feat: enhance Composio integration with pagination and improved error handling
- Updated the list_gmail_messages method to support pagination with page tokens, allowing for more efficient message retrieval.
- Modified the return structure to include next_page_token and result_size_estimate for better client-side handling.
- Improved error handling and logging throughout the Gmail indexing process, ensuring better visibility into failures.
- Implemented batch processing for Gmail messages, committing changes incrementally to prevent data loss.
- Ensured consistent timestamp updates for connectors, even when no documents are indexed, to maintain accurate UI states.
- Refactored the indexing logic to streamline message processing and enhance overall performance.
2026-01-23 04:44:37 +05:30
Anish Sarkar
4bff1e8c10 Merge branch 'feat/inbox' into feat/composio 2026-01-22 23:02:00 +05:30
Anish Sarkar
076de2f3d7 feat: add unread count endpoint and update inbox logic
- Introduced a new API endpoint to fetch unread notification counts, providing both total and recent counts for better tracking.
- Updated the useInbox hook to manage separate states for older and recent unread counts, enhancing user experience with real-time updates.
- Implemented logic to handle marking notifications as read, ensuring accurate count adjustments for both recent and older items.
- Enhanced type definitions in the inbox types to support the new unread count functionality.
2026-01-22 22:56:02 +05:30
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
Anish Sarkar
be7ba76417 chore: ran backend and frontend linting 2026-01-22 16:07:06 +05:30
Anish Sarkar
3d4a8f981c Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 16:03:37 +05:30
Anish Sarkar
a449e7e2a6 feat: enhance notifications API and inbox functionality
- Added a new endpoint to list notifications with pagination, allowing users to fetch older notifications beyond the sync window.
- Introduced response models for notifications and improved error handling for date filtering.
- Updated the useInbox hook to support API fallback for loading older notifications when Electric SQL returns no recent items.
- Implemented deduplication and sorting logic for inbox items to prevent race conditions and ensure consistent data display.
- Enhanced loading logic for inbox items, including improved pagination and handling of loading states.
2026-01-22 16:02:25 +05:30
DESKTOP-RTLN3BA\$punk
12b825bff0 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-01-21 22:58:48 -08:00
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Rohan Verma
cc658789e4
Merge pull request #722 from manojag115/feature/user-memory
Add user memory feature to SurfSense
2026-01-21 14:54:06 -08:00
Anish Sarkar
57baeda767 refactor: remove archived column migration for notifications 2026-01-22 02:14:46 +05:30
Anish Sarkar
200f8732f6 Merge remote-tracking branch 'upstream/dev' into feat/inbox 2026-01-22 02:13:42 +05:30
Rohan Verma
017eabe6cf
Merge pull request #718 from AnishSarkar22/feat/github-connector
feat: Integrate gitingest for GitHub connector
2026-01-21 12:28:28 -08:00
Rohan Verma
4fa71d2cd6
Merge pull request #716 from AnishSarkar22/fix/chat-ui
fix: Simiplify UI for chat
2026-01-21 12:21:46 -08:00
Manoj Aggarwal
6a8721bd17 ruff format 2026-01-21 09:55:40 -08:00
Manoj Aggarwal
ea6f6b3851 ruff 2026-01-21 09:47:17 -08:00
Anish Sarkar
112f6ec4cc refactor: remove archived functionality from notifications and related components
- Removed the archived column from the Notification model and database schema, simplifying the notification structure.
- Deleted ArchiveRequest and ArchiveResponse models, along with associated API endpoints for archiving notifications.
- Updated InboxSidebar and related components to eliminate archiving functionality, streamlining the user experience.
- Adjusted filtering logic in the InboxSidebar to focus solely on unread notifications, enhancing clarity and usability.
2026-01-21 22:47:39 +05:30
Anish Sarkar
22b2d6e400 feat: add archived column to notifications and implement archiving functionality
- Introduced an archived boolean column in the notifications table to allow users to archive inbox items without deletion.
- Updated Notification model to include the archived field with default value.
- Added ArchiveRequest and ArchiveResponse models for handling archive/unarchive operations.
- Implemented API endpoint to archive or unarchive notifications, ensuring real-time updates with Electric SQL.
- Enhanced InboxSidebar to filter and display archived notifications appropriately.
2026-01-21 20:34:58 +05:30
Manoj Aggarwal
e3fe4b86df remove debug logs 2026-01-20 17:48:40 -08:00
Manoj Aggarwal
92aa3f4eab error 2026-01-20 15:34:01 -08:00
Manoj Aggarwal
48fb38bafc Add ability to store and retreive user memory through mcp tool 2026-01-20 15:04:07 -08:00
Anish Sarkar
35888144eb refactor: Update GitHub connector to use gitingest CLI
- Refactored GitHubConnector to utilize gitingest CLI via subprocess, improving performance and avoiding async issues with Celery.
- Updated ingestion method to handle repository digests more efficiently, including error handling for subprocess execution.
- Adjusted GitHub indexer to call the new synchronous ingestion method.
- Clarified documentation regarding the optional nature of the Personal Access Token for public repositories.
2026-01-20 23:24:33 +05:30
Anish Sarkar
49b8a46d10 feat: Integrate gitingest for GitHub repository ingestion
- Added gitingest as a dependency to streamline the ingestion of GitHub repositories.
- Refactored GitHubConnector to utilize gitingest for efficient repository digest generation, reducing API calls.
- Updated GitHub indexer to process entire repository digests, enhancing performance and simplifying the indexing process.
- Modified GitHub connect form to indicate that the Personal Access Token is optional for public repositories.
2026-01-20 21:52:32 +05:30
Anish Sarkar
96701a9f01 feat: enhance chat comment notifications with author details
- Added author_avatar_url and author_email to comment creation and reply functions for improved metadata.
- Updated MentionNotificationHandler to include author details in notifications.
- Enhanced NotificationPopup to display author's avatar with initials fallback for mentions.
- Updated notification types to accommodate new author fields.
2026-01-20 20:05:37 +05:30
DESKTOP-RTLN3BA\$punk
f200502ffc refactor: bulk updating Admin to Editor roles
- Consolidated the migration process for search space memberships and invites from Admin to Editor roles using bulk SQL updates.
- Removed the Admin role in bulk for system roles.
- Updated permissions for Editor and Viewer roles across all search spaces in a more efficient manner.
2026-01-20 03:11:49 -08:00
DESKTOP-RTLN3BA\$punk
e578bb9e77 chore: linting 2026-01-20 03:00:02 -08:00
DESKTOP-RTLN3BA\$punk
e163708bad feat: Refactor role permissions and access checks
- Removed the Admin role and updated the permission sets for Owner, Editor, and Viewer roles in db.py.
- Clarified access requirements for chat threads in new_chat_routes.py, ensuring ownership checks are prioritized.
- Added preset permission options for quick role creation in the CreateRoleDialog component of the team page.
2026-01-20 02:59:32 -08:00
DESKTOP-RTLN3BA\$punk
4595fd3d1f docs: updated docs 2026-01-20 02:03:05 -08:00
DESKTOP-RTLN3BA\$punk
d96ae66012 chore: linting 2026-01-20 00:32:31 -08:00
DESKTOP-RTLN3BA\$punk
a41b75463f chore: enhance system prompt 2026-01-19 18:14:21 -08:00
DESKTOP-RTLN3BA\$punk
9625a24475 feat: support multiple transport types for MCP server connections, including stdio and HTTP 2026-01-19 17:44:19 -08:00
CREDO23
4d004cc1b2 fix: mention notifications and scroll-to-comment from notifications 2026-01-19 19:56:21 +02:00
CREDO23
2839501503 feat: add Electric SQL replication for chat_comment_mentions 2026-01-19 17:28:44 +02:00
CREDO23
6b9695e848 chore: resolve migration file conflicts 2026-01-19 17:10:11 +02:00
CREDO23
ae4297a02f feat: add MentionNotificationHandler and create notifications on mention 2026-01-19 17:06:51 +02:00
CREDO23
7f5f4a6893 feat: add Electric SQL replication for chat_comments 2026-01-19 16:39:08 +02:00
CREDO23
47fbc83d48 Merge branch 'dev' into sur-90-feat-comments-in-chats 2026-01-19 14:49:10 +02:00
CREDO23
8ad6c268df chore: cleanup unused files and update cache keys 2026-01-19 14:38:05 +02:00
CREDO23
ba57c39556 feat(backend): add has_comments field to thread API 2026-01-19 14:36:29 +02:00
Rohan Verma
26ef83fbaa
Merge pull request #707 from AnishSarkar22/fix/mentions
feat: Revamped search in document mentions
2026-01-18 22:15:28 -08:00
Rohan Verma
87a174a1fd
Merge pull request #706 from AnishSarkar22/fix/drive-index
feat: enhance Google Drive indexing
2026-01-18 22:15:03 -08:00
Anish Sarkar
8654c98afe chore: update redundant comments 2026-01-18 20:13:51 +05:30
Manoj Aggarwal
f78c2a685e add error handling to mcp_tool python files 2026-01-17 09:18:46 -08:00
Anish Sarkar
293de6876a feat: implement fuzzy search in mention document 2026-01-17 20:46:47 +05:30
Anish Sarkar
b001b65067 feat: add pg_trgm indexes and lightweight document title search
- Introduced pg_trgm extension and GIN trigram indexes for efficient document title searches, enhancing performance for mention picker functionality.
- Implemented a new API endpoint for lightweight document title searches, returning only essential fields.
- Updated frontend components to utilize the new title search feature with throttling for improved user experience.
- Added necessary schemas and types for the new search functionality.
2026-01-17 20:45:10 +05:30
Anish Sarkar
e0be1b9133 chore: ran backend and frontend linting 2026-01-17 16:30:07 +05:30