Commit graph

157 commits

Author SHA1 Message Date
Anish Sarkar
0ba70401e9 feat: enhance date range selector with last indexed timestamp for improved user context 2026-01-30 23:57:18 +05:30
Anish Sarkar
1658724fb2 Merge remote-tracking branch 'upstream/dev' into fix/notion-connector 2026-01-29 10:45:31 +05:30
Anish Sarkar
41ebe162b0 feat(backend): Implement handling of unsupported Notion block types and track skipped content, add documentation for it 2026-01-28 17:43:45 +05:30
Anish Sarkar
3af4fd0533 feat(indexing): add content hash check to prevent duplicate indexing and update return values for indexing functions 2026-01-28 03:55:25 +05:30
DESKTOP-RTLN3BA\$punk
39d65d6166 feat: added incentive credits system 2026-01-26 23:32:30 -08:00
Rohan Verma
b031b98639
Merge pull request #742 from AnishSarkar22/fix/docker
fix: add `git` as github connector dependency and update connector status
2026-01-25 16:21:01 -08:00
Anish Sarkar
0e26fb157a chore: fixed github connector dependency and update connector status configuration 2026-01-26 03:24:05 +05:30
Anish Sarkar
c7c9eb3eb2 Merge remote-tracking branch 'upstream/dev' into feat/ui 2026-01-25 16:19:18 +05:30
Anish Sarkar
03e38ab178 chore: ran frontend linting 2026-01-25 16:16:09 +05:30
Anish Sarkar
2d17d1a1b6 feat: replace Loader2 with Spinner component for consistent loading indicators 2026-01-25 15:23:45 +05:30
DESKTOP-RTLN3BA\$punk
555df90c84 chore: New connector statuses for Composio and GitHub 2026-01-24 17:47:18 -08:00
Anish Sarkar
9215118bab feat: enhance documentation and fixed bug in loading.tsx 2026-01-24 22:43:04 +05:30
Anish Sarkar
c6bd978d5b Merge remote-tracking branch 'upstream/dev' into feat/composio 2026-01-24 04:38:34 +05:30
Anish Sarkar
a5103da3d7 chore: ran linting 2026-01-24 04:36:34 +05:30
Anish Sarkar
6d14b49d3f feat: enhance indexing state management and inbox count formatting
- Improved indexing state management by refining the logic for handling notifications, ensuring accurate updates for in-progress, completed, and failed states.
- Introduced a new utility function to format inbox counts, displaying numbers up to 999 and using "k+" for larger counts, enhancing user interface clarity.
- Updated sidebar components to utilize the new inbox count formatting, improving the overall user experience.
2026-01-24 01:20:51 +05:30
Anish Sarkar
c48ba36fa4 feat: improve indexing logic and duplicate handling in connectors
- Enhanced Google Calendar and Composio connector indexing to track and log duplicate content, preventing re-indexing of already processed events.
- Implemented robust error handling during final commits to manage integrity errors gracefully, ensuring successful indexing despite potential duplicates.
- Updated notification service to differentiate between actual errors and warnings for duplicate content, improving user feedback.
- Refactored date handling to ensure valid date ranges and adjusted end dates when necessary for better indexing accuracy.
2026-01-23 23:36:14 +05:30
Anish Sarkar
d20bb385b5 feat: enhance date handling and indexing logic across connectors
- Added normalization for "undefined" strings to None in date parameters to prevent parsing errors.
- Improved date range validation to ensure start_date is strictly before end_date, adjusting end_date if necessary.
- Updated Google Calendar and Composio connector indexing logic to handle duplicate content more effectively, logging warnings for skipped events.
- Enhanced error handling during final commits to manage integrity errors gracefully.
- Refactored date handling in various connector indexers for consistency and reliability.
2026-01-23 23:03:29 +05:30
Anish Sarkar
12f45e1bd3 feat: streamline Composio connector configurations and enhance UI interactions
- Refactored Composio connector configuration components to improve modularity and maintainability.
- Simplified the ComposioCalendarConfig, ComposioGmailConfig, and ComposioDriveConfig components by removing unnecessary state management and UI elements.
- Added functionality to remove selected folders and files in the Google Drive and Composio Drive configurations, enhancing user experience.
- Updated connector display names for better clarity in the UI.
- Improved the overall structure of the connector edit view for better readability and usability.
2026-01-23 20:19:04 +05:30
Anish Sarkar
1343fabeee feat: refactor composio connectors for modularity 2026-01-23 19:56:19 +05:30
Anish Sarkar
8d8f69545e feat: improve Google Calendar and Gmail connectors with enhanced error handling
- Added user-friendly re-authentication messages for expired or revoked tokens in both Google Calendar and Gmail connectors.
- Updated error handling in indexing tasks to log specific authentication errors and provide clearer feedback to users.
- Enhanced the connector UI to handle indexing failures more effectively, improving overall user experience.
2026-01-23 18:57:10 +05:30
Anish Sarkar
29382070aa feat: enhance Composio connector functionality with Google Drive delta sync support
- Added methods to retrieve the starting page token and list changes in Google Drive, enabling delta sync capabilities.
- Updated Composio service to handle file download directory configuration.
- Modified indexing tasks to support delta sync, improving efficiency by processing only changed files.
- Adjusted date handling in connector tasks to allow optional start and end dates.
- Improved error handling and logging throughout the Composio indexing process.
2026-01-23 18:37:09 +05:30
DESKTOP-RTLN3BA\$punk
a160f0dde3 chore: linting 2026-01-23 01:44:14 -08:00
Anish Sarkar
9c5c925fca feat: update Obsidian connector UI and icon 2026-01-23 14:50:06 +05:30
Anish Sarkar
fae52345f8 Merge remote-tracking branch 'upstream/dev' into feat/composio 2026-01-23 14:35:17 +05:30
Anish Sarkar
6a41b0f608 feat: enhance Composio and Google Drive connector functionality
- Added support for extracting connected account IDs from query parameters in the Composio callback, accommodating both camelCase and snake_case formats.
- Improved logging for received query parameters in the Composio callback to enhance debugging.
- Updated Google Drive folder listing logs to remove unnecessary emoji for consistency.
- Expanded the connector dialog to include Composio Google Drive as a recognized connector type, improving user interface clarity.
2026-01-23 14:12:57 +05:30
Manoj Aggarwal
49d51ba569 merge 2026-01-22 20:57:48 -08:00
DESKTOP-RTLN3BA\$punk
8b81507739 refactor: remove unused COMPOSIO_CONNECTOR migration and linting 2026-01-22 16:43:08 -08:00
DESKTOP-RTLN3BA\$punk
eb509810f1 fix(temp-hotpatch): Disabling composio until fixed. 2026-01-22 16:35:28 -08:00
Anish Sarkar
8a0b8346a5 chore: ran linting 2026-01-23 05:28:18 +05:30
Anish Sarkar
7ec7ed5c3b feat: enhance Composio Google Drive integration with folder and file selection
- Added a new endpoint to list folders and files in a user's Composio Google Drive, supporting hierarchical structure.
- Implemented UI components for selecting specific folders and files to index, improving user control over indexing options.
- Introduced indexing options for maximum files per folder and inclusion of subfolders, allowing for customizable indexing behavior.
- Enhanced error handling and logging for Composio Drive operations, ensuring better visibility into issues during file retrieval and indexing.
- Updated the Composio configuration component to reflect new selection capabilities and indexing options.
2026-01-23 05:17:28 +05:30
Anish Sarkar
6139b07a66 fix: remove toolkit view 2026-01-23 03:57:02 +05:30
Manoj Aggarwal
a680759c23 explicitly remove obsidian when cloud 2026-01-22 12:01:19 -08:00
Manoj Aggarwal
5426c6e80d bluff 2026-01-22 11:44:12 -08:00
Manoj Aggarwal
f0760c14e9 Merge dev into feature/obsidian - resolved conflicts keeping both Obsidian and Composio connectors 2026-01-22 11:43:18 -08:00
Anish Sarkar
be5715cfeb feat: add Composio connector types and enhance integration
- Introduced new enum values for Composio connectors: COMPOSIO_GOOGLE_DRIVE_CONNECTOR, COMPOSIO_GMAIL_CONNECTOR, and COMPOSIO_GOOGLE_CALENDAR_CONNECTOR.
- Updated database migration to add these new enum values to the relevant types.
- Refactored Composio integration logic to handle specific connector types, improving the management of connected accounts and indexing processes.
- Enhanced frontend components to support the new Composio connector types, including updated UI elements and connector configuration handling.
- Improved backend services to manage Composio connected accounts more effectively, including deletion and indexing tasks.
2026-01-22 22:33:28 +05:30
DESKTOP-RTLN3BA\$punk
12b825bff0 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-01-21 22:58:48 -08:00
DESKTOP-RTLN3BA\$punk
8c625d4237 feat: composio connector 2026-01-21 22:57:58 -08:00
Manoj Aggarwal
88a9a5bef2 format 2026-01-21 22:54:09 -08:00
Manoj Aggarwal
8a83424be5 Add support for obsidian to surfsense 2026-01-21 15:21:06 -08:00
Anish Sarkar
d35d89f3a9 chore: ran linting 2026-01-21 03:28:34 +05:30
Anish Sarkar
5a95a6b543 feat: Add documentation link to GitHub connect form
- Replaced the removed Accordion component with a direct link to the GitHub connector documentation.
- Enhanced user experience by providing easy access to relevant documentation.
2026-01-21 01:21:25 +05:30
Anish Sarkar
8bd1ba0251 refactor: Simplify GitHub connect form by removing unused components and documentation sections 2026-01-21 00:21:21 +05:30
Anish Sarkar
6dd535c85a fix: Clean up GitHub connector UI and documentation
- Removed unnecessary period from the GitHub connect form alert description.
- Moved helper functions for string and array conversion outside the component to avoid useEffect dependency issues.
- Updated the GitHub connector documentation to provide detailed indexing information and troubleshooting tips for users.
2026-01-21 00:19:17 +05:30
Anish Sarkar
35888144eb refactor: Update GitHub connector to use gitingest CLI
- Refactored GitHubConnector to utilize gitingest CLI via subprocess, improving performance and avoiding async issues with Celery.
- Updated ingestion method to handle repository digests more efficiently, including error handling for subprocess execution.
- Adjusted GitHub indexer to call the new synchronous ingestion method.
- Clarified documentation regarding the optional nature of the Personal Access Token for public repositories.
2026-01-20 23:24:33 +05:30
Anish Sarkar
49b8a46d10 feat: Integrate gitingest for GitHub repository ingestion
- Added gitingest as a dependency to streamline the ingestion of GitHub repositories.
- Refactored GitHubConnector to utilize gitingest for efficient repository digest generation, reducing API calls.
- Updated GitHub indexer to process entire repository digests, enhancing performance and simplifying the indexing process.
- Modified GitHub connect form to indicate that the Personal Access Token is optional for public repositories.
2026-01-20 21:52:32 +05:30
DESKTOP-RTLN3BA\$punk
d96ae66012 chore: linting 2026-01-20 00:32:31 -08:00
Anish Sarkar
e65d9fa1db chore: ran linting 2026-01-20 11:50:17 +05:30
Anish Sarkar
0c3307fabb fix: use keyboard smoothly while editing the MCP json 2026-01-20 11:49:24 +05:30
Anish Sarkar
a536ad1590 Merge remote-tracking branch 'upstream/dev' into fix/ui-mcp 2026-01-20 11:39:45 +05:30
DESKTOP-RTLN3BA\$punk
9625a24475 feat: support multiple transport types for MCP server connections, including stdio and HTTP 2026-01-19 17:44:19 -08:00