Commit graph

147 commits

Author SHA1 Message Date
CREDO23
c70f0ccf49 revert Notion auth URLs to classic OAuth endpoints 2026-04-21 20:34:08 +02:00
CREDO23
30944c0fec feat(notion-mcp): wire frontend to MCP OAuth endpoints 2026-04-20 21:02:34 +02:00
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
CREDO23
a95bf58c8f Make Vision LLM opt-in for uploads and connectors 2026-04-10 16:45:51 +02:00
Anish Sarkar
56c5809170 chore: ran linting 2026-04-08 18:23:03 +05:30
SohamBhattacharjee2003
2b02ecaa6f perf: implement dynamic imports for connector configs and forms (#1142)
- Replace 23 static connector config imports with dynamic imports
- Replace 10 static connect form imports with dynamic imports
- Add component caching to avoid recreating dynamic components
- Significantly reduces connector popup chunk size
- Only selected connector components load on demand
2026-04-08 06:47:31 +05:30
Anish Sarkar
7f32dd068f refactor: update button rendering logic in connector views to improve loading state handling 2026-04-07 05:40:40 +05:30
Anish Sarkar
e4462292e4 refactor: update Google Drive indexer to return an additional unsupported file count, enhancing error reporting consistency 2026-04-07 05:30:10 +05:30
Rohan Verma
0ad72e21a5
Merge pull request #1112 from SohamBhattacharjee2003/fix/fetch-abort-controller
fix: add AbortController to properly cancel fetch requests on …
2026-04-03 08:11:42 -07:00
SohamBhattacharjee2003
8a8e5fcd76 fix(hooks): add AbortController to properly cancel fetch requests on unmount 2026-04-03 14:29:41 +05:30
Anish Sarkar
746c730b2e chore: ran linting 2026-04-03 13:14:40 +05:30
Anish Sarkar
1ef0d913e7 refactor: remove Local Folder connector components and related configurations from the UI 2026-04-02 22:19:55 +05:30
Anish Sarkar
5eeee99bb1 feat: enhance Local Folder connector with version history and folder sync capabilities 2026-04-02 11:40:04 +05:30
Anish Sarkar
e2f946b7c0 feat: add support for Local Folder connector in UI components and configuration 2026-04-02 11:38:40 +05:30
DESKTOP-RTLN3BA\$punk
17642493eb chore: linting 2026-03-31 14:45:46 -07:00
Rohan Verma
97139bc239
Merge pull request #1061 from JoeMakuta/feat/use-key-to-reset-connectors
refactor: Use key={connector.id} to reset connector config forms and cleanup useEffects
2026-03-31 14:34:34 -07:00
Rohan Verma
d12d68d759
Merge pull request #1041 from AnishSarkar22/feat/dropbox-connector
feat: Dropbox connector with sensitive actions using HITL
2026-03-31 12:12:10 -07:00
JoeMakuta
3ed5a741f7 refactor: Use key={connector.id} to reset connector config forms then useEffect hooks from connector config components 2026-03-31 15:27:28 +02:00
Rohan Verma
d836eea554
Merge pull request #1035 from JoeMakuta/fix/derive-has-changes-and-use-functional-setstate
fix : derive has changes and use functional setstate
2026-03-30 15:22:01 -07:00
Anish Sarkar
781984c224 fix: update date range selector visibility logic for file-based connectors in connector edit view 2026-03-31 00:00:32 +05:30
Anish Sarkar
d8d5102416 feat: introduce incremental sync option for Dropbox indexing, enhancing performance and user control 2026-03-30 23:27:48 +05:30
Anish Sarkar
debe758ff5 fix: update date range selector visibility logic for file-based connectors in indexing configuration 2026-03-30 22:59:27 +05:30
Anish Sarkar
d509148636 feat: implement Dropbox connector configuration and UI components for folder and file selection 2026-03-30 22:27:22 +05:30
Anish Sarkar
04691d572b chore: ran linting 2026-03-30 01:50:41 +05:30
JoeMakuta
4e6251ea04 Replace setOpen(!open) toggles with functional setOpen(prev => !prev) across codebase 2026-03-29 18:47:05 +02:00
Anish Sarkar
c8767272ec feat: enhance OneDrive folder management by adding mimeType handling and integrating DriveFolderTree component for improved UI 2026-03-29 03:29:31 +05:30
Anish Sarkar
101e426792 fix: remove error message display for Google Drive and OneDrive authentication issues; add toast notifications for picker errors 2026-03-28 23:57:57 +05:30
Anish Sarkar
ea218b7be6 feat: implement OneDrive picker integration and enhance connector functionality with new API endpoints and UI updates 2026-03-28 23:57:46 +05:30
Anish Sarkar
40f086b6ed refactor: replace useAuth with authenticatedFetch in OneDriveConfig and add OneDrive SVG icon 2026-03-28 17:33:41 +05:30
Anish Sarkar
147061284b feat: integrate OneDrive connector with UI components and configuration options 2026-03-28 17:00:52 +05:30
Anish Sarkar
856073b61b refactor: update file icon colors in connector configuration components for improved visual consistency 2026-03-21 22:36:49 +05:30
Anish Sarkar
de8841fb86 chore: ran linting 2026-03-21 13:20:13 +05:30
Anish Sarkar
f938c4018e refactor: streamline authentication handling and UI feedback for connectors showing re-authentication button in the config edit area as well 2026-03-20 19:36:55 +05:30
Anish Sarkar
15857ecfd6 refactor: update radio group implementation and improve input styling 2026-03-20 17:09:31 +05:30
Anish Sarkar
df0d9bb2b5 feat: improve Composio Drive folder listing and authentication handling
- Simplified the folder and file listing process in the Composio Drive integration by utilizing the GoogleDriveClient for fetching contents.
- Enhanced error handling for authentication issues, marking connectors as 'auth_expired' when necessary and prompting users to re-authenticate.
- Updated UI components to display authentication status and provide re-authentication options, improving user experience during folder selection.
2026-03-20 14:48:19 +05:30
Anish Sarkar
a27c10a5f5 feat: update Google Drive connector UI and authentication handling 2026-03-20 13:39:28 +05:30
Anish Sarkar
c9deae940c feat: implement re-authentication flows for Google Drive, Gmail, and Calendar connectors
- Added re-authentication endpoints for Google Drive, Gmail, and Calendar connectors to handle expired authentication.
- Enhanced the UI to prompt users for re-authentication when their credentials are expired.
- Updated backend logic to mark connectors as 'auth_expired' and manage re-authentication requests effectively.
- Improved error handling for authentication failures across Google connectors.
2026-03-19 17:51:59 +05:30
Anish Sarkar
c343368456 refactor: remove query params for connector popup and improve connector callback URLs 2026-03-18 16:08:30 +05:30
Anish Sarkar
d40c6bf743 feat: integrate SearXNG web search service with platform capabilities
- Added SearXNG service configuration to Docker setup, including environment variables and health checks.
- Introduced new settings management for web search in the frontend, allowing users to enable/disable and configure search engines and language preferences.
- Updated backend to support web search functionality, including database schema changes and service integration.
- Implemented health check endpoint for the web search service and integrated it into the application.
- Removed legacy SearXNG API connector references in favor of the new platform service approach.
2026-03-14 20:25:25 +05:30
Anish Sarkar
9503d4ade1 chore: ran linting 2026-03-11 12:30:20 +05:30
CREDO23
89ed845dcd merge upstream/dev into improve-ux-connectors
Resolve 3 conflicts:
- connector-popup.tsx: keep Picker modal coordination (pickerOpen state)
- google-drive-config.tsx: keep Google Picker, discard upstream folder tree
- composio-drive-config.tsx: accept upstream collapsible folder tree UX
2026-03-10 23:40:04 +02:00
CREDO23
3bda6c1679 revert Composio Drive to folder tree, harden Picker for native Drive 2026-03-10 23:06:33 +02:00
Rohan Verma
d41d1a1c7f
Merge pull request #866 from AnishSarkar22/fix/docker-dev
fix: enhance docker build CI pipeline, update docker ports & docker docs
2026-03-10 14:00:27 -07:00
Rohan Verma
547077e5b9
Merge pull request #865 from CREDO23/sur-182-fix-ux-experience-for-composio-google-drive-connector
[Perf] Batch embedding, non-blocking search, chunks index & Google Drive UX fix
2026-03-10 12:52:16 -07:00
CREDO23
2c9d01ba2d replace custom folder tree with Google Picker in Drive configs 2026-03-10 20:29:09 +02:00
Anish Sarkar
f53e6b3948 refactor: update Alert component styles and structure for improved consistency across connector forms 2026-03-10 19:33:36 +05:30
Anish Sarkar
6a88f9e0eb chore: ran linting 2026-03-10 16:17:12 +05:30
DESKTOP-RTLN3BA\$punk
8f94350bc1 feat: update web crawler configuration and messaging for improved user guidance and clarity 2026-03-09 16:34:16 -07:00
CREDO23
79daebbd7d fix: improve Google Drive folder selection UX 2026-03-09 14:39:40 +02:00
DESKTOP-RTLN3BA\$punk
e9892c8fe9 feat: added configable summary calculation and various improvements
- Replaced direct embedding calls with a utility function across various components to streamline embedding logic.
- Added enable_summary flag to several models and routes to control summary generation behavior.
2026-02-26 18:24:57 -08:00