Commit graph

62 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
80d3f624d4 chore: linting 2026-04-22 01:05:31 -07:00
DESKTOP-RTLN3BA\$punk
2f793e7a69 refactor: improve content extraction and encoding handling
- Enhanced Azure Document Intelligence parser to raise an error for empty or whitespace-only content.
- Updated LLMRouterService to log premium model strings more clearly.
- Added automatic encoding detection for file reading in document processors.
- Improved error handling for empty markdown content extraction in file processors.
- Refactored DocumentUploadTab component for better accessibility and user interaction.
2026-04-16 00:25:46 -07:00
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
CREDO23
a95bf58c8f Make Vision LLM opt-in for uploads and connectors 2026-04-10 16:45:51 +02:00
CREDO23
7e14df6012 Fix button-in-button hydration error in mobile upload drop zone 2026-04-09 16:40:55 +02:00
CREDO23
7851db7928 fix: add i18n keys for folder upload strings 2026-04-09 13:42:57 +02:00
CREDO23
57ae2bd5af feat: preserve folder structure on web folder upload 2026-04-09 11:18:56 +02:00
DESKTOP-RTLN3BA\$punk
c6e1a04169 chore: linting 2026-04-08 16:14:26 -07:00
DESKTOP-RTLN3BA\$punk
0af6b3882a refactor: replace button with div for improved accessibility in DocumentUploadTab
- Changed the button element to a div with role="button" to enhance keyboard accessibility.
- Updated event handling for click and keydown events to ensure consistent behavior across devices.
- Maintained existing styling and functionality while improving semantic structure.
2026-04-07 17:23:46 -07:00
Anish Sarkar
8455451ce1 chore: ran linting 2026-04-08 05:20:03 +05:30
Anish Sarkar
6038f6dfc0 Merge remote-tracking branch 'upstream/dev' into feat/azure-ocr 2026-04-08 05:00:32 +05:30
Anish Sarkar
078f735e3a feat: improve folder watching functionality with UI dialog for selecting and managing watched folders 2026-04-08 04:11:49 +05:30
Anish Sarkar
20fa93f0ba refactor: make Azure Document Intelligence an internal LLAMACLOUD accelerator instead of a standalone ETL service 2026-04-08 03:26:24 +05:30
Anish Sarkar
1fa8d1220b feat: add support for Azure Document Intelligence in ETL pipeline 2026-04-08 00:59:12 +05:30
DESKTOP-RTLN3BA\$punk
91ea293fa2 chore: linting 2026-04-07 03:10:06 -07:00
DESKTOP-RTLN3BA\$punk
82b5c7f19e Merge commit '056fc0e7ff' into dev_mod 2026-04-07 02:56:46 -07:00
DESKTOP-RTLN3BA\$punk
49441233e7 feat: enhance keyboard shortcut management and improve app responsiveness
- Updated the development script to include a build step before launching the app.
- Refactored the registration of quick ask and autocomplete functionalities to be asynchronous, ensuring proper initialization.
- Introduced IPC channels for getting and setting keyboard shortcuts, allowing users to customize their experience.
- Enhanced the platform module to support better interaction with the Electron API for clipboard operations.
- Improved the user interface for managing keyboard shortcuts in the settings dialog, providing a more intuitive experience.
2026-04-07 00:43:40 -07:00
Anish Sarkar
0a26a6c5bb chore: ran linting 2026-04-07 05:55:39 +05:30
Anish Sarkar
e7beeb2a36 refactor: unify file skipping logic across Dropbox, Google Drive, and OneDrive connectors by replacing classification checks with a centralized service-based approach, enhancing maintainability and consistency in file handling 2026-04-07 02:19:31 +05:30
Rohan Verma
3dba11d532
Merge pull request #1110 from mvanhorn/fix/upload-progress-interval-cleanup
fix: clear upload progress interval on unmount
2026-04-03 08:08:38 -07:00
Anish Sarkar
5068a6b4f3 style: update button variant and improve drag-and-drop UI in DocumentUploadTab 2026-04-03 17:52:59 +05:30
Anish Sarkar
b7f916c4df chore: ran linting 2026-04-03 17:24:34 +05:30
Anish Sarkar
1c50106c81 refactor: simplify file upload logic in DocumentUploadTab by removing file count and size limits; update file size limit messages in multiple languages 2026-04-03 17:24:06 +05:30
Anish Sarkar
c964b47f99 style: enhance folder selection UI in DocumentUploadTab 2026-04-03 13:59:33 +05:30
Anish Sarkar
746c730b2e chore: ran linting 2026-04-03 13:14:40 +05:30
Matt Van Horn
134beec392 fix: clear upload progress interval on unmount
Store the progress setInterval ID in a ref and clear it in a
useEffect cleanup. Previously the interval was stored in a local
variable and only cleared in onSuccess/onError callbacks, leaking
if the component unmounted mid-upload.

Fixes #1090
2026-04-03 00:05:06 -07:00
Anish Sarkar
388811194e feat: update DocumentUploadTab to use a dropdown for file and folder selection, enhancing user experience; also update upload limits and file size messages in multiple languages 2026-04-03 12:33:47 +05:30
Anish Sarkar
62b44889d1 Merge remote-tracking branch 'upstream/dev' into feat/local-folder-sync 2026-04-03 11:42:43 +05:30
Anish Sarkar
9a65163fe4 feat: improve DocumentUploadTab UI with updated styles, enhanced file size limit messages 2026-04-03 09:20:44 +05:30
DESKTOP-RTLN3BA\$punk
eb17850274 chore: linting 2026-04-02 19:45:28 -07:00
DESKTOP-RTLN3BA\$punk
62e698d8aa refactor: streamline document upload limits and enhance handling of mentioned documents
- Updated maximum file size limit to 500 MB per file.
- Removed restrictions on the number of files per upload and total upload size.
- Enhanced handling of user-mentioning documents in the knowledge base search middleware.
- Improved document reading and processing logic to accommodate new features and optimizations.
2026-04-02 19:39:10 -07:00
Anish Sarkar
bd21c2842d feat: enhance document upload and folder synchronization UI with improved processing state indicators and responsive design adjustments 2026-04-03 04:14:09 +05:30
Anish Sarkar
530db10539 refactor: remove unused Electron API check and update search space ID handling in document upload 2026-04-03 02:56:24 +05:30
Anish Sarkar
b46c5532b3 feat: add unified file and folder browsing functionality with IPC channel integration 2026-04-03 00:28:24 +05:30
Anish Sarkar
f53e6b3948 refactor: update Alert component styles and structure for improved consistency across connector forms 2026-03-10 19:33:36 +05:30
Anish Sarkar
0a1d0035e6 refactor: update DocumentUploadTab to ensure unique file IDs are generated using a fallback method for compatibility 2026-03-08 21:11:54 +05:30
Anish Sarkar
a65fda359a chore: ran linting 2026-03-08 20:57:29 +05:30
Anish Sarkar
0b028bab49 refactor: update DocumentUploadTab to manage files with unique IDs using UUIDs 2026-03-08 19:48:38 +05:30
Anish Sarkar
77dc6b7c91 feat: implement user settings page with profile and API key management components 2026-03-08 19:36:12 +05:30
Anish Sarkar
c02207e911 refactor: simplify DocumentUploadTab component by removing motion animations and enhancing file display logic for improved performance and readability 2026-03-07 12:31:55 +05:30
DESKTOP-RTLN3BA\$punk
d959a6a6c8 feat: optimize document upload process and enhance memory management
- Increased maximum file upload limit from 10 to 50 to improve user experience.
- Implemented batch processing for document uploads to avoid proxy timeouts, splitting files into manageable chunks.
- Enhanced garbage collection in chat streaming functions to prevent memory leaks and improve performance.
- Added memory delta tracking in system snapshots for better monitoring of resource usage.
- Updated LLM router and service configurations to prevent unbounded internal accumulation and improve efficiency.
2026-02-28 17:22:34 -08:00
DESKTOP-RTLN3BA\$punk
e9892c8fe9 feat: added configable summary calculation and various improvements
- Replaced direct embedding calls with a utility function across various components to streamline embedding logic.
- Added enable_summary flag to several models and routes to control summary generation behavior.
2026-02-26 18:24:57 -08:00
Anish Sarkar
f0d170a595 feat: improve chat renaming functionality with dialog support in sidebar components 2026-02-21 23:59:04 +05:30
DESKTOP-RTLN3BA\$punk
39d65d6166 feat: added incentive credits system 2026-01-26 23:32:30 -08:00
Anish Sarkar
2d17d1a1b6 feat: replace Loader2 with Spinner component for consistent loading indicators 2026-01-25 15:23:45 +05:30
DESKTOP-RTLN3BA\$punk
8aad15d392 Reapply "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 3418c0e026.
2026-01-16 11:32:06 -08:00
DESKTOP-RTLN3BA\$punk
3418c0e026 Revert "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 5963a1125e, reversing
changes made to 0d2a2f8ea1.
2026-01-16 00:49:33 -08:00
Anish Sarkar
ab63b23f0a Merge remote-tracking branch 'upstream/dev' into feat/replace-logs 2026-01-15 15:52:47 +05:30
DESKTOP-RTLN3BA\$punk
7ae68455b3 chore: linting 2026-01-15 00:05:53 -08:00
DESKTOP-RTLN3BA\$punk
3375aeb9bc feat: add upload limits and validation to DocumentUploadTab component 2026-01-15 00:01:00 -08:00