Commit graph

532 commits

Author SHA1 Message Date
Anish Sarkar
99623a85d5 refactor: remove legacy Obsidian connector support 2026-04-22 00:10:24 +05:30
Rohan Verma
2b2453e015
Merge pull request #1240 from AnishSarkar22/feat/resume-builder
Some checks failed
Build and Push Docker Images / tag_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
feat: resume builder
2026-04-17 13:41:32 -07:00
DESKTOP-RTLN3BA\$punk
2f793e7a69 refactor: improve content extraction and encoding handling
- Enhanced Azure Document Intelligence parser to raise an error for empty or whitespace-only content.
- Updated LLMRouterService to log premium model strings more clearly.
- Added automatic encoding detection for file reading in document processors.
- Improved error handling for empty markdown content extraction in file processors.
- Refactored DocumentUploadTab component for better accessibility and user interaction.
2026-04-16 00:25:46 -07:00
DESKTOP-RTLN3BA\$punk
4a51ccdc2c cloud: added openrouter integration with global configs 2026-04-15 23:46:29 -07:00
DESKTOP-RTLN3BA\$punk
ff4e0f9b62 feat: no login experience and prem tokens
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
Anish Sarkar
ccf010175d feat: enhance report content schema and add resume generation output handling 2026-04-15 21:11:58 +05:30
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
Anish Sarkar
9fc0976d5e chore: ran linting 2026-04-14 21:52:26 +05:30
Anish Sarkar
f01ddf3f0a feat: implement token usage recording in chat routes and enhance title generation handling 2026-04-14 20:56:07 +05:30
Anish Sarkar
8fd7664f8f Merge remote-tracking branch 'upstream/dev' into feat/token-calculation 2026-04-14 15:49:39 +05:30
Anish Sarkar
f21bdc0668 feat: enhance LLM response handling and token usage tracking in chat services and UI components 2026-04-14 15:29:02 +05:30
Anish Sarkar
5af6005163 feat: improve token usage tracking and response handling in chat routes and services 2026-04-14 14:28:31 +05:30
DESKTOP-RTLN3BA\$punk
4bee367d4a feat: added ai file sorting 2026-04-14 01:43:30 -07:00
Anish Sarkar
3cfe53fb7f feat: implement token usage tracking for LLM calls with new accumulator and callback 2026-04-14 13:40:32 +05:30
DESKTOP-RTLN3BA\$punk
b5301fa438 feat: enhance sandbox functionality with threading support and file download capabilities 2026-04-13 16:41:46 -07:00
CREDO23
c30cc08771 Merge upstream/dev into feat/kb-export-and-folder-upload 2026-04-11 10:28:40 +02:00
CREDO23
a95bf58c8f Make Vision LLM opt-in for uploads and connectors 2026-04-10 16:45:51 +02:00
Anish Sarkar
a0883d2ab6 feat: implement team memory extraction and validation mechanisms, enhancing memory management by enforcing scope restrictions and improving memory persistence for shared threads 2026-04-10 01:54:00 +05:30
CREDO23
0aefcbd504 Remove vision LLM from desktop folder watcher 2026-04-09 22:06:06 +02:00
Anish Sarkar
33626d4f91 chore: ran linting 2026-04-10 00:31:43 +05:30
Anish Sarkar
84fc72e596 feat: implement background memory extraction and editing capabilities for user and team memory management, enhancing long-term memory persistence and user interaction 2026-04-10 00:21:55 +05:30
Anish Sarkar
cd72fa9a48 refactor: remove memory extraction functionality and update memory management protocols to ensure immediate updates for user and team interactions 2026-04-09 23:30:17 +05:30
CREDO23
ff2a9c77f9 Pass vision_llm in legacy process_file_in_background path 2026-04-09 15:28:21 +02:00
CREDO23
afd3c2cde2 Pass vision LLM through local folder indexer call chain 2026-04-09 14:50:24 +02:00
Anish Sarkar
f38ea77940 chore: ran linting 2026-04-09 18:10:34 +05:30
CREDO23
7e90a8ed3c Route uploaded images to vision LLM with document-parser fallback 2026-04-09 14:33:33 +02:00
Anish Sarkar
7caf3b25e2 feat: implement background memory extraction for user and team interactions, enhancing long-term memory management in the SurfSense agent 2026-04-09 17:43:52 +05:30
Anish Sarkar
56c5809170 chore: ran linting 2026-04-08 18:23:03 +05:30
Anish Sarkar
37c52ce7ea feat: implement indexing progress management in local folder indexing process and enhance related test coverage 2026-04-08 18:01:55 +05:30
Anish Sarkar
a8b83dcf3f feat: add folder_id support in ConnectorDocument and indexing pipeline for improved document organization 2026-04-08 17:48:50 +05:30
Anish Sarkar
f3aa514240 feat: integrate subtree ID retrieval in local folder cleanup process and enhance UI component styling for folder selection 2026-04-08 17:25:18 +05:30
Anish Sarkar
cab0d1bdfe feat: enhance folder synchronization by integrating subtree ID retrieval and optimizing empty folder cleanup process 2026-04-08 17:10:22 +05:30
Anish Sarkar
ae98f64760 feat: enhance folder indexing with metadata management and improve folder structure handling in UI components 2026-04-08 16:48:40 +05:30
Anish Sarkar
60eb1e4060 feat: implement raw file hash computation to optimize content extraction during local folder indexing 2026-04-08 16:28:51 +05:30
Anish Sarkar
5f5954e932 feat: implement upload-based folder indexing and synchronization features 2026-04-08 15:46:52 +05:30
Anish Sarkar
8d810467dd refactor: add support for XHTML file conversion to markdown in document processors 2026-04-07 05:57:13 +05:30
Anish Sarkar
0a26a6c5bb chore: ran linting 2026-04-07 05:55:39 +05:30
Anish Sarkar
1b87719a92 refactor: enhance file skipping logic in Google Drive connector to check for Google Workspace files before unsupported extensions 2026-04-07 05:36:29 +05:30
Anish Sarkar
e4462292e4 refactor: update Google Drive indexer to return an additional unsupported file count, enhancing error reporting consistency 2026-04-07 05:30:10 +05:30
Anish Sarkar
122be76133 refactor: update _index_selected_files method signatures in Dropbox, Google Drive, and OneDrive indexers to include unsupported file count, enhancing error reporting and consistency across connectors 2026-04-07 03:16:46 +05:30
Anish Sarkar
3a1d700817 refactor: enhance file skipping logic across Dropbox, Google Drive, and OneDrive connectors to return unsupported extensions, improving error reporting and maintainability 2026-04-07 03:16:34 +05:30
Anish Sarkar
f03bf05aaa refactor: enhance Google Drive indexer to support file extension filtering, improving file handling and error reporting 2026-04-06 22:34:49 +05:30
Anish Sarkar
0fb92b7c56 refactor: streamline file skipping logic in Dropbox indexer by removing redundant checks, improving code clarity 2026-04-06 22:17:50 +05:30
Anish Sarkar
63a75052ca Merge remote-tracking branch 'upstream/dev' into feat/unified-etl-pipeline 2026-04-06 22:04:51 +05:30
Anish Sarkar
dc7047f64d refactor: implement file type classification for supported extensions across Dropbox, Google Drive, and OneDrive connectors, enhancing file handling and error management 2026-04-06 22:03:47 +05:30
Anish Sarkar
b5a15b7681 feat: implement cursor-based delta sync for Dropbox integration, enhancing file indexing efficiency and preserving folder cursors during re-authentication 2026-04-06 18:36:29 +05:30
Anish Sarkar
87af012a60 refactor: streamline file processing by integrating ETL pipeline for all file types and removing redundant functions 2026-04-05 17:45:18 +05:30
Anish Sarkar
1248363ca9 refactor: consolidate document processing logic and remove unused files and ETL strategies 2026-04-05 17:29:24 +05:30
Anish Sarkar
a2b3541046 chore: ran linting 2026-04-04 03:11:56 +05:30
Anish Sarkar
0d2acc665d Merge remote-tracking branch 'upstream/dev' into feat/page-limit-connectors 2026-04-04 03:08:27 +05:30