Anish Sarkar
9b1b9a90c0
Merge remote-tracking branch 'upstream/dev' into feat/obsidian-plugin
2026-04-24 21:34:55 +05:30
Rohan Verma
a0f2851784
Merge pull request #1299 from AnishSarkar22/feat/swappable-filesystem
...
Build and Push Docker Images / tag_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
feat: introduce swappable filesystem on desktop & monaco editor to edit local files
2026-04-23 19:38:33 -07:00
Anish Sarkar
30b55a9baa
feat(filesystem): refactor local filesystem handling to use mounts instead of root paths, enhancing mount management and path normalization
2026-04-24 05:59:21 +05:30
Anish Sarkar
1eadecee23
feat(new-chat): integrate filesystem flow into agent pipeline
2026-04-23 15:45:33 +05:30
CREDO23
b6c506abef
fix: treat all Gmail/Calendar as live connectors, hide indexing UI
2026-04-22 22:51:28 +02:00
CREDO23
9977f9b641
remove dead indexing tasks and fix silent schedule breakage for live connectors
2026-04-22 21:43:51 +02:00
Anish Sarkar
6ac5256431
feat: implement background processing for binary attachments in Obsidian plugin
...
- Added a new Celery task for indexing non-markdown attachments.
- Enhanced the Obsidian plugin schema to support binary attachments.
- Updated routes to enqueue binary attachments for background processing.
- Improved metadata handling for binary attachments during indexing.
- Added tests for binary attachment processing and validation.
2026-04-22 23:00:34 +05:30
CREDO23
5ff0ec5d5d
disable periodic indexing for live connectors
2026-04-21 21:51:40 +02:00
Anish Sarkar
99623a85d5
refactor: remove legacy Obsidian connector support
2026-04-22 00:10:24 +05:30
CREDO23
e02fbbef6c
remove MCP-mode skip from Notion indexer
2026-04-21 20:33:57 +02:00
CREDO23
5a8ec704fe
feat(notion-mcp): add MCP gating in agent, indexer, and health check
2026-04-20 21:02:21 +02:00
Rohan Verma
2b2453e015
Merge pull request #1240 from AnishSarkar22/feat/resume-builder
...
Build and Push Docker Images / tag_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
feat: resume builder
2026-04-17 13:41:32 -07:00
DESKTOP-RTLN3BA\$punk
2f793e7a69
refactor: improve content extraction and encoding handling
...
- Enhanced Azure Document Intelligence parser to raise an error for empty or whitespace-only content.
- Updated LLMRouterService to log premium model strings more clearly.
- Added automatic encoding detection for file reading in document processors.
- Improved error handling for empty markdown content extraction in file processors.
- Refactored DocumentUploadTab component for better accessibility and user interaction.
2026-04-16 00:25:46 -07:00
DESKTOP-RTLN3BA\$punk
4a51ccdc2c
cloud: added openrouter integration with global configs
2026-04-15 23:46:29 -07:00
DESKTOP-RTLN3BA\$punk
ff4e0f9b62
feat: no login experience and prem tokens
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
Anish Sarkar
ccf010175d
feat: enhance report content schema and add resume generation output handling
2026-04-15 21:11:58 +05:30
DESKTOP-RTLN3BA\$punk
656e061f84
feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
...
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
Anish Sarkar
9fc0976d5e
chore: ran linting
2026-04-14 21:52:26 +05:30
Anish Sarkar
f01ddf3f0a
feat: implement token usage recording in chat routes and enhance title generation handling
2026-04-14 20:56:07 +05:30
Anish Sarkar
8fd7664f8f
Merge remote-tracking branch 'upstream/dev' into feat/token-calculation
2026-04-14 15:49:39 +05:30
Anish Sarkar
f21bdc0668
feat: enhance LLM response handling and token usage tracking in chat services and UI components
2026-04-14 15:29:02 +05:30
Anish Sarkar
5af6005163
feat: improve token usage tracking and response handling in chat routes and services
2026-04-14 14:28:31 +05:30
DESKTOP-RTLN3BA\$punk
4bee367d4a
feat: added ai file sorting
2026-04-14 01:43:30 -07:00
Anish Sarkar
3cfe53fb7f
feat: implement token usage tracking for LLM calls with new accumulator and callback
2026-04-14 13:40:32 +05:30
DESKTOP-RTLN3BA\$punk
b5301fa438
feat: enhance sandbox functionality with threading support and file download capabilities
2026-04-13 16:41:46 -07:00
CREDO23
c30cc08771
Merge upstream/dev into feat/kb-export-and-folder-upload
2026-04-11 10:28:40 +02:00
CREDO23
a95bf58c8f
Make Vision LLM opt-in for uploads and connectors
2026-04-10 16:45:51 +02:00
Anish Sarkar
a0883d2ab6
feat: implement team memory extraction and validation mechanisms, enhancing memory management by enforcing scope restrictions and improving memory persistence for shared threads
2026-04-10 01:54:00 +05:30
CREDO23
0aefcbd504
Remove vision LLM from desktop folder watcher
2026-04-09 22:06:06 +02:00
Anish Sarkar
33626d4f91
chore: ran linting
2026-04-10 00:31:43 +05:30
Anish Sarkar
84fc72e596
feat: implement background memory extraction and editing capabilities for user and team memory management, enhancing long-term memory persistence and user interaction
2026-04-10 00:21:55 +05:30
Anish Sarkar
cd72fa9a48
refactor: remove memory extraction functionality and update memory management protocols to ensure immediate updates for user and team interactions
2026-04-09 23:30:17 +05:30
CREDO23
ff2a9c77f9
Pass vision_llm in legacy process_file_in_background path
2026-04-09 15:28:21 +02:00
CREDO23
afd3c2cde2
Pass vision LLM through local folder indexer call chain
2026-04-09 14:50:24 +02:00
Anish Sarkar
f38ea77940
chore: ran linting
2026-04-09 18:10:34 +05:30
CREDO23
7e90a8ed3c
Route uploaded images to vision LLM with document-parser fallback
2026-04-09 14:33:33 +02:00
Anish Sarkar
7caf3b25e2
feat: implement background memory extraction for user and team interactions, enhancing long-term memory management in the SurfSense agent
2026-04-09 17:43:52 +05:30
Anish Sarkar
56c5809170
chore: ran linting
2026-04-08 18:23:03 +05:30
Anish Sarkar
37c52ce7ea
feat: implement indexing progress management in local folder indexing process and enhance related test coverage
2026-04-08 18:01:55 +05:30
Anish Sarkar
a8b83dcf3f
feat: add folder_id support in ConnectorDocument and indexing pipeline for improved document organization
2026-04-08 17:48:50 +05:30
Anish Sarkar
f3aa514240
feat: integrate subtree ID retrieval in local folder cleanup process and enhance UI component styling for folder selection
2026-04-08 17:25:18 +05:30
Anish Sarkar
cab0d1bdfe
feat: enhance folder synchronization by integrating subtree ID retrieval and optimizing empty folder cleanup process
2026-04-08 17:10:22 +05:30
Anish Sarkar
ae98f64760
feat: enhance folder indexing with metadata management and improve folder structure handling in UI components
2026-04-08 16:48:40 +05:30
Anish Sarkar
60eb1e4060
feat: implement raw file hash computation to optimize content extraction during local folder indexing
2026-04-08 16:28:51 +05:30
Anish Sarkar
5f5954e932
feat: implement upload-based folder indexing and synchronization features
2026-04-08 15:46:52 +05:30
Anish Sarkar
8d810467dd
refactor: add support for XHTML file conversion to markdown in document processors
2026-04-07 05:57:13 +05:30
Anish Sarkar
0a26a6c5bb
chore: ran linting
2026-04-07 05:55:39 +05:30
Anish Sarkar
1b87719a92
refactor: enhance file skipping logic in Google Drive connector to check for Google Workspace files before unsupported extensions
2026-04-07 05:36:29 +05:30
Anish Sarkar
e4462292e4
refactor: update Google Drive indexer to return an additional unsupported file count, enhancing error reporting consistency
2026-04-07 05:30:10 +05:30
Anish Sarkar
122be76133
refactor: update _index_selected_files method signatures in Dropbox, Google Drive, and OneDrive indexers to include unsupported file count, enhancing error reporting and consistency across connectors
2026-04-07 03:16:46 +05:30