CREDO23
c30cc08771
Merge upstream/dev into feat/kb-export-and-folder-upload
2026-04-11 10:28:40 +02:00
CREDO23
a95bf58c8f
Make Vision LLM opt-in for uploads and connectors
2026-04-10 16:45:51 +02:00
Anish Sarkar
a0883d2ab6
feat: implement team memory extraction and validation mechanisms, enhancing memory management by enforcing scope restrictions and improving memory persistence for shared threads
2026-04-10 01:54:00 +05:30
CREDO23
0aefcbd504
Remove vision LLM from desktop folder watcher
2026-04-09 22:06:06 +02:00
Anish Sarkar
33626d4f91
chore: ran linting
2026-04-10 00:31:43 +05:30
Anish Sarkar
84fc72e596
feat: implement background memory extraction and editing capabilities for user and team memory management, enhancing long-term memory persistence and user interaction
2026-04-10 00:21:55 +05:30
Anish Sarkar
cd72fa9a48
refactor: remove memory extraction functionality and update memory management protocols to ensure immediate updates for user and team interactions
2026-04-09 23:30:17 +05:30
CREDO23
ff2a9c77f9
Pass vision_llm in legacy process_file_in_background path
2026-04-09 15:28:21 +02:00
CREDO23
afd3c2cde2
Pass vision LLM through local folder indexer call chain
2026-04-09 14:50:24 +02:00
Anish Sarkar
f38ea77940
chore: ran linting
2026-04-09 18:10:34 +05:30
CREDO23
7e90a8ed3c
Route uploaded images to vision LLM with document-parser fallback
2026-04-09 14:33:33 +02:00
Anish Sarkar
7caf3b25e2
feat: implement background memory extraction for user and team interactions, enhancing long-term memory management in the SurfSense agent
2026-04-09 17:43:52 +05:30
Anish Sarkar
56c5809170
chore: ran linting
2026-04-08 18:23:03 +05:30
Anish Sarkar
37c52ce7ea
feat: implement indexing progress management in local folder indexing process and enhance related test coverage
2026-04-08 18:01:55 +05:30
Anish Sarkar
a8b83dcf3f
feat: add folder_id support in ConnectorDocument and indexing pipeline for improved document organization
2026-04-08 17:48:50 +05:30
Anish Sarkar
f3aa514240
feat: integrate subtree ID retrieval in local folder cleanup process and enhance UI component styling for folder selection
2026-04-08 17:25:18 +05:30
Anish Sarkar
cab0d1bdfe
feat: enhance folder synchronization by integrating subtree ID retrieval and optimizing empty folder cleanup process
2026-04-08 17:10:22 +05:30
Anish Sarkar
ae98f64760
feat: enhance folder indexing with metadata management and improve folder structure handling in UI components
2026-04-08 16:48:40 +05:30
Anish Sarkar
60eb1e4060
feat: implement raw file hash computation to optimize content extraction during local folder indexing
2026-04-08 16:28:51 +05:30
Anish Sarkar
5f5954e932
feat: implement upload-based folder indexing and synchronization features
2026-04-08 15:46:52 +05:30
Anish Sarkar
8d810467dd
refactor: add support for XHTML file conversion to markdown in document processors
2026-04-07 05:57:13 +05:30
Anish Sarkar
0a26a6c5bb
chore: ran linting
2026-04-07 05:55:39 +05:30
Anish Sarkar
1b87719a92
refactor: enhance file skipping logic in Google Drive connector to check for Google Workspace files before unsupported extensions
2026-04-07 05:36:29 +05:30
Anish Sarkar
e4462292e4
refactor: update Google Drive indexer to return an additional unsupported file count, enhancing error reporting consistency
2026-04-07 05:30:10 +05:30
Anish Sarkar
122be76133
refactor: update _index_selected_files method signatures in Dropbox, Google Drive, and OneDrive indexers to include unsupported file count, enhancing error reporting and consistency across connectors
2026-04-07 03:16:46 +05:30
Anish Sarkar
3a1d700817
refactor: enhance file skipping logic across Dropbox, Google Drive, and OneDrive connectors to return unsupported extensions, improving error reporting and maintainability
2026-04-07 03:16:34 +05:30
Anish Sarkar
f03bf05aaa
refactor: enhance Google Drive indexer to support file extension filtering, improving file handling and error reporting
2026-04-06 22:34:49 +05:30
Anish Sarkar
0fb92b7c56
refactor: streamline file skipping logic in Dropbox indexer by removing redundant checks, improving code clarity
2026-04-06 22:17:50 +05:30
Anish Sarkar
63a75052ca
Merge remote-tracking branch 'upstream/dev' into feat/unified-etl-pipeline
2026-04-06 22:04:51 +05:30
Anish Sarkar
dc7047f64d
refactor: implement file type classification for supported extensions across Dropbox, Google Drive, and OneDrive connectors, enhancing file handling and error management
2026-04-06 22:03:47 +05:30
Anish Sarkar
b5a15b7681
feat: implement cursor-based delta sync for Dropbox integration, enhancing file indexing efficiency and preserving folder cursors during re-authentication
2026-04-06 18:36:29 +05:30
Anish Sarkar
87af012a60
refactor: streamline file processing by integrating ETL pipeline for all file types and removing redundant functions
2026-04-05 17:45:18 +05:30
Anish Sarkar
1248363ca9
refactor: consolidate document processing logic and remove unused files and ETL strategies
2026-04-05 17:29:24 +05:30
Anish Sarkar
a2b3541046
chore: ran linting
2026-04-04 03:11:56 +05:30
Anish Sarkar
0d2acc665d
Merge remote-tracking branch 'upstream/dev' into feat/page-limit-connectors
2026-04-04 03:08:27 +05:30
Anish Sarkar
ce40da80ea
feat: implement page limit estimation and enforcement in file based connector indexers
...
- Added a static method `estimate_pages_from_metadata` to `PageLimitService` for estimating page counts based on file metadata.
- Integrated page limit checks in Google Drive, Dropbox, and OneDrive indexers to prevent exceeding user quotas during file indexing.
- Updated relevant indexing methods to utilize the new page estimation logic and enforce limits accordingly.
- Enhanced tests for page limit functionality, ensuring accurate estimation and enforcement across different file types.
2026-04-04 02:51:28 +05:30
Anish Sarkar
9c0af6569d
feat: implement page limit checks in local folder indexing to manage user page usage
2026-04-03 19:13:25 +05:30
Anish Sarkar
b759bb36a9
feat: add direct conversion support for CSV, TSV, and HTML files in local folder indexing
2026-04-03 17:36:48 +05:30
Anish Sarkar
746c730b2e
chore: ran linting
2026-04-03 13:14:40 +05:30
Anish Sarkar
62b44889d1
Merge remote-tracking branch 'upstream/dev' into feat/local-folder-sync
2026-04-03 11:42:43 +05:30
Anish Sarkar
4ca0787ab7
feat: add version history functionality to document management, enabling users to view and manage document versions through UI updates and backend integration
2026-04-03 10:42:21 +05:30
Anish Sarkar
1fa8e1cc83
feat: refactor folder indexing to support batch processing of multiple files, enhancing performance and error handling
2026-04-03 10:02:36 +05:30
Anish Sarkar
e2ba509314
feat: enhance error handling in local folder indexing by adding rollback and refresh on IntegrityError
2026-04-03 09:29:59 +05:30
DESKTOP-RTLN3BA\$punk
62e698d8aa
refactor: streamline document upload limits and enhance handling of mentioned documents
...
- Updated maximum file size limit to 500 MB per file.
- Removed restrictions on the number of files per upload and total upload size.
- Enhanced handling of user-mentioning documents in the knowledge base search middleware.
- Improved document reading and processing logic to accommodate new features and optimizations.
2026-04-02 19:39:10 -07:00
Anish Sarkar
fe7fcaae5d
feat: update folder deletion process to queue document deletions first and handle folder cleanup in Celery task
2026-04-03 04:16:19 +05:30
Anish Sarkar
44e39792da
feat: assign folder_id to documents before indexing to ensure correct folder visibility during processing
2026-04-03 04:14:28 +05:30
Anish Sarkar
53df393cf7
refactor: streamline local folder indexing logic by removing unused imports, enhancing content hashing, and improving document creation process
2026-04-02 23:28:23 +05:30
Anish Sarkar
c27d24a117
feat: enhance folder indexing by adding root folder ID support and implement folder creation and cleanup logic
2026-04-02 22:41:45 +05:30
Anish Sarkar
caf2525ab5
fix: update folder ID collection logic to include deleted directories and adjust test cases for document titles
2026-04-02 22:29:07 +05:30
Anish Sarkar
22ee5c99cc
refactor: remove Local Folder connector and related tasks, implement new folder indexing endpoints
2026-04-02 22:21:31 +05:30
