Commit graph

306 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
ff4e0f9b62 feat: no login experience and prem tokens
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
DESKTOP-RTLN3BA\$punk
4bee367d4a feat: added ai file sorting 2026-04-14 01:43:30 -07:00
CREDO23
c30cc08771 Merge upstream/dev into feat/kb-export-and-folder-upload 2026-04-11 10:28:40 +02:00
CREDO23
a95bf58c8f Make Vision LLM opt-in for uploads and connectors 2026-04-10 16:45:51 +02:00
Anish Sarkar
ab3cb0e1c5 Merge remote-tracking branch 'upstream/dev' into refactor/persistent-memory 2026-04-09 15:33:23 +05:30
Anish Sarkar
e21582f259 refactor: rename and update memory tool components to reflect new update_memory functionality 2026-04-09 00:02:54 +05:30
Anish Sarkar
5eada7bcab fix: update button variant in FolderWatchDialog and refine metadata type in folder.types 2026-04-08 15:55:37 +05:30
Anish Sarkar
8455451ce1 chore: ran linting 2026-04-08 05:20:03 +05:30
CREDO23
26bffbcc47 Add dynamic vision model list from OpenRouter with combobox selector 2026-04-07 23:39:52 +02:00
CREDO23
3369b8a832 Add frontend vision LLM config types, API, atoms, and role manager wiring 2026-04-07 19:24:43 +02:00
Anish Sarkar
63a75052ca Merge remote-tracking branch 'upstream/dev' into feat/unified-etl-pipeline 2026-04-06 22:04:51 +05:30
Anish Sarkar
be7e73e615 refactor: enhance DocumentsFilters and FolderTreeView components for improved filter handling and search functionality 2026-04-06 14:41:53 +05:30
CREDO23
d7315e7f27 Merge upstream/dev into feat/vision-autocomplete 2026-04-04 09:15:13 +02:00
CREDO23
482238e5d4 add vision LLM role for screenshot analysis 2026-04-03 17:40:27 +02:00
Anish Sarkar
62b44889d1 Merge remote-tracking branch 'upstream/dev' into feat/local-folder-sync 2026-04-03 11:42:43 +05:30
DESKTOP-RTLN3BA\$punk
62e698d8aa refactor: streamline document upload limits and enhance handling of mentioned documents
- Updated maximum file size limit to 500 MB per file.
- Removed restrictions on the number of files per upload and total upload size.
- Enhanced handling of user-mentioning documents in the knowledge base search middleware.
- Improved document reading and processing logic to accommodate new features and optimizations.
2026-04-02 19:39:10 -07:00
Anish Sarkar
bd21c2842d feat: enhance document upload and folder synchronization UI with improved processing state indicators and responsive design adjustments 2026-04-03 04:14:09 +05:30
Anish Sarkar
25358fddcf feat: implement local folder synchronization and versioning with new metadata handling and document_versions table 2026-04-02 23:46:21 +05:30
Anish Sarkar
149ccb97dd refactor: completely remove Local Folder connector references and update folder sync logic 2026-04-02 22:21:16 +05:30
Anish Sarkar
5eeee99bb1 feat: enhance Local Folder connector with version history and folder sync capabilities 2026-04-02 11:40:04 +05:30
Anish Sarkar
e2f946b7c0 feat: add support for Local Folder connector in UI components and configuration 2026-04-02 11:38:40 +05:30
Anish Sarkar
000c2d9b5b style: simplify LLM model terminology in UI 2026-04-02 10:11:35 +05:30
DESKTOP-RTLN3BA\$punk
a9fd45844d feat: integrate Stripe for page purchases and reconciliation tasks 2026-03-31 18:39:45 -07:00
CREDO23
1aeb5ba645 Merge remote-tracking branch 'upstream/dev' into feature/prompt-library 2026-03-31 22:41:53 +02:00
CREDO23
440762fb07 Merge upstream/dev 2026-03-31 20:21:12 +02:00
CREDO23
95620a4331 Unify frontend prompt rendering to use API-only prompt library
Remove hardcoded DEFAULT_ACTIONS and icon map from prompt-picker,
fetch all prompts from the backend. Simplify Zod types to match the
single-table schema (drop source/system_prompt_slug/is_modified,
add version). Update PromptsContent empty state copy.
2026-03-31 18:18:24 +02:00
CREDO23
0c975a6f80 Simplify prompts to seed-based CRUD with version tracking 2026-03-31 18:05:42 +02:00
CREDO23
16884963a4 add is_public to frontend types and API service 2026-03-30 19:38:00 +02:00
Anish Sarkar
6b922966e7 feat: integrate Dropbox support across various components, including document type labels, connector logic, and validation checks 2026-03-30 23:04:07 +05:30
Anish Sarkar
2cd09d49a2 feat: add Dropbox connector support in enums, icons, and API service for enhanced integration 2026-03-30 22:29:29 +05:30
Anish Sarkar
0e3f5d804c refactor: add OneDrive support to connector icons and types for enhanced integration 2026-03-29 23:05:11 +05:30
CREDO23
ab3c636bcd Merge remote-tracking branch 'upstream/dev' into electon-desktop 2026-03-29 10:41:05 +02:00
Anish Sarkar
5a3eece397 Merge remote-tracking branch 'upstream/dev' into feat/onedrive-connector 2026-03-29 11:55:06 +05:30
CREDO23
b8a1d1f594 Merge remote-tracking branch 'upstream/dev' into electon-desktop 2026-03-29 03:10:51 +02:00
DESKTOP-RTLN3BA\$punk
2cc2d339e6 feat: made agent file sytem optimized 2026-03-28 16:39:46 -07:00
CREDO23
a6ccb7a875 rename quick-ask-actions to prompts across backend and frontend 2026-03-29 00:07:08 +02:00
Anish Sarkar
db49f851ba feat: add ONEDRIVE_FILE mapping to connector-document-mapping and document type enum for improved OneDrive integration 2026-03-29 03:35:07 +05:30
Anish Sarkar
c8767272ec feat: enhance OneDrive folder management by adding mimeType handling and integrating DriveFolderTree component for improved UI 2026-03-29 03:29:31 +05:30
CREDO23
11374248d8 restore custom actions API service and wire to ActionPicker 2026-03-28 23:51:33 +02:00
Anish Sarkar
ea218b7be6 feat: implement OneDrive picker integration and enhance connector functionality with new API endpoints and UI updates 2026-03-28 23:57:46 +05:30
Anish Sarkar
147061284b feat: integrate OneDrive connector with UI components and configuration options 2026-03-28 17:00:52 +05:30
Anish Sarkar
17091edb77 Merge remote-tracking branch 'upstream/dev' into refactor/indexing-pipelines 2026-03-27 22:36:34 +05:30
CREDO23
2a8f393cde add quick-ask action type definition 2026-03-27 17:13:37 +02:00
DESKTOP-RTLN3BA\$punk
685ad0c02d feat: add folder management features including creation, deletion, and organization of documents within folders 2026-03-27 01:39:15 -07:00
Anish Sarkar
e5cb6bfacf feat: implement parallel document indexing in IndexingPipelineService
- Added `index_batch_parallel` method to enable concurrent indexing of documents with bounded concurrency, improving performance and efficiency.
- Refactored existing indexing logic to utilize `asyncio.to_thread` for non-blocking execution of embedding and chunking functions.
- Introduced unit tests to validate the functionality of the new parallel indexing method, ensuring robustness and error handling during document processing.
2026-03-26 19:33:49 +05:30
Anish Sarkar
778cfac6fa Merge remote-tracking branch 'upstream/dev' into impr/thinking-steps 2026-03-25 01:50:10 +05:30
CREDO23
5d8a62a4a6 merge upstream/dev into feat/migrate-electric-to-zero
Resolve 8 conflicts:
- Accept upstream deletion of 3 composio_*_connector.py (unified Google connectors)
- Accept our deletion of ElectricProvider.tsx, use-connectors-electric.ts,
  use-messages-electric.ts (replaced by Zero equivalents)
- Keep both new deps in package.json (@rocicorp/zero + @slate-serializers/html)
- Regenerate pnpm-lock.yaml
2026-03-24 17:40:34 +02:00
Anish Sarkar
a009cae62a refactor: remove link_preview tool and associated components to streamline agent functionality 2026-03-24 17:15:29 +05:30
Anish Sarkar
6c507989d2 refactor: remove display_image tool and update related components to streamline image handling 2026-03-24 16:28:11 +05:30