Commit graph

563 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
ff4e0f9b62 feat: no login experience and prem tokens
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
Anish Sarkar
9fc0976d5e chore: ran linting 2026-04-14 21:52:26 +05:30
Anish Sarkar
f01ddf3f0a feat: implement token usage recording in chat routes and enhance title generation handling 2026-04-14 20:56:07 +05:30
Anish Sarkar
8fd7664f8f Merge remote-tracking branch 'upstream/dev' into feat/token-calculation 2026-04-14 15:49:39 +05:30
Anish Sarkar
5af6005163 feat: improve token usage tracking and response handling in chat routes and services 2026-04-14 14:28:31 +05:30
DESKTOP-RTLN3BA\$punk
4bee367d4a feat: added ai file sorting 2026-04-14 01:43:30 -07:00
Anish Sarkar
3cfe53fb7f feat: implement token usage tracking for LLM calls with new accumulator and callback 2026-04-14 13:40:32 +05:30
DESKTOP-RTLN3BA\$punk
5d3142332b Merge commit 'e1e4bb4706' into dev_mod 2026-04-13 20:35:04 -07:00
DESKTOP-RTLN3BA\$punk
b5301fa438 feat: enhance sandbox functionality with threading support and file download capabilities 2026-04-13 16:41:46 -07:00
Anish Sarkar
3f68962772 feat: implement cache invalidation for MCP connectors upon deletion in search source connectors 2026-04-14 04:09:30 +05:30
Anish Sarkar
ec27807644 refactor: improve document processing error handling and UI state management 2026-04-13 22:22:50 +05:30
Anish Sarkar
b3a8364fbd feat: add MCP Tool Trust routes for managing trusted tools 2026-04-13 20:18:12 +05:30
CREDO23
c30cc08771 Merge upstream/dev into feat/kb-export-and-folder-upload 2026-04-11 10:28:40 +02:00
CREDO23
a95bf58c8f Make Vision LLM opt-in for uploads and connectors 2026-04-10 16:45:51 +02:00
Anish Sarkar
0925f89b7c fix: guard display_name.split() against whitespace-only IndexError (recurseml feedback) 2026-04-10 15:29:56 +05:30
Anish Sarkar
8d7b5bfe36 feat: enhance memory management protocols to enforce structured headings, utilize user first names in entries, and improve clarity in memory update rules 2026-04-10 04:51:56 +05:30
Anish Sarkar
b8e1c9801b feat: update memory extraction and management protocols to enforce structured bullet formats, utilize user first names, and enhance validation for team and user memory entries 2026-04-10 04:36:51 +05:30
Anish Sarkar
a0883d2ab6 feat: implement team memory extraction and validation mechanisms, enhancing memory management by enforcing scope restrictions and improving memory persistence for shared threads 2026-04-10 01:54:00 +05:30
Anish Sarkar
33626d4f91 chore: ran linting 2026-04-10 00:31:43 +05:30
Anish Sarkar
84fc72e596 feat: implement background memory extraction and editing capabilities for user and team memory management, enhancing long-term memory persistence and user interaction 2026-04-10 00:21:55 +05:30
CREDO23
4ccdd80e26 Harden vision LLM fallback, folder upload validation, and export memory 2026-04-09 16:14:53 +02:00
Anish Sarkar
f38ea77940 chore: ran linting 2026-04-09 18:10:34 +05:30
CREDO23
e7107b751d fix: strip folder prefix from filename in folder upload 2026-04-09 13:01:23 +02:00
CREDO23
47f1d7e373 feat: implement KB export as ZIP with service layer 2026-04-09 12:17:43 +02:00
CREDO23
473eece896 feat: add export route skeleton 2026-04-09 12:10:37 +02:00
Anish Sarkar
ab3cb0e1c5 Merge remote-tracking branch 'upstream/dev' into refactor/persistent-memory 2026-04-09 15:33:23 +05:30
Anish Sarkar
dfa6005af5 feat: implement update_memory tool and routes for user memory management 2026-04-08 23:54:29 +05:30
Anish Sarkar
dec381d87e feat: add shared_memory_md field and enforce character limit in search space updates 2026-04-08 23:37:23 +05:30
Anish Sarkar
56c5809170 chore: ran linting 2026-04-08 18:23:03 +05:30
Anish Sarkar
cab0d1bdfe feat: enhance folder synchronization by integrating subtree ID retrieval and optimizing empty folder cleanup process 2026-04-08 17:10:22 +05:30
Anish Sarkar
6f9f69c3e8 refactor: remove local folder indexing endpoints and update related API calls 2026-04-08 15:49:36 +05:30
Anish Sarkar
5f5954e932 feat: implement upload-based folder indexing and synchronization features 2026-04-08 15:46:52 +05:30
Anish Sarkar
8455451ce1 chore: ran linting 2026-04-08 05:20:03 +05:30
CREDO23
26bffbcc47 Add dynamic vision model list from OpenRouter with combobox selector 2026-04-07 23:39:52 +02:00
CREDO23
6d85821ae9 Wire vision_llm_config_id in preferences, register vision LLM router 2026-04-07 19:20:28 +02:00
CREDO23
bdbc4ce4a1 Add vision LLM config CRUD and global configs routes 2026-04-07 19:04:03 +02:00
Anish Sarkar
0a26a6c5bb chore: ran linting 2026-04-07 05:55:39 +05:30
Anish Sarkar
3a1d700817 refactor: enhance file skipping logic across Dropbox, Google Drive, and OneDrive connectors to return unsupported extensions, improving error reporting and maintainability 2026-04-07 03:16:34 +05:30
Anish Sarkar
63a75052ca Merge remote-tracking branch 'upstream/dev' into feat/unified-etl-pipeline 2026-04-06 22:04:51 +05:30
Anish Sarkar
b5a15b7681 feat: implement cursor-based delta sync for Dropbox integration, enhancing file indexing efficiency and preserving folder cursors during re-authentication 2026-04-06 18:36:29 +05:30
Rohan Verma
74bf3df880
Merge pull request #1130 from CREDO23/feat/vision-autocomplete
[Feat] Vision-based autocomplete with KB grounding
2026-04-05 13:24:55 -07:00
CREDO23
d7315e7f27 Merge upstream/dev into feat/vision-autocomplete 2026-04-04 09:15:13 +02:00
CREDO23
18103417bb fix: harden autocomplete endpoint security and error handling 2026-04-04 08:57:09 +02:00
Anish Sarkar
82d4d3e272 chore: ran linting 2026-04-04 03:37:33 +05:30
Anish Sarkar
e814540727 refactor: move PKCE pair generatio for airtable
- Removed the `generate_pkce_pair` function from `airtable_add_connector_route.py` and relocated it to `oauth_security.py` for better organization.
- Updated imports in `airtable_add_connector_route.py` to reflect the new location of the PKCE generation function.
2026-04-04 03:36:54 +05:30
Anish Sarkar
8e6b1c77ea feat: implement PKCE support in native Google OAuth flows
- Added `generate_code_verifier` function to create a PKCE code verifier for enhanced security.
- Updated Google Calendar, Drive, and Gmail connector routes to utilize the PKCE code verifier during OAuth authorization.
- Modified state management to include the code verifier for secure state generation and validation.
2026-04-04 03:35:34 +05:30
CREDO23
960b8fc012 add app context and KB grounding to autocomplete suggestions 2026-04-03 21:34:01 +02:00
CREDO23
aeb3f13f91 replace text-based autocomplete with vision-based endpoint 2026-04-03 18:17:50 +02:00
CREDO23
482238e5d4 add vision LLM role for screenshot analysis 2026-04-03 17:40:27 +02:00