CREDO23
ba687813c1
fix(elasticsearch): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
c26181d086
fix(airtable): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
e3afe9d7c7
fix(luma): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
8191118eb4
fix(bookstack): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
45438249b6
fix(clickup): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
f5dd8f3985
fix(github): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
f085ac59e5
fix(teams): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
791b0afe16
fix(discord): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
be8a3bcd00
fix(slack): commit failed status immediately
2026-06-10 00:10:52 +02:00
CREDO23
c47949791b
fix(confluence): fail skipped placeholders so they don't stay pending
2026-06-10 00:10:42 +02:00
CREDO23
d70d01f331
fix(linear): fail skipped placeholders so they don't stay pending
2026-06-10 00:10:42 +02:00
CREDO23
1b0912aaa3
fix(calendar): fail skipped placeholders so they don't stay pending
2026-06-10 00:10:42 +02:00
CREDO23
b2c2fc9c2e
fix(gmail): fail skipped placeholders so they don't stay pending
2026-06-10 00:10:42 +02:00
CREDO23
90b32a8880
fix(notion): fail skipped placeholders so they don't stay pending
2026-06-10 00:10:42 +02:00
CREDO23
33300e4faa
fix(dropbox): sanitize ETL reason and retry stuck pending/processing files
2026-06-10 00:10:25 +02:00
CREDO23
464e7d4554
fix(onedrive): sanitize ETL reason and retry stuck pending/processing files
2026-06-10 00:10:25 +02:00
CREDO23
c0c5f3414e
fix(google-drive): sanitize ETL reason and retry stuck pending/processing files
2026-06-10 00:10:25 +02:00
CREDO23
e45e8389dc
fix(dropbox): mark documents failed on ETL failure
2026-06-09 23:39:25 +02:00
CREDO23
82aaaa5a9f
fix(onedrive): mark documents failed on ETL failure
2026-06-09 23:39:25 +02:00
CREDO23
6fd95f82b4
fix(google-drive): mark placeholders failed on ETL failure
2026-06-09 23:39:25 +02:00
CREDO23
cb10882dc8
feat(indexers): add mark_connector_documents_failed helper
2026-06-09 23:39:25 +02:00
DESKTOP-RTLN3BA\$punk
ce952d2ad1
chore: linting
2026-06-09 00:42:26 -07:00
Anish Sarkar
e4d7b01b09
refactor(backend): Update references from document summary LLM to agent LLM across multiple files
2026-06-04 01:50:44 +05:30
Anish Sarkar
f3866b9e7e
feat(backend): Use deterministic content in connector ingestion
2026-06-04 00:51:38 +05:30
CREDO23
b6710ae9af
refactor(jira): remove dead legacy indexing and write tools (mcp-only now)
2026-06-02 16:38:00 +02:00
CREDO23
1791241c0c
perf(indexers): offload sync embed_text to thread across background workers
...
Connector kb_sync_services (gmail, onedrive, google_calendar, jira),
streaming indexers (discord, luma, teams) and the file-processor save
path all called embed_text inside async coroutines, blocking the
background worker's event loop for the duration of the embed. Wrap each
call site in asyncio.to_thread so concurrent indexing tasks stop
serialising on the embed.
2026-05-20 10:09:38 +02:00
DESKTOP-RTLN3BA\$punk
cea8618aed
fix: fixed composio issues
2026-05-02 21:16:03 -07:00
Anish Sarkar
9b1b9a90c0
Merge remote-tracking branch 'upstream/dev' into feat/obsidian-plugin
2026-04-24 21:34:55 +05:30
CREDO23
9977f9b641
remove dead indexing tasks and fix silent schedule breakage for live connectors
2026-04-22 21:43:51 +02:00
Anish Sarkar
99623a85d5
refactor: remove legacy Obsidian connector support
2026-04-22 00:10:24 +05:30
CREDO23
e02fbbef6c
remove MCP-mode skip from Notion indexer
2026-04-21 20:33:57 +02:00
CREDO23
5a8ec704fe
feat(notion-mcp): add MCP gating in agent, indexer, and health check
2026-04-20 21:02:21 +02:00
DESKTOP-RTLN3BA\$punk
656e061f84
feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
...
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
DESKTOP-RTLN3BA\$punk
4bee367d4a
feat: added ai file sorting
2026-04-14 01:43:30 -07:00
CREDO23
a95bf58c8f
Make Vision LLM opt-in for uploads and connectors
2026-04-10 16:45:51 +02:00
CREDO23
0aefcbd504
Remove vision LLM from desktop folder watcher
2026-04-09 22:06:06 +02:00
CREDO23
afd3c2cde2
Pass vision LLM through local folder indexer call chain
2026-04-09 14:50:24 +02:00
Anish Sarkar
56c5809170
chore: ran linting
2026-04-08 18:23:03 +05:30
Anish Sarkar
37c52ce7ea
feat: implement indexing progress management in local folder indexing process and enhance related test coverage
2026-04-08 18:01:55 +05:30
Anish Sarkar
a8b83dcf3f
feat: add folder_id support in ConnectorDocument and indexing pipeline for improved document organization
2026-04-08 17:48:50 +05:30
Anish Sarkar
f3aa514240
feat: integrate subtree ID retrieval in local folder cleanup process and enhance UI component styling for folder selection
2026-04-08 17:25:18 +05:30
Anish Sarkar
cab0d1bdfe
feat: enhance folder synchronization by integrating subtree ID retrieval and optimizing empty folder cleanup process
2026-04-08 17:10:22 +05:30
Anish Sarkar
ae98f64760
feat: enhance folder indexing with metadata management and improve folder structure handling in UI components
2026-04-08 16:48:40 +05:30
Anish Sarkar
60eb1e4060
feat: implement raw file hash computation to optimize content extraction during local folder indexing
2026-04-08 16:28:51 +05:30
Anish Sarkar
5f5954e932
feat: implement upload-based folder indexing and synchronization features
2026-04-08 15:46:52 +05:30
Anish Sarkar
0a26a6c5bb
chore: ran linting
2026-04-07 05:55:39 +05:30
Anish Sarkar
1b87719a92
refactor: enhance file skipping logic in Google Drive connector to check for Google Workspace files before unsupported extensions
2026-04-07 05:36:29 +05:30
Anish Sarkar
e4462292e4
refactor: update Google Drive indexer to return an additional unsupported file count, enhancing error reporting consistency
2026-04-07 05:30:10 +05:30
Anish Sarkar
122be76133
refactor: update _index_selected_files method signatures in Dropbox, Google Drive, and OneDrive indexers to include unsupported file count, enhancing error reporting and consistency across connectors
2026-04-07 03:16:46 +05:30
Anish Sarkar
3a1d700817
refactor: enhance file skipping logic across Dropbox, Google Drive, and OneDrive connectors to return unsupported extensions, improving error reporting and maintainability
2026-04-07 03:16:34 +05:30
