apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-05-04 05:12:38 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
5265 commits 3 branches 214 tags 387 MiB
Commit graph

1562 commits

Author SHA1 Message Date
Anish Sarkar
e6db050dfd feat(chat): add userId to premium alert handling and improve alert visibility in UI 2026-04-29 21:58:17 +05:30
Anish Sarkar
901de33684 feat(chat): enhance error formatting to include optional error codes for better frontend handling 2026-04-29 21:05:21 +05:30
Anish Sarkar
d66fa1559b feat(chat): implement forced repin to free tier for pinned LLM configurations 2026-04-29 20:29:41 +05:30
Anish Sarkar
c598d7038f refactor(chat): update premium token error messages for clarity and consistency 2026-04-29 20:17:45 +05:30
Anish Sarkar
835bd9f65d fix(chat): enforce pinned model quota flow and reset stale pins 2026-04-29 19:15:36 +05:30
Anish Sarkar
41849fe10f feat(chat): add auto model pin resolution service 2026-04-29 19:15:15 +05:30
Anish Sarkar
57db198919 feat(chat): add thread-level auto model pinning fields 2026-04-29 19:14:56 +05:30
DESKTOP-RTLN3BA\$punk
f9b5367754 chore: cleaned comments slop 2026-04-28 23:52:37 -07:00
DESKTOP-RTLN3BA\$punk
ca9bbee06d chore: linting 2026-04-28 21:37:51 -07:00
DESKTOP-RTLN3BA\$punk
b9a66cb417 feat: various UI fixes, prompt optimizations, and allowing duplicate docs 
- Updated `content_hash` in the `Document` model to remove global uniqueness, allowing identical content across different paths.
- Enhanced `_create_document` function to handle path uniqueness and prevent session-poisoning from `IntegrityError`.
- Added detailed comments for clarity on the changes and their implications.
- Introduced new citation handling in the editor for improved user experience with citation jumps.
- Updated package dependencies in the frontend for better functionality.
 2026-04-28 21:30:53 -07:00
DESKTOP-RTLN3BA\$punk
e6433f78c4 Merge commit '61f4d05cd1' into dev_mod 2026-04-28 09:25:41 -07:00
DESKTOP-RTLN3BA\$punk
31a372bb84 feat: updated agent harness 2026-04-28 09:22:19 -07:00
DESKTOP-RTLN3BA\$punk
9ec9b64348 feat(chat_deepagent): optimize agent creation by offloading middleware stack compilation to a separate thread 2026-04-28 05:03:52 -07:00
DESKTOP-RTLN3BA\$punk
05ca4c0b9f feat: updated file management for main agent 2026-04-28 04:32:52 -07:00
DESKTOP-RTLN3BA\$punk
8d50f90060 chore: linting
Some checks failed
Obsidian Plugin Lint / lint (push) Has been cancelled
Details
2026-04-27 14:04:50 -07:00
CREDO23
2d962f6dd2 Merge upstream/dev 2026-04-27 22:44:40 +02:00
Rohan Verma
f607636ba6
Merge pull request #1286 from AnishSarkar22/feat/obsidian-plugin 
feat: introduce Obsidian vault sync plugin
 2026-04-27 13:34:33 -07:00
Rohan Verma
19f4668e8b
Merge pull request #1314 from AnishSarkar22/fix/swappable-filesystem 
fix: improve swappable filesystem architecture
 2026-04-27 13:32:56 -07:00
Rohan Verma
7d782c7837
Merge pull request #1306 from mvanhorn/osc/1295-github-connector-heartbeat 
fix(connectors): refresh Redis heartbeat during long Phase 1 indexing
 2026-04-27 13:31:06 -07:00
Anish Sarkar
c238a671c8 feat(filesystem): enhance local mount path normalization and add error handling for missing parent directories 2026-04-28 01:54:26 +05:30
Anish Sarkar
7134b0feae refactor(file_intent): remove _infer_text_file_extension function and standardize fallback filename to 'notes.md' 2026-04-28 00:57:07 +05:30
Anish Sarkar
7bcb6306c5 refactor(filesystem): streamline filesystem operations by removing cursor-based pagination and enhancing path normalization methods 2026-04-28 00:45:07 +05:30
CREDO23
056870464a Accept optional user_images on regenerate and apply them when resolving the model turn. 2026-04-27 19:25:20 +02:00
Anish Sarkar
3fa8c790f5 feat(filesystem): add move and list_tree functionalities to enhance local folder operations 2026-04-27 22:32:37 +05:30
Matt Van Horn
a08066e2f9
style: ruff format Redis heartbeat refresh in connectors route 2026-04-26 08:59:16 -07:00
Matt Van Horn
456dd7417c
fix(connectors): refresh Redis heartbeat during long Phase 1 indexing 
Closes #1295

The connector indexing route's `_run_indexing_with_notifications` set the
Redis heartbeat key once at the start of indexing and relied on
`on_heartbeat_callback` (only fired in Phase 2 per-document loops) to
refresh it. The GitHub connector's Phase 1 runs `gitingest` as a blocking
subprocess via `asyncio.to_thread`, so for any repo larger than the
2-minute TTL, the key expires before Phase 2 starts. The
`cleanup_stale_indexing_notifications_task` then marks the document as
failed with the misleading "Sync was interrupted unexpectedly. Please
retry." message — even though the indexing thread is still running and
gitingest's own subprocess timeout is 900 seconds.

Add a background asyncio coroutine that refreshes the Redis key every
60 seconds for the duration of the indexing call. Same pattern already
in use at app/tasks/celery_tasks/document_tasks.py:_run_heartbeat_loop,
just adapted to use the route's get_heartbeat_redis_client() and
_get_heartbeat_key() helpers.

Cancellation runs in the `finally` block BEFORE the heartbeat-key
delete so the loop cannot race and re-create the key after we have
deleted it. The new `HEARTBEAT_REFRESH_INTERVAL = 60` constant mirrors
the celery task module's value.
 2026-04-26 02:46:43 -07:00
Anish Sarkar
02795e08e3 feat: add server time to obsidian connect responses and enhance error handling 
- Included server_time_utc in the connect response schema for better synchronization.
- Updated obsidian_connect function to set server_time_utc during connection handling.
- Enhanced integration tests to verify the presence of server_time_utc in responses.
- Improved connectivity status recovery in the sync engine for better error management.
 2026-04-25 03:57:07 +05:30
Anish Sarkar
1c18735d38 feat: enhance authentication handling and UI feedback in SurfSense plugin 
- Introduced an authentication block mechanism to prevent repeated invalid token submissions.
- Updated notification logic to provide clearer feedback on API token status.
- Refactored status visuals for better clarity and consistency in the user interface.
- Improved connection handling in the sync engine to ensure robust error management.
 2026-04-25 01:07:02 +05:30
Anish Sarkar
e84dc87c5b feat(obsidian_plugin): validate binary attachments and enforce MIME type checks 2026-04-25 00:23:17 +05:30
CREDO23
d1080b1298 Extend new chat streaming for multimodal user turns 2026-04-24 18:48:02 +02:00
CREDO23
c9477d13fc Remove backend vision autocomplete stack 2026-04-24 18:45:38 +02:00
Anish Sarkar
9b1b9a90c0 Merge remote-tracking branch 'upstream/dev' into feat/obsidian-plugin 2026-04-24 21:34:55 +05:30
Rohan Verma
a0f2851784
Merge pull request #1299 from AnishSarkar22/feat/swappable-filesystem
Some checks failed
Build and Push Docker Images / tag_release (push) Has been cancelled
Details
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Details
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Details
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Details
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Details
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Details
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
Details 
feat: introduce swappable filesystem on desktop & monaco editor to edit local files
 2026-04-23 19:38:33 -07:00
Anish Sarkar
7063d6d1e4 feat(filesystem): improve path normalization in SurfSenseFilesystemMiddleware to handle Windows-style paths and mixed separators 2026-04-24 06:09:22 +05:30
Anish Sarkar
30b55a9baa feat(filesystem): refactor local filesystem handling to use mounts instead of root paths, enhancing mount management and path normalization 2026-04-24 05:59:21 +05:30
Anish Sarkar
1e9db6f26f feat(filesystem): enhance local mount path normalization and improve virtual path handling in agent filesystem 2026-04-24 02:12:30 +05:30
Anish Sarkar
6721919398 feat(filesystem): add multi-root local folder support in backend 2026-04-24 01:44:23 +05:30
Anish Sarkar
864f6f798a feat(filesystem): enhance local file handling in editor and IPC integration 2026-04-23 17:23:38 +05:30
Anish Sarkar
1eadecee23 feat(new-chat): integrate filesystem flow into agent pipeline 2026-04-23 15:45:33 +05:30
Anish Sarkar
42d2d2222e feat(filesystem): add local folder backend and verification coverage 2026-04-23 15:44:12 +05:30
CREDO23
739345671b fix: break circular import in llm_service and kb_sync_service files 2026-04-23 11:47:15 +02:00
Anish Sarkar
15a9e8b085 feat(middleware): detect file intent in chat messages 2026-04-23 15:03:32 +05:30
Anish Sarkar
749116e830 feat(new-chat): add filesystem backend interfaces and selection helpers 2026-04-23 15:02:58 +05:30
CREDO23
45b72de481 fix: robust generic MCP tool routing, retry, and empty-schema handling 2026-04-23 11:30:58 +02:00
CREDO23
cf7c14cf44 fix: mark connector auth_expired on token decryption failure 2026-04-23 09:27:03 +02:00
CREDO23
0b3551bd06 perf: parallelize MCP connector discovery with per-connector timeout 2026-04-23 08:40:06 +02:00
CREDO23
e3172dc282 fix: reactive 401 recovery for live MCP connectors and unified reauth endpoints 2026-04-23 08:27:11 +02:00
CREDO23
16f47578d7 Enhance MCP tool trust functionality to support OAuth-backed connectors and improve error handling in the UI. Refactor API calls to use baseApiService for consistency. 2026-04-23 08:03:32 +02:00
Rohan Verma
7245ab4046
Merge pull request #1294 from CREDO23/feature/mcp-migration
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Details
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Details
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Details
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Details
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Details
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Details
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
Details 
[FEAT] Live connector tools via MCP OAuth and native APIs
 2026-04-22 21:00:28 -07:00
CREDO23
b6c506abef fix: treat all Gmail/Calendar as live connectors, hide indexing UI 2026-04-22 22:51:28 +02:00