Commit graph

354 commits

Author SHA1 Message Date
Anish Sarkar
9b1b9a90c0 Merge remote-tracking branch 'upstream/dev' into feat/obsidian-plugin 2026-04-24 21:34:55 +05:30
CREDO23
739345671b fix: break circular import in llm_service and kb_sync_service files 2026-04-23 11:47:15 +02:00
CREDO23
b6c506abef fix: treat all Gmail/Calendar as live connectors, hide indexing UI 2026-04-22 22:51:28 +02:00
CREDO23
01153b0d7e fix: cache TokenEncryption, clear stale router caches on re-init 2026-04-22 20:24:45 +02:00
CREDO23
4915675f45 Merge upstream/dev into feature/mcp-migration 2026-04-22 19:53:26 +02:00
Anish Sarkar
6ac5256431 feat: implement background processing for binary attachments in Obsidian plugin
- Added a new Celery task for indexing non-markdown attachments.
- Enhanced the Obsidian plugin schema to support binary attachments.
- Updated routes to enqueue binary attachments for background processing.
- Improved metadata handling for binary attachments during indexing.
- Added tests for binary attachment processing and validation.
2026-04-22 23:00:34 +05:30
CREDO23
9eb54bc4af add account metadata discovery and connected_accounts tool 2026-04-22 18:57:26 +02:00
Anish Sarkar
6eeaa2db4d feat: enhance Obsidian plugin schema with HeadingRef class 2026-04-22 20:26:58 +05:30
DESKTOP-RTLN3BA\$punk
435406c302 temp(hotpatch): block github_coplot custom provider 2026-04-22 04:04:08 -07:00
CREDO23
dfa40b8801 fix MCP OAuth for all 5 services, add MCP connector edit view 2026-04-22 10:50:43 +02:00
CREDO23
dde1948a5c fix Slack MCP OAuth: v2 endpoint, user_scope param, nested token extraction 2026-04-22 10:06:12 +02:00
CREDO23
970f62278b revert scope_param, use standard scope for Slack v2_user endpoint 2026-04-22 09:56:18 +02:00
DESKTOP-RTLN3BA\$punk
95de0547f4 feat: add default API base URLs for LiteLLM providers and enhance fallback handling in LLMRouterService 2026-04-22 00:56:05 -07:00
CREDO23
820326e3ee use user_scope param for Slack OAuth 2026-04-22 09:54:16 +02:00
CREDO23
3638d72b29 restore full Slack MCP scopes for all MCP tools 2026-04-22 09:41:19 +02:00
CREDO23
225236e6f1 add required OAuth scopes for Slack MCP 2026-04-22 09:35:15 +02:00
CREDO23
0cc2475f6b add required OAuth scopes for Airtable MCP 2026-04-22 09:21:19 +02:00
CREDO23
2f4052aa71 use pre-configured credentials for Airtable MCP OAuth 2026-04-22 09:15:06 +02:00
CREDO23
ea3508cb25 use native connector types for MCP OAuth, restore original UI 2026-04-22 08:57:28 +02:00
Anish Sarkar
3eb4d55ef5 chore: ran linting 2026-04-22 06:40:39 +05:30
CREDO23
8b8c9b1f5d add Slack and Airtable MCP OAuth support 2026-04-21 21:38:24 +02:00
CREDO23
4efdee5aed add MCP OAuth discovery, DCR, and token exchange 2026-04-21 21:19:15 +02:00
CREDO23
7133655eeb add MCP service registry for Linear, Jira, ClickUp 2026-04-21 21:19:08 +02:00
CREDO23
978a8e2e07 remove MCP health check branch from Notion metadata service 2026-04-21 20:33:35 +02:00
CREDO23
ea3bda9ec3 delete Notion MCP services, tools, and route 2026-04-21 20:33:10 +02:00
Anish Sarkar
54ce2666f5 feat: implement cross-device deduplication for Obsidian connectors using vault fingerprinting and enhance connector management 2026-04-21 04:21:33 +05:30
CREDO23
5a8ec704fe feat(notion-mcp): add MCP gating in agent, indexer, and health check 2026-04-20 21:02:21 +02:00
CREDO23
d6e605fd50 feat(notion-mcp): add OAuth + PKCE service layer and MCP adapter
Implements Notion MCP integration core:
- OAuth 2.0 discovery (RFC 9470 + 8414), dynamic client registration,
  PKCE token exchange, and refresh with rotation
- NotionMCPAdapter connecting to mcp.notion.com/mcp with fallback
  to direct API on known serialization errors
- Response parser translating MCP text responses into dicts matching
  NotionHistoryConnector output format
- has_mcp_notion_connector() helper for connector gating
2026-04-20 20:59:17 +02:00
Anish Sarkar
4d3406341d feat: add file size tracking and sync interval settings to Obsidian plugin for improved reconciliation and performance 2026-04-20 23:48:51 +05:30
Anish Sarkar
e8fc1069bc feat: implement Obsidian plugin ingestion routes and indexing service 2026-04-20 04:03:19 +05:30
Rohan Verma
2b2453e015
Merge pull request #1240 from AnishSarkar22/feat/resume-builder
Some checks failed
Build and Push Docker Images / tag_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
feat: resume builder
2026-04-17 13:41:32 -07:00
Anish Sarkar
e2cd0557a5 feat: add public report PDF preview endpoint and update report content handling for Typst-based resumes 2026-04-16 22:51:36 +05:30
DESKTOP-RTLN3BA\$punk
2f793e7a69 refactor: improve content extraction and encoding handling
- Enhanced Azure Document Intelligence parser to raise an error for empty or whitespace-only content.
- Updated LLMRouterService to log premium model strings more clearly.
- Added automatic encoding detection for file reading in document processors.
- Improved error handling for empty markdown content extraction in file processors.
- Refactored DocumentUploadTab component for better accessibility and user interaction.
2026-04-16 00:25:46 -07:00
DESKTOP-RTLN3BA\$punk
4a51ccdc2c cloud: added openrouter integration with global configs 2026-04-15 23:46:29 -07:00
DESKTOP-RTLN3BA\$punk
ff4e0f9b62 feat: no login experience and prem tokens
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
DESKTOP-RTLN3BA\$punk
656e061f84 feat: add processing mode support for document uploads and ETL pipeline, improded error handling ux
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
- Introduced a `ProcessingMode` enum to differentiate between basic and premium processing modes.
- Updated `EtlRequest` to include a `processing_mode` field, defaulting to basic.
- Enhanced ETL pipeline services to utilize the selected processing mode for Azure Document Intelligence and LlamaCloud parsing.
- Modified various routes and services to handle processing mode, affecting document upload and indexing tasks.
- Improved error handling and logging to include processing mode details.
- Added tests to validate processing mode functionality and its impact on ETL operations.
2026-04-14 21:26:00 -07:00
Anish Sarkar
9fc0976d5e chore: ran linting 2026-04-14 21:52:26 +05:30
Anish Sarkar
f01ddf3f0a feat: implement token usage recording in chat routes and enhance title generation handling 2026-04-14 20:56:07 +05:30
Anish Sarkar
8fd7664f8f Merge remote-tracking branch 'upstream/dev' into feat/token-calculation 2026-04-14 15:49:39 +05:30
Anish Sarkar
f21bdc0668 feat: enhance LLM response handling and token usage tracking in chat services and UI components 2026-04-14 15:29:02 +05:30
Anish Sarkar
5af6005163 feat: improve token usage tracking and response handling in chat routes and services 2026-04-14 14:28:31 +05:30
DESKTOP-RTLN3BA\$punk
4bee367d4a feat: added ai file sorting 2026-04-14 01:43:30 -07:00
Anish Sarkar
3cfe53fb7f feat: implement token usage tracking for LLM calls with new accumulator and callback 2026-04-14 13:40:32 +05:30
CREDO23
a95bf58c8f Make Vision LLM opt-in for uploads and connectors 2026-04-10 16:45:51 +02:00
CREDO23
4ccdd80e26 Harden vision LLM fallback, folder upload validation, and export memory 2026-04-09 16:14:53 +02:00
CREDO23
1af5725bd1 fix: track dedup'd filename in used_paths to prevent collisions 2026-04-09 13:51:32 +02:00
CREDO23
b5f6e44fc3 security: sanitize folder names in ZIP export paths 2026-04-09 13:39:36 +02:00
CREDO23
47f1d7e373 feat: implement KB export as ZIP with service layer 2026-04-09 12:17:43 +02:00
Anish Sarkar
8455451ce1 chore: ran linting 2026-04-08 05:20:03 +05:30
CREDO23
26bffbcc47 Add dynamic vision model list from OpenRouter with combobox selector 2026-04-07 23:39:52 +02:00