Commit graph

120 commits

Author SHA1 Message Date
CREDO23
9f75a3f0b3 BE-1: Add connector_naming.py utilities for friendly auto-naming and unique identifier extraction 2026-01-06 18:32:18 +02:00
Anish Sarkar
5d363b8a60 feat: implement Confluence OAuth integration and connector routes
- Added support for Confluence OAuth with new environment variables for client ID, client secret, and redirect URI.
- Implemented Confluence connector routes for OAuth flow, including authorization and callback handling.
- Enhanced Confluence connector to support both OAuth 2.0 and legacy API token authentication methods.
- Updated Confluence indexing logic to utilize OAuth credentials with auto-refresh capabilities.
- Removed outdated Confluence UI components and adjusted frontend logic to reflect the new integration.
2026-01-06 13:20:22 +05:30
Anish Sarkar
982b9ceb76 feat: implement Jira OAuth integration and connector routes
- Added support for Jira OAuth with new environment variables for client ID, client secret, and redirect URI.
- Implemented Jira connector routes for OAuth flow, including authorization and callback handling.
- Enhanced Jira connector to support both OAuth 2.0 and legacy API token authentication methods.
- Updated Jira indexing logic to utilize OAuth credentials with auto-refresh capabilities.
- Removed outdated Jira UI components and adjusted frontend logic to reflect the new integration.
2026-01-06 01:01:04 +05:30
Anish Sarkar
df23813f1c feat: add Discord OAuth integration and connector routes
- Introduced Discord OAuth support with new environment variables for client ID, client secret, and redirect URI.
- Implemented Discord connector routes for OAuth flow, including authorization and callback handling.
- Enhanced Discord connector to support both OAuth-based authentication and legacy bot token usage.
- Updated Discord indexing logic to utilize OAuth credentials with auto-refresh capabilities.
- Removed outdated Discord UI components and adjusted frontend logic to reflect the new integration.
2026-01-05 14:21:39 +05:30
Anish Sarkar
0fe94bfcf3 feat: add Slack OAuth integration and connector routes
- Introduced Slack OAuth support with new environment variables for client ID, client secret, and redirect URI.
- Implemented Slack connector routes for OAuth flow, including authorization and callback handling.
- Updated configuration to support both new OAuth format and legacy token handling.
- Enhanced the Slack indexer to decrypt tokens when necessary, ensuring compatibility with existing encrypted credentials.
- Removed outdated Slack connector UI components and adjusted frontend logic to reflect the new integration.
2026-01-04 02:30:00 +05:30
Anish Sarkar
645e849d93 chore: ran both frontend and backend linting 2026-01-03 00:18:17 +05:30
Anish Sarkar
45489423d1 feat: implement token encryption and state management for OAuth connectors
- Added encryption for sensitive tokens (access token, refresh token, client secret) in Google Calendar, Google Drive, Gmail, Linear, and Notion connectors to enhance security.
- Introduced OAuthStateManager for secure state parameter generation and validation, improving the integrity of OAuth flows.
- Updated callback routes to handle state validation and error management, ensuring robust handling of authorization processes.
- Enhanced indexers to support decryption of tokens for backward compatibility, maintaining functionality with existing encrypted credentials.
- Improved validation for date parameters in connector routes to ensure proper input handling.
2026-01-02 23:46:03 +05:30
Anish Sarkar
b81af397c0 feat: add Linear OAuth integration and connector routes
- Introduced Linear OAuth support with new environment variables for client ID, client secret, and redirect URI.
- Implemented Linear connector routes for OAuth flow, including authorization and callback handling.
- Updated existing components to accommodate Linear integration, including validation changes and connector configuration.
- Enhanced the Linear indexer to utilize OAuth access tokens instead of API keys.
- Adjusted UI components to reflect the new Linear connector without requiring special configuration.
2026-01-02 21:24:28 +05:30
Anish Sarkar
c5b184d475 feat: add Notion OAuth integration and connector routes
- Introduced Notion OAuth support with new environment variables for client ID, client secret, and redirect URI.
- Implemented Notion connector routes for OAuth flow, including authorization and callback handling.
- Updated existing components to accommodate Notion integration, including validation changes and connector configuration.
- Enhanced the Notion indexer to utilize OAuth access tokens instead of integration tokens.
- Adjusted UI components to reflect the new Notion connector without requiring special configuration.
2026-01-02 20:07:14 +05:30
Differ
e238fab638 Merge remote-tracking branch 'upstream/main' into feat/bookstack-connector 2025-12-06 09:15:02 +08:00
Differ
6b1b8d0f2e feat: add BookStack connector for wiki documentation indexing 2025-12-04 14:08:44 +08:00
Anish Sarkar
b98c312fb1 Merge remote-tracking branch 'upstream/main' into feature/blocknote-editor 2025-11-30 04:10:49 +05:30
DESKTOP-RTLN3BA\$punk
e9d32c3516 feat: Implement Role-Based Access Control (RBAC) for search space resources.
-Introduce granular permissions for documents, chats, podcasts, and logs.
- Update routes to enforce permission checks for creating, reading, updating, and deleting resources. - Refactor user and search space interactions to align with RBAC model, removing ownership checks in favor of permission validation.
2025-11-27 22:45:04 -08:00
DESKTOP-RTLN3BA\$punk
8f30cfd69a chore(lint): ruff checks 2025-11-26 13:22:31 -08:00
Anish Sarkar
3fac196c35 code quality issues fixed 2025-11-23 16:39:23 +05:30
Anish Sarkar
e68286f22e introduced blocknote editor 2025-11-23 15:23:31 +05:30
samkul-swe
ebea98cfc8 Linting fixed 2025-11-22 19:49:28 -08:00
samkul-swe
121e2f0c0e Renaming resources 2025-11-22 19:19:00 -08:00
samkul-swe
896e410e2a Webcrawler connector draft 2025-11-21 23:27:21 -08:00
DESKTOP-RTLN3BA\$punk
7ed159b395 feat: added top_k in chat Interface. 2025-11-06 13:25:05 -08:00
DESKTOP-RTLN3BA\$punk
81ddc81026 feat(removed): sub_section_writer
- Its bad and not needed.
2025-10-27 20:30:10 -07:00
MSI\ModSetter
8706df6716 feat: added meta-scheduler for running periodic tasks 2025-10-22 19:49:44 -07:00
MSI\ModSetter
a90767a478 feat: added meta-scheduler for running periodic tasks 2025-10-22 19:49:30 -07:00
Differ
beaf8f89a6 feat: add Baidu AI Search integration
- Add BAIDU_SEARCH_API connector type to support Chinese web search
- Implement search_baidu() method in connector_service.py
- Add frontend configuration page for Baidu Search API
- Create Alembic migration for new enum values
- Add validation rules and agent integration
- Support configurable model, search source, and deep search options
- Update .gitignore to exclude .env.local and other env files

Addresses integration with Chinese search ecosystem for better local market support.
Baidu AI Search provides intelligent search with automatic summarization.
2025-10-16 19:30:42 +08:00
DESKTOP-RTLN3BA\$punk
97f06899e4 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2025-10-14 21:12:17 -07:00
DESKTOP-RTLN3BA\$punk
c99cd710ea feat: add unique identifier hash for documents to prevent duplicates across various connectors 2025-10-14 21:11:19 -07:00
MSI\ModSetter
031dc714eb chore: fixed validators 2025-10-14 17:03:38 -07:00
DESKTOP-RTLN3BA\$punk
acd900c41d ruff fix 2025-10-13 14:01:55 -07:00
DESKTOP-RTLN3BA\$punk
576dc19260 refactor: updated SearxNG connector migration and fixed validation for SearxNG host URL 2025-10-13 13:57:58 -07:00
Aki-07
d2ffd12480 feat(back): add SearxNG connector type 2025-10-12 20:43:45 +05:30
DESKTOP-RTLN3BA\$punk
633ea3ac0f feat: moved LLMConfigs from User to SearchSpaces
- RBAC soon??
- Updated various services and routes to handle search space-specific LLM preferences.
- Modified frontend components to pass search space ID for LLM configuration management.
- Removed onboarding page and settings page as part of the refactor.
2025-10-10 00:50:29 -07:00
DESKTOP-RTLN3BA\$punk
b5c1157468 fix: removed checks that were not checked
- fuck this hacktoberfest
2025-10-08 21:45:21 -07:00
Aditya Vaish
20ac726a37 cleanup issue resolved 2025-10-08 12:22:28 +05:30
Aditya Vaish
3d52a5e9d6 attribute error fixed 2025-10-08 12:13:26 +05:30
Aditya Vaish
c1975091ce minor changes added 2025-10-08 12:06:49 +05:30
Aditya Vaish
a13a0594b8 fix trim mode values before validating 2025-10-08 01:07:32 +05:30
Aditya Vaish
d1f21a8dc6 pending issues resolved 2025-10-08 00:29:09 +05:30
DESKTOP-RTLN3BA\$punk
ebcfd97a0e fix: added basic context window check for summarization
- Need to optimize. Better to have seperate class with long form summarization using chunking.
2025-08-28 22:58:55 -07:00
DESKTOP-RTLN3BA\$punk
9ef2ddd15c refactor: Remove deprecated document_title parameter from generate_document_summary function 2025-08-18 20:56:53 -07:00
DESKTOP-RTLN3BA\$punk
1c4c61eb04 feat: Fixed Document Summary Content across connectors and processors 2025-08-18 20:51:48 -07:00
Utkarsh-Patel-13
d359a59f6d Fixed all ruff lint and formatting errors 2025-07-24 14:43:48 -07:00
DESKTOP-RTLN3BA\$punk
5045b7433a refactor: Move utility services to a dedicated 'services' module
- Updated import paths for LLM, connector, query, and streaming services to reflect their new location in the 'services' module.
- Removed obsolete utility service files that have been migrated.
2025-07-06 17:51:24 -07:00
DESKTOP-RTLN3BA\$punk
671984acbd fix: Fix rerank_documents node in sub_section_writer & qna_agent 2025-07-03 14:09:36 -07:00
DESKTOP-RTLN3BA\$punk
d8f2c5f7cf fix: generate content hash based on search space id as well.
- Allows Reindexing in selperate seatch spaces.
2025-06-10 13:56:23 -07:00
DESKTOP-RTLN3BA\$punk
a85f7920a9 feat: added configurable LLM's 2025-06-09 15:50:15 -07:00
DESKTOP-RTLN3BA\$punk
d7bb31f894 feat: Document Selector in Chat.
- Still need improvements but lets use it first.
2025-06-04 21:46:50 -07:00
DESKTOP-RTLN3BA\$punk
bc1642488f fix: Coderabbit & Recurse 2025-06-04 17:38:44 -07:00
DESKTOP-RTLN3BA\$punk
ef252e821e fix: to prevent collisions incase of fallback which should never happen 2025-06-04 17:30:15 -07:00
DESKTOP-RTLN3BA\$punk
52a9ad04bd feat: Stabilized Citation Logic 2025-06-04 17:19:31 -07:00
DESKTOP-RTLN3BA\$punk
deea3fa544 chore: remove VERSION file and clean up unused imports across multiple files 2025-06-03 01:33:21 -07:00