Commit graph

70 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
4a0c3e368a feat: migrated to surfsense deep agent 2025-12-23 01:16:25 -08:00
DESKTOP-RTLN3BA\$punk
1cbb1b5d66 refactor: remove chat-related fields and legacy podcast generation function 2025-12-21 23:31:11 -08:00
DESKTOP-RTLN3BA\$punk
c2dcb2045d feat: added attachment support 2025-12-21 22:26:33 -08:00
DESKTOP-RTLN3BA\$punk
bb971460fc feat: migrated old chat to new chat 2025-12-21 19:33:52 -08:00
DESKTOP-RTLN3BA\$punk
0c3574d049 feat: implement new chat feature with message persistence and UI integration 2025-12-21 16:16:50 -08:00
Anish Sarkar
8eceb7a5cb feat: add note management functionality with BlockNote support
- Introduced a new ENUM value 'NOTE' for document types in the database.
- Implemented backend routes for creating, listing, and deleting notes.
- Added a new frontend page for creating notes with a BlockNote editor.
- Updated sidebar to include recent notes and an option to add new notes.
- Enhanced API service for notes with validation and request/response schemas.
- Updated translations to support new note-related terms.
2025-12-16 12:28:30 +05:30
DESKTOP-RTLN3BA\$punk
919c323ef3 feat: implement time-based filtering for document retrieval using 'updated_at' timestamp 2025-12-12 02:42:20 -08:00
DESKTOP-RTLN3BA\$punk
8c9aa68faa feat: update document tracking to use 'updated_at' timestamp instead of 'last_edited_at' 2025-12-12 01:32:14 -08:00
DESKTOP-RTLN3BA\$punk
1cbe479af4 chore: ruff format 2025-12-11 00:31:58 -08:00
DESKTOP-RTLN3BA\$punk
3207fbf9ea feat(fix): add PAGES_LIMIT configuration for ETL services 2025-12-11 00:29:56 -08:00
Rohan Verma
e1e14c7ab6
Merge pull request #534 from ankitpasayat/fix/retriever-typo
fix(backend): rename retriver directory to retriever
2025-12-06 17:54:18 -08:00
Ankit Pasayat
b30f53bf0b fix(backend): rename retriver directory to retriever
Fixes typo in directory name and updates all import paths:
- Renamed surfsense_backend/app/retriver/ to surfsense_backend/app/retriever/
- Updated imports in db.py
- Updated imports in connector_service.py
2025-12-06 22:21:30 +05:30
Differ
e238fab638 Merge remote-tracking branch 'upstream/main' into feat/bookstack-connector 2025-12-06 09:15:02 +08:00
Differ
6b1b8d0f2e feat: add BookStack connector for wiki documentation indexing 2025-12-04 14:08:44 +08:00
Anish Sarkar
b98c312fb1 Merge remote-tracking branch 'upstream/main' into feature/blocknote-editor 2025-11-30 04:10:49 +05:30
DESKTOP-RTLN3BA\$punk
07234d7849 ruff format 2025-11-29 00:16:41 -08:00
DESKTOP-RTLN3BA\$punk
72236f65f7 refactor: remove UserSearchSpacePreference model and related relationships
- Deleted UserSearchSpacePreference class and its relationships from SearchSpace and User models.
- Cleaned up unused code to streamline database interactions.
2025-11-29 00:12:30 -08:00
DESKTOP-RTLN3BA\$punk
e9d32c3516 feat: Implement Role-Based Access Control (RBAC) for search space resources.
-Introduce granular permissions for documents, chats, podcasts, and logs.
- Update routes to enforce permission checks for creating, reading, updating, and deleting resources. - Refactor user and search space interactions to align with RBAC model, removing ownership checks in favor of permission validation.
2025-11-27 22:45:04 -08:00
Anish Sarkar
3fac196c35 code quality issues fixed 2025-11-23 16:39:23 +05:30
Anish Sarkar
e68286f22e introduced blocknote editor 2025-11-23 15:23:31 +05:30
samkul-swe
896e410e2a Webcrawler connector draft 2025-11-21 23:27:21 -08:00
DESKTOP-RTLN3BA\$punk
6648409237 feat: Added Search Space System Instructions
- Added `citations_enabled` and `qna_custom_instructions` fields to the SearchSpace model for better QnA configuration.
- Updated the creation and update schemas to handle new fields with appropriate defaults.
- Refactored QnA handling in the agent to utilize the new SearchSpace fields for improved response customization.
- Adjusted UI components to include settings for managing QnA configurations.
- Enhanced onboarding process to incorporate prompt setup as an optional step.
2025-11-19 15:04:46 -08:00
DESKTOP-RTLN3BA\$punk
d4345f75e5 feat: added global llm configurations 2025-11-14 21:53:46 -08:00
DESKTOP-RTLN3BA\$punk
38dffaffa3 feat(llm): expand LLM provider options and improve model selection UI
- Added new LLM providers including Google, Azure OpenAI, Bedrock, and others to the backend.
- Updated the model selection UI to dynamically display available models based on the selected provider.
- Enhanced the provider change handling to reset the model selection when the provider is changed.
- Improved the overall user experience by providing contextual information for model selection.
2025-11-13 02:41:30 -08:00
CREDO23
666ea87a9d reference the chat in the podcast 2025-11-06 21:52:45 +02:00
CREDO23
aaa6ee22ed implement chat/podcast staleness 2025-11-06 21:52:45 +02:00
DESKTOP-RTLN3BA\$punk
4be9d099bf feat: added file limit tracking for a user 2025-10-30 14:58:08 -07:00
DESKTOP-RTLN3BA\$punk
81ddc81026 feat(removed): sub_section_writer
- Its bad and not needed.
2025-10-27 20:30:10 -07:00
DESKTOP-RTLN3BA\$punk
182f815bb7 feat: added periodic tasks in backend db and frontend hooks
- TODO: Add celery redbeat and create tasks dinamically in our redis
2025-10-22 16:14:25 -07:00
Anish Sarkar
8e1e81ebae Merge remote-tracking branch 'upstream/main' into feature/elasticsearch-connector 2025-10-17 01:02:29 +05:30
Differ
beaf8f89a6 feat: add Baidu AI Search integration
- Add BAIDU_SEARCH_API connector type to support Chinese web search
- Implement search_baidu() method in connector_service.py
- Add frontend configuration page for Baidu Search API
- Create Alembic migration for new enum values
- Add validation rules and agent integration
- Support configurable model, search source, and deep search options
- Update .gitignore to exclude .env.local and other env files

Addresses integration with Chinese search ecosystem for better local market support.
Baidu AI Search provides intelligent search with automatic summarization.
2025-10-16 19:30:42 +08:00
Anish Sarkar
929035f802 Merge remote-tracking branch 'upstream/main' into feature/elasticsearch-connector 2025-10-16 16:24:37 +05:30
DESKTOP-RTLN3BA\$punk
c99cd710ea feat: add unique identifier hash for documents to prevent duplicates across various connectors 2025-10-14 21:11:19 -07:00
DESKTOP-RTLN3BA\$punk
ba5bb91a7b chore: removed chinese comments to pass ruff checks and updated migration nos 2025-10-13 20:07:32 -07:00
Rohan Verma
c99469bfdf
Merge pull request #391 from unitagain/feature/chinese-llm-support
feat: add Chinese LLM providers support with auto-fill API Base URL
2025-10-13 19:52:21 -07:00
Rohan Verma
08661e686c
Merge pull request #392 from Aki-07/feature/add-searxng-connector
Add Searxng connector
2025-10-13 13:41:37 -07:00
Aki-07
d2ffd12480 feat(back): add SearxNG connector type 2025-10-12 20:43:45 +05:30
Differ
917cf4f398 feat: add Chinese LLM providers support with auto-fill API Base URL
- Add support for DeepSeek, Qwen (Alibaba), Kimi (Moonshot), and GLM (Zhipu)
- Implement auto-fill API Base URL when selecting Chinese LLM providers
- Add smart validation and warnings for missing API endpoints
- Fix session state management in task logging service
- Add comprehensive Chinese setup documentation
- Add database migration for new LLM provider enums

Closes #383
2025-10-12 19:10:46 +08:00
Tarun
045537aa79 feat: add language support across configurations and prompts 2025-10-12 13:13:42 +05:30
Anish Sarkar
55d752e3c8 feat: added elasticsearch connector 2025-10-12 09:39:04 +05:30
DESKTOP-RTLN3BA\$punk
633ea3ac0f feat: moved LLMConfigs from User to SearchSpaces
- RBAC soon??
- Updated various services and routes to handle search space-specific LLM preferences.
- Modified frontend components to pass search space ID for LLM configuration management.
- Removed onboarding page and settings page as part of the refactor.
2025-10-10 00:50:29 -07:00
DESKTOP-RTLN3BA\$punk
aea09a5dad feat: Moved searchconnectors association from user to searchspace
- Need to move llm configs to searchspace
2025-10-08 21:13:01 -07:00
TensorNull
d87773d0a6 feat: Added CometAPI to LLM providers list 2025-10-04 15:13:03 +08:00
samkul-swe
9d2b808e66 Added Luma connector 2025-09-28 14:59:10 -07:00
Natsume Ryuhane
5c3ea68d8f
Added OpenRouter to provider list 2025-09-16 18:26:58 -07:00
CREDO23
27b914f822 Add airtable connector auth flow routes 2025-08-26 13:56:31 +02:00
CREDO23
a1bc9a1c60 update search source connector / add gmail enum value 2025-08-15 09:07:22 +02:00
CREDO23
605d0f71fd add requested changes 2025-08-07 21:18:25 +02:00
CREDO23
edf46e4de1 update seach source connector schema 2025-08-03 12:16:40 +02:00
CREDO23
9abaf4fd2a add (backend) google calendar connection flow 2025-08-03 12:16:40 +02:00