Commit graph

70 commits

Author SHA1 Message Date
Rohan Verma
e1e14c7ab6
Merge pull request #534 from ankitpasayat/fix/retriever-typo
fix(backend): rename retriver directory to retriever
2025-12-06 17:54:18 -08:00
Ankit Pasayat
b30f53bf0b fix(backend): rename retriver directory to retriever
Fixes typo in directory name and updates all import paths:
- Renamed surfsense_backend/app/retriver/ to surfsense_backend/app/retriever/
- Updated imports in db.py
- Updated imports in connector_service.py
2025-12-06 22:21:30 +05:30
Differ
e238fab638 Merge remote-tracking branch 'upstream/main' into feat/bookstack-connector 2025-12-06 09:15:02 +08:00
Differ
6b1b8d0f2e feat: add BookStack connector for wiki documentation indexing 2025-12-04 14:08:44 +08:00
DESKTOP-RTLN3BA\$punk
e9d32c3516 feat: Implement Role-Based Access Control (RBAC) for search space resources.
-Introduce granular permissions for documents, chats, podcasts, and logs.
- Update routes to enforce permission checks for creating, reading, updating, and deleting resources. - Refactor user and search space interactions to align with RBAC model, removing ownership checks in favor of permission validation.
2025-11-27 22:45:04 -08:00
DESKTOP-RTLN3BA\$punk
8f30cfd69a chore(lint): ruff checks 2025-11-26 13:22:31 -08:00
samkul-swe
121e2f0c0e Renaming resources 2025-11-22 19:19:00 -08:00
samkul-swe
6d19e0fad8 Fixing search logic 2025-11-22 13:33:16 -08:00
DESKTOP-RTLN3BA\$punk
d4345f75e5 feat: added global llm configurations 2025-11-14 21:53:46 -08:00
DESKTOP-RTLN3BA\$punk
38dffaffa3 feat(llm): expand LLM provider options and improve model selection UI
- Added new LLM providers including Google, Azure OpenAI, Bedrock, and others to the backend.
- Updated the model selection UI to dynamically display available models based on the selected provider.
- Enhanced the provider change handling to reset the model selection when the provider is changed.
- Improved the overall user experience by providing contextual information for model selection.
2025-11-13 02:41:30 -08:00
DESKTOP-RTLN3BA\$punk
9466bf595c feat: Implement LLM configuration validation in create and update routes
- Added `validate_llm_config` function to `llm_service.py` for validating LLM configurations via test API calls.
- Integrated validation in `create_llm_config` and `update_llm_config` routes in `llm_config_routes.py`, raising HTTP exceptions for invalid configurations.
- Enhanced error handling to provide detailed feedback on configuration issues.
2025-11-05 12:15:05 -08:00
DESKTOP-RTLN3BA\$punk
a2fb9faad6 feat: enhance Azure OpenAI embeddings and add voice support for Azure provider
- Introduced a fixed parameter order for AzureOpenAIEmbeddings to resolve compatibility issues.
- Updated the voice selection logic to include Azure voices in the podcaster utility.
- Modified the page limit service to use a more efficient method for retrieving users.
2025-10-30 22:33:47 -07:00
DESKTOP-RTLN3BA\$punk
4be9d099bf feat: added file limit tracking for a user 2025-10-30 14:58:08 -07:00
DESKTOP-RTLN3BA\$punk
5b957ec21c feat: bumped version to v0.0.8 2025-10-16 22:44:12 -07:00
Anish Sarkar
8e1e81ebae Merge remote-tracking branch 'upstream/main' into feature/elasticsearch-connector 2025-10-17 01:02:29 +05:30
Differ
a479fea588 fix: Baidu search UI rendering and clean debug code
- Fix: Add BAIDU_SEARCH_API to direct render sources
- Fix: Remove API key exposure in debug logs
- Resolves 404 error when clicking Baidu search results
2025-10-16 22:45:35 +08:00
Differ
beaf8f89a6 feat: add Baidu AI Search integration
- Add BAIDU_SEARCH_API connector type to support Chinese web search
- Implement search_baidu() method in connector_service.py
- Add frontend configuration page for Baidu Search API
- Create Alembic migration for new enum values
- Add validation rules and agent integration
- Support configurable model, search source, and deep search options
- Update .gitignore to exclude .env.local and other env files

Addresses integration with Chinese search ecosystem for better local market support.
Baidu AI Search provides intelligent search with automatic summarization.
2025-10-16 19:30:42 +08:00
Anish Sarkar
929035f802 Merge remote-tracking branch 'upstream/main' into feature/elasticsearch-connector 2025-10-16 16:24:37 +05:30
DESKTOP-RTLN3BA\$punk
70b547c9c9 chore: updated docs & refactored sst_service.py 2025-10-15 14:31:38 -07:00
Rohan Verma
5ed9aa2b0b
Merge pull request #387 from nabthebest135/local-stt
local STT implementation with Faster-Whisper
2025-10-15 14:08:09 -07:00
DESKTOP-RTLN3BA\$punk
31982cea9a chore: removed content trunking for better UI 2025-10-14 14:19:48 -07:00
DESKTOP-RTLN3BA\$punk
ba5bb91a7b chore: removed chinese comments to pass ruff checks and updated migration nos 2025-10-13 20:07:32 -07:00
Rohan Verma
c99469bfdf
Merge pull request #391 from unitagain/feature/chinese-llm-support
feat: add Chinese LLM providers support with auto-fill API Base URL
2025-10-13 19:52:21 -07:00
DESKTOP-RTLN3BA\$punk
576dc19260 refactor: updated SearxNG connector migration and fixed validation for SearxNG host URL 2025-10-13 13:57:58 -07:00
Aki-07
ff08daccb1 fix: restore Tavily search and tighten SearxNG config 2025-10-12 21:29:12 +05:30
Aki-07
020c5ed04e feat(back): add SearxNG search integration 2025-10-12 20:44:00 +05:30
Differ
917cf4f398 feat: add Chinese LLM providers support with auto-fill API Base URL
- Add support for DeepSeek, Qwen (Alibaba), Kimi (Moonshot), and GLM (Zhipu)
- Implement auto-fill API Base URL when selecting Chinese LLM providers
- Add smart validation and warnings for missing API endpoints
- Fix session state management in task logging service
- Add comprehensive Chinese setup documentation
- Add database migration for new LLM provider enums

Closes #383
2025-10-12 19:10:46 +08:00
Nabhan
cf0e265107 refactor: integrate local STT with existing upload flow
- Simplify STT_SERVICE config to local/MODEL_SIZE format
- Remove separate STT routes, integrate with document upload
- Add local STT support to audio file processing pipeline
- Remove React component, use existing upload interface
- Support both local Faster-Whisper and external STT services
- Tested with real speech: 99% accuracy, 2.87s processing
2025-10-12 10:50:55 +05:00
Anish Sarkar
55d752e3c8 feat: added elasticsearch connector 2025-10-12 09:39:04 +05:30
Nabhan
dad79674c8 Added local Speech-to-Text (STT) support using Faster-Whisper 2025-10-11 23:56:12 +05:00
DESKTOP-RTLN3BA\$punk
633ea3ac0f feat: moved LLMConfigs from User to SearchSpaces
- RBAC soon??
- Updated various services and routes to handle search space-specific LLM preferences.
- Modified frontend components to pass search space ID for LLM configuration management.
- Removed onboarding page and settings page as part of the refactor.
2025-10-10 00:50:29 -07:00
DESKTOP-RTLN3BA\$punk
aea09a5dad feat: Moved searchconnectors association from user to searchspace
- Need to move llm configs to searchspace
2025-10-08 21:13:01 -07:00
DESKTOP-RTLN3BA\$punk
6ebad8936c chore: updated litellm and langchain-litellm
- Fixed CometAPI map
2025-10-04 12:07:36 -07:00
TensorNull
d87773d0a6 feat: Added CometAPI to LLM providers list 2025-10-04 15:13:03 +08:00
DESKTOP-RTLN3BA\$punk
94367e4226 chore: linting and formatting 2025-09-28 22:26:26 -07:00
samkul-swe
9d2b808e66 Added Luma connector 2025-09-28 14:59:10 -07:00
Natsume Ryuhane
5c3ea68d8f
Added OpenRouter to provider list 2025-09-16 18:26:58 -07:00
Rohan Verma
662212d4e2
Merge pull request #295 from CREDO23/feature/airtable-connector
[Feature]  Add Airtable connector
2025-09-03 12:49:14 -07:00
DESKTOP-RTLN3BA\$punk
74aff69a73 fix: azure litellm 2025-08-26 18:07:03 -07:00
CREDO23
45d2c18c16 update airtable indexer 2025-08-26 19:17:46 +02:00
DESKTOP-RTLN3BA\$punk
cbc799b15c fix: fixed search scope switching duplicate sources.
- User Selected docs still need a fix.
2025-08-20 10:10:37 -07:00
DESKTOP-RTLN3BA\$punk
d804be5fb3 fix: Streaming Dulplicate Sources & Delete Search Space UI 2025-08-19 11:05:12 -07:00
CREDO23
e17d969087 add search google gmail connector service 2025-08-15 09:11:14 +02:00
DESKTOP-RTLN3BA\$punk
1b29310ae7 feat: Added Local TTS (Kokoro TTS) Support 2025-08-13 17:25:34 -07:00
CREDO23
edf46e4de1 update seach source connector schema 2025-08-03 12:16:40 +02:00
CREDO23
e96590ff86 fix ruff isues 2025-08-01 00:27:50 +02:00
CREDO23
9c2408d026 fix source generation for clickup tasks 2025-07-31 23:21:01 +02:00
CREDO23
9a98742f81 Add web implementation for clickup connector 2025-07-30 21:37:12 +02:00
CREDO23
8958970320 update the connector service 2025-07-30 21:32:33 +02:00
CREDO23
8e52a0b201 add relevant coderrabit suggestions 2025-07-27 14:03:39 +02:00