Commit graph

1339 commits

Author SHA1 Message Date
Anish Sarkar
ac0f2fa2eb chore: ran linting 2026-03-17 04:40:46 +05:30
Anish Sarkar
993c8539e8 feat: update UI components to utilize new main panel styling
- Replaced background styles with `bg-main-panel` in various components for consistent theming.
- Enhanced the `Header`, `LayoutShell`, and `Thread` components to improve visual coherence.
- Adjusted tool management UI to reflect new design standards, ensuring a unified user experience.
2026-03-17 01:09:15 +05:30
Anish Sarkar
60d12b0a70 Merge remote-tracking branch 'upstream/dev' into feat/web-search 2026-03-16 19:34:38 +05:30
Tim Ren
0269900c60 fix: use asyncio.to_thread for embedding calls in search endpoints
Wrap synchronous embedding_model.embed() calls with asyncio.to_thread()
in both vector_search and hybrid_search methods. This prevents blocking
the asyncio event loop during embedding computation, improving server
responsiveness under concurrent load.

Fixes #794

Signed-off-by: Tim Ren <137012659+xr843@users.noreply.github.com>
2026-03-15 16:21:19 +08:00
Rohan Verma
ee07ed8168
Merge pull request #883 from octo-patch/feat/complete-minimax-provider-support
feat: add MiniMax LLM provider support
2026-03-15 00:45:16 -07:00
DESKTOP-RTLN3BA\$punk
2b33dfe728 refactor: update safe_set_chunks function to be asynchronous and modify all connector and document processor files to use the new async implementation 2026-03-15 00:44:27 -07:00
Anish Sarkar
b22fe012d5 feat: enhance search_web functionality and clarify connector usage
- modify the `web_search` tool that integrates multiple live search connectors (Tavily, Linkup, Baidu) alongside the SearXNG platform for real-time information retrieval.
- Updated comments to reflect the separation of local knowledge base searches from web searches.
- Improved handling of connector types and search logic to ensure accurate routing of queries to the appropriate tools.
- Refactored existing code to streamline the search process and enhance performance.
2026-03-15 04:45:39 +05:30
Anish Sarkar
c1fe95939f refactor: remove legacy SearXNG API references and web search settings
- Deleted the migration script for adding web search columns to the database.
- Removed web search related fields from the SearchSpace model and schemas.
- Eliminated web search health check endpoint and associated service logic.
- Updated frontend components to remove web search settings management.
- Cleaned up references to SearXNG API in various modules, transitioning to a platform service approach.
2026-03-15 03:49:37 +05:30
Anish Sarkar
cc841a5af4 chore: update SearXNG engine settings and example configuration 2026-03-14 21:27:09 +05:30
Anish Sarkar
4376f74127 chore: update SearXNG service configuration in Docker and documentation
- Updated SearXNG image version to 2026.3.13-3c1f68c59 in the Docker Compose file.
- Added port mapping for SearXNG service to allow access on a configurable port.
- Enhanced the .env.example file with comments for SearXNG configuration and usage instructions.
2026-03-14 21:03:25 +05:30
Anish Sarkar
d9e312ddaa refactor: simplify SearXNG service configuration in Docker setup
- Consolidated volume mappings for SearXNG to use a single directory.
- Removed unnecessary port mappings and legacy data volume definitions.
- Updated web search service documentation to clarify Redis usage and circuit breaker implementation, eliminating Redis dependency for circuit breaker logic.
2026-03-14 20:34:34 +05:30
Anish Sarkar
d40c6bf743 feat: integrate SearXNG web search service with platform capabilities
- Added SearXNG service configuration to Docker setup, including environment variables and health checks.
- Introduced new settings management for web search in the frontend, allowing users to enable/disable and configure search engines and language preferences.
- Updated backend to support web search functionality, including database schema changes and service integration.
- Implemented health check endpoint for the web search service and integrated it into the application.
- Removed legacy SearXNG API connector references in favor of the new platform service approach.
2026-03-14 20:25:25 +05:30
PR Bot
760aa38225 feat: complete MiniMax LLM provider integration
Add full MiniMax provider support across the entire stack:

Backend:
- Add MINIMAX to LiteLLMProvider enum in db.py
- Add MINIMAX mapping to all provider_map dicts in llm_service.py,
  llm_router_service.py, and llm_config.py
- Add Alembic migration (rev 106) for PostgreSQL enum
- Add MiniMax M2.5 example in global_llm_config.example.yaml

Frontend:
- Add MiniMax to LLM_PROVIDERS enum with apiBase
- Add MiniMax-M2.5 and MiniMax-M2.5-highspeed to LLM_MODELS
- Add MINIMAX to Zod validation schema
- Add MiniMax SVG icon and wire up in provider-icons

Docs:
- Add MiniMax setup guide in chinese-llm-setup.md

MiniMax uses an OpenAI-compatible API (https://api.minimax.io/v1)
with models supporting up to 204K context window.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 07:27:47 +08:00
DESKTOP-RTLN3BA\$punk
d61e29e74b feat: fixed connectors dialog navigation, Implement bulk document deletion and improve search space filtering
- Added bulk delete functionality for documents in DocumentsTableShell and DocumentsSidebar.
- Enhanced search space retrieval to exclude spaces marked for deletion in read_search_spaces.
- Updated connector dialog to synchronize URL parameters when opened externally.
- Improved layout behavior to handle search space deletion and redirection more effectively.
2026-03-11 15:09:10 -07:00
Anish Sarkar
851856a54b fix: update document cleanup logic and mock Celery task in tests 2026-03-11 12:27:32 +05:30
DESKTOP-RTLN3BA\$punk
eec4db4a3b feat: Enhance LLM configuration and routing with model profile attachment
- Added `_attach_model_profile` function to attach model context metadata to `ChatLiteLLM`.
- Updated `create_chat_litellm_from_config` and `create_chat_litellm_from_agent_config` to utilize the new profile attachment.
- Improved context profile caching in `llm_router_service.py` to include both minimum and maximum input tokens, along with token model names for better context management.
- Introduced new methods for token counting and context trimming based on model profiles.
2026-03-10 18:18:59 -07:00
DESKTOP-RTLN3BA\$punk
d8a05ae4d5 feat: refactor agent tools management and add UI integration
- Added endpoint to list agent tools with metadata, excluding hidden tools.
- Updated NewChatRequest and RegenerateRequest schemas to include disabled tools.
- Integrated disabled tools management in the NewChatPage and Composer components.
- Improved tool instructions and visibility in the system prompt.
- Refactored tool registration to support hidden tools and default enabled states.
- Enhanced document chunk creation to handle strict zip behavior.
- Cleaned up imports and formatting across various files for consistency.
2026-03-10 17:36:26 -07:00
CREDO23
89ed845dcd merge upstream/dev into improve-ux-connectors
Resolve 3 conflicts:
- connector-popup.tsx: keep Picker modal coordination (pickerOpen state)
- google-drive-config.tsx: keep Google Picker, discard upstream folder tree
- composio-drive-config.tsx: accept upstream collapsible folder tree UX
2026-03-10 23:40:04 +02:00
CREDO23
cf8f70da2b fix auth bypass on picker endpoint, async safety, and picker error handling
- Add check_permission to drive-picker-token endpoint (IDOR fix)
- Use get_composio_service singleton + asyncio.to_thread to avoid blocking the event loop
- Sanitize error detail in 500 response to prevent internal info leakage
- Dispose picker on unmount to prevent orphaned overlay
- Surface error state on Google Picker Action.ERROR instead of silently closing
2026-03-10 23:21:35 +02:00
DESKTOP-RTLN3BA\$punk
001b2c9094 chore: remove unused dependencies 'mmdc' and 'phasma' from project configuration 2026-03-10 14:11:31 -07:00
DESKTOP-RTLN3BA\$punk
78384f1f11 refactor: correct alembic migration no 2026-03-10 12:54:42 -07:00
Rohan Verma
547077e5b9
Merge pull request #865 from CREDO23/sur-182-fix-ux-experience-for-composio-google-drive-connector
[Perf] Batch embedding, non-blocking search, chunks index & Google Drive UX fix
2026-03-10 12:52:16 -07:00
CREDO23
1e2c54eea6 add unified drive-picker-token endpoint and GOOGLE_PICKER_API_KEY config 2026-03-10 20:06:45 +02:00
CREDO23
0bb1b730dd fix Gmail HTML rendering: unwrap layout tables and use native img 2026-03-10 18:57:49 +02:00
DESKTOP-RTLN3BA\$punk
403097646d feat: implement batch unread counts for notifications to reduce API calls and improve performance 2026-03-10 01:26:37 -07:00
DESKTOP-RTLN3BA\$punk
45cc527d02 feat: update report generation and export capabilities to support multiple formats (PDF, DOCX, HTML, LaTeX, EPUB, ODT, plain text) across documentation and backend 2026-03-09 18:41:21 -07:00
DESKTOP-RTLN3BA\$punk
11b84a3fb4 feat: expand report export functionality to support multiple formats (PDF, DOCX, HTML, EPUB, etc.) and enhance UI for format selection 2026-03-09 18:31:14 -07:00
DESKTOP-RTLN3BA\$punk
c6fc4edbc2 feat: add YouTube video and playlist support in document collection with enhanced URL handling 2026-03-09 16:07:54 -07:00
Rohan Verma
192dc611c4
Merge pull request #863 from AnishSarkar22/feat/test-ci
feat: add GA CI pipeline for backend tests & few fixes
2026-03-09 12:58:56 -07:00
CREDO23
e951fbb991 fix: update stale embed_text mock in document_upload tests 2026-03-09 21:47:27 +02:00
CREDO23
fffef4cb5e perf: add missing index on chunks.document_id for faster search retrieval 2026-03-09 21:16:53 +02:00
CREDO23
6eabfe2396 perf: conditional batch embedding — batch for API, sequential for local 2026-03-09 19:12:43 +02:00
CREDO23
a49a4db6d6 perf: use asyncio.to_thread for embed_text in FastAPI paths 2026-03-09 16:33:24 +02:00
CREDO23
c4f2e9a3a5 feat: use batch embedding in create_document_chunks 2026-03-09 16:21:14 +02:00
CREDO23
929445afd9 feat: use batch embedding in IndexingPipelineService.index 2026-03-09 16:13:44 +02:00
CREDO23
cb4b155b9d feat: re-export embed_texts from document_embedder 2026-03-09 15:54:02 +02:00
CREDO23
15aeec1fcb feat: add embed_texts batch embedding utility 2026-03-09 15:53:40 +02:00
Anish Sarkar
e8cf677b25 refactor: update title generation logic to improve user experience by generating titles in parallel with assistant responses 2026-03-09 01:28:53 +05:30
Anish Sarkar
a11c95e30f feat: add last_login column to user table and update user login tracking 2026-03-08 18:24:29 +05:30
Anish Sarkar
8122370cec test: mark test_connector_document.py with unit pytest marker 2026-03-08 02:53:47 +05:30
Anish Sarkar
ca3710a239 fix: remove slowapi limiter for testing 2026-03-08 02:41:05 +05:30
Anish Sarkar
f8b0e946ce chore: ran linting 2026-03-07 04:46:48 +05:30
Anish Sarkar
2ea67c1764 Merge remote-tracking branch 'upstream/dev' into feat/document-revamp 2026-03-07 04:37:37 +05:30
Anish Sarkar
1a688c7161 feat: enhance notifications system by introducing category-based filtering for comments and status, improving user experience in the inbox and API interactions 2026-03-06 19:35:35 +05:30
Anish Sarkar
bd783cc2d0 feat: add filtering options for notifications by 'unread' and 'errors', enhancing user experience in the notifications list 2026-03-06 18:32:28 +05:30
Anish Sarkar
d03f938fcd feat: implement source type filtering in notifications API and UI, enhancing user experience by allowing users to filter notifications by connector and document types in the status tab 2026-03-06 17:25:07 +05:30
Anish Sarkar
dc6c18b3f6 refactor: add sorting functionality to document retrieval and enhance DocumentsSidebar for improved search and pagination handling 2026-03-06 11:22:33 +05:30
Rohan Verma
7b6f832483
Merge pull request #842 from AnishSarkar22/refactor/upload-document-adapter-class
refactor: Migrate document reindexing to `UploadDocumentAdapter` with unified indexing pipeline
2026-03-05 18:45:16 -08:00
DESKTOP-RTLN3BA\$punk
81fb1f327c fix: update LLM retrieval in podcast transcript creation to use agent LLM instead of document summary LLM 2026-03-03 13:35:29 -08:00
Rohan Verma
672b4e1808
Merge pull request #838 from AnishSarkar22/fix/docker
feat: docker-compose and docker CI pipeline enhancements
2026-03-02 13:54:27 -08:00