Commit graph

174 commits

Author SHA1 Message Date
Anish Sarkar
5c598e8588 Merge remote-tracking branch 'upstream/dev' into feat/human-in-the-loop 2026-03-22 15:45:45 +05:30
DESKTOP-RTLN3BA\$punk
b28f135a96 feat: init video presentation agent 2026-03-21 22:13:41 -07:00
Anish Sarkar
d21593ee71 feat: unify handling of native and legacy document types for Google connectors
- Introduced a mapping of native Google document types to their legacy Composio equivalents, ensuring seamless search and indexing for both types.
- Updated relevant components to utilize the new mapping, enhancing the consistency of document type handling across the application.
- Improved search functionality to transparently include legacy types, maintaining accessibility for older documents until re-indexed.
2026-03-20 03:41:32 +05:30
PR Bot
760aa38225 feat: complete MiniMax LLM provider integration
Add full MiniMax provider support across the entire stack:

Backend:
- Add MINIMAX to LiteLLMProvider enum in db.py
- Add MINIMAX mapping to all provider_map dicts in llm_service.py,
  llm_router_service.py, and llm_config.py
- Add Alembic migration (rev 106) for PostgreSQL enum
- Add MiniMax M2.5 example in global_llm_config.example.yaml

Frontend:
- Add MiniMax to LLM_PROVIDERS enum with apiBase
- Add MiniMax-M2.5 and MiniMax-M2.5-highspeed to LLM_MODELS
- Add MINIMAX to Zod validation schema
- Add MiniMax SVG icon and wire up in provider-icons

Docs:
- Add MiniMax setup guide in chinese-llm-setup.md

MiniMax uses an OpenAI-compatible API (https://api.minimax.io/v1)
with models supporting up to 204K context window.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 07:27:47 +08:00
DESKTOP-RTLN3BA\$punk
d8a05ae4d5 feat: refactor agent tools management and add UI integration
- Added endpoint to list agent tools with metadata, excluding hidden tools.
- Updated NewChatRequest and RegenerateRequest schemas to include disabled tools.
- Integrated disabled tools management in the NewChatPage and Composer components.
- Improved tool instructions and visibility in the system prompt.
- Refactored tool registration to support hidden tools and default enabled states.
- Enhanced document chunk creation to handle strict zip behavior.
- Cleaned up imports and formatting across various files for consistency.
2026-03-10 17:36:26 -07:00
Rohan Verma
547077e5b9
Merge pull request #865 from CREDO23/sur-182-fix-ux-experience-for-composio-google-drive-connector
[Perf] Batch embedding, non-blocking search, chunks index & Google Drive UX fix
2026-03-10 12:52:16 -07:00
DESKTOP-RTLN3BA\$punk
403097646d feat: implement batch unread counts for notifications to reduce API calls and improve performance 2026-03-10 01:26:37 -07:00
CREDO23
fffef4cb5e perf: add missing index on chunks.document_id for faster search retrieval 2026-03-09 21:16:53 +02:00
Anish Sarkar
a11c95e30f feat: add last_login column to user table and update user login tracking 2026-03-08 18:24:29 +05:30
DESKTOP-RTLN3BA\$punk
ecb0a25cc8 feat: enhance memory management and session handling in database operations
- Introduced a shielded async session context manager to ensure safe session closure during cancellations.
- Updated various database operations to utilize the new shielded session, preventing orphaned connections.
- Added environment variables to optimize glibc memory management, improving overall application performance.
- Implemented a function to trim the native heap, allowing for better memory reclamation on Linux systems.
2026-02-28 23:59:28 -08:00
DESKTOP-RTLN3BA\$punk
d959a6a6c8 feat: optimize document upload process and enhance memory management
- Increased maximum file upload limit from 10 to 50 to improve user experience.
- Implemented batch processing for document uploads to avoid proxy timeouts, splitting files into manageable chunks.
- Enhanced garbage collection in chat streaming functions to prevent memory leaks and improve performance.
- Added memory delta tracking in system snapshots for better monitoring of resource usage.
- Updated LLM router and service configurations to prevent unbounded internal accumulation and improve efficiency.
2026-02-28 17:22:34 -08:00
DESKTOP-RTLN3BA\$punk
e9892c8fe9 feat: added configable summary calculation and various improvements
- Replaced direct embedding calls with a utility function across various components to streamline embedding logic.
- Added enable_summary flag to several models and routes to control summary generation behavior.
2026-02-26 18:24:57 -08:00
Anish Sarkar
8b497da130 feat: add source_markdown column to documents and implement migration logic for existing records using a pure-Python BlockNote JSON to Markdown converter 2026-02-17 11:34:11 +05:30
Anish Sarkar
a2dd5fb671 chore: ran linting 2026-02-13 02:43:26 +05:30
Anish Sarkar
adeef35443 feat: add report versioning support with report_group_id 2026-02-12 03:19:38 +05:30
Anish Sarkar
6fc5dc224b refactor: remove report_status enum and related index from reports table migration 2026-02-11 17:45:07 +05:30
Anish Sarkar
b6c0406d10 feat: add reports table and report status enum for generated Markdown reports 2026-02-11 16:28:56 +05:30
Anish Sarkar
fc64f65876 Merge remote-tracking branch 'upstream/dev' into feat/sur-159 2026-02-11 03:47:51 +05:30
DESKTOP-RTLN3BA\$punk
d152605682 fix: update pages reward for incentive tasks
- Reduced the pages reward for GitHub and Reddit tasks from 100 to 30.
- Adjusted the pages reward for the Discord task from 100 to 40.
2026-02-09 17:46:41 -08:00
Rohan Verma
dcd1497630
Merge pull request #802 from CREDO23/sur-161-feat-add-github-models-as-llm-provider
[Improvements] Add GitHub models as llm provider
2026-02-09 15:07:40 -08:00
CREDO23
515be6b648 Add GITHUB_MODELS to LiteLLMProvider enum 2026-02-09 17:26:35 +02:00
Anish Sarkar
4b60068e8b feat: add user_id to new_llm_configs and image_generation_configs for user association 2026-02-09 18:30:52 +05:30
CREDO23
474989687c feat: conditionnaly build the system prompt (private / shared) memory 2026-02-09 09:19:44 +02:00
CREDO23
f537dc211b Add shared_memory backend (constants + helpers), UserMemory docstring (SUR-152) 2026-02-06 16:43:52 +02:00
CREDO23
9acf746698 Add SharedMemory ORM and SearchSpace.shared_memories (SUR-152) 2026-02-06 16:33:12 +02:00
Anish Sarkar
0fdd194d92 Merge remote-tracking branch 'upstream/dev' into fix/documents 2026-02-06 12:13:26 +05:30
DESKTOP-RTLN3BA\$punk
f85adefe5e chore: made generate_image more agnostic 2026-02-05 17:18:27 -08:00
DESKTOP-RTLN3BA\$punk
19e2857343 feat: added image gen support 2026-02-05 16:43:48 -08:00
Anish Sarkar
c132e5ddb0 Merge remote-tracking branch 'upstream/dev' into fix/documents 2026-02-06 05:36:32 +05:30
Anish Sarkar
aa66928154 chore: ran linting 2026-02-06 05:35:15 +05:30
Anish Sarkar
aef59d04eb feat: add document status management with JSONB column for processing states in documents 2026-02-05 21:59:31 +05:30
CREDO23
9bd7d74755 Add RefreshToken model and multi-session refresh token logic 2026-02-05 16:49:37 +02:00
CREDO23
04aac379ed Add RefreshToken model for user session management 2026-02-05 16:18:45 +02:00
DESKTOP-RTLN3BA\$punk
5cb59bbde8 feat: add new incentive task type for Discord 2026-02-03 22:32:39 -08:00
CREDO23
60330622bf Merge remote-tracking branch 'upstream/dev' into dev 2026-02-03 14:24:24 +02:00
CREDO23
17c7b34e44 feat: add public_sharing permissions 2026-02-02 14:09:28 +02:00
Anish Sarkar
bf08982029 feat: add connector_id to documents for source tracking and implement connector deletion task 2026-02-02 16:23:26 +05:30
Anish Sarkar
87c0d78bf6 Merge remote-tracking branch 'upstream/dev' into fix/documents 2026-02-02 13:04:08 +05:30
Anish Sarkar
e0ade20e68 feat: add created_by_id column to documents for ownership tracking and update related connectors 2026-02-02 12:32:24 +05:30
DESKTOP-RTLN3BA\$punk
8fb5a7fb8f chore: linting 2026-02-01 21:17:24 -08:00
CREDO23
f2a607300d Merge remote-tracking branch 'upstream/dev' into sur-127-impr-public-chats-should-be-immutable 2026-02-01 14:23:20 +02:00
CREDO23
bc0fb3cb68 feat: track cloned_from_snapshot_id for cloned chats 2026-01-30 17:08:07 +02:00
DESKTOP-RTLN3BA\$punk
6fb656fd8f hotpatch(cloud): add llm load balancing 2026-01-29 15:28:31 -08:00
CREDO23
439b1547af refactor: add PublicChatSnapshot model, remove deprecated public share columns 2026-01-29 16:05:36 +02:00
DESKTOP-RTLN3BA\$punk
16b839138d feat(backend): add new incentive task type for Reddit follow
Introduce a new incentive task type, REDDIT_FOLLOW, to encourage users to join the SurfSense community on Reddit. This includes a title, description, pages reward, and action URL for the task.
2026-01-28 21:58:49 -08:00
CREDO23
0c8d1f3fef refactor(backend): two-phase synchronous cloning 2026-01-28 00:17:29 +02:00
CREDO23
0fbf5d5bdd fix: podcast status enum serialization and frontend polling 2026-01-27 19:07:46 +02:00
CREDO23
87c7d92672 feat: add podcast status tracking 2026-01-27 17:51:36 +02:00
CREDO23
3c40c6e365 feat: add clone tracking and history bootstrap for cloned chats 2026-01-27 13:33:36 +02:00
CREDO23
a7145b2c63 merge: upstream/dev with migration renumbering 2026-01-27 11:22:26 +02:00