Commit graph

434 commits

Author SHA1 Message Date
Anish Sarkar
a11c95e30f feat: add last_login column to user table and update user login tracking 2026-03-08 18:24:29 +05:30
Anish Sarkar
f8b0e946ce chore: ran linting 2026-03-07 04:46:48 +05:30
Anish Sarkar
1a688c7161 feat: enhance notifications system by introducing category-based filtering for comments and status, improving user experience in the inbox and API interactions 2026-03-06 19:35:35 +05:30
Anish Sarkar
bd783cc2d0 feat: add filtering options for notifications by 'unread' and 'errors', enhancing user experience in the notifications list 2026-03-06 18:32:28 +05:30
Anish Sarkar
d03f938fcd feat: implement source type filtering in notifications API and UI, enhancing user experience by allowing users to filter notifications by connector and document types in the status tab 2026-03-06 17:25:07 +05:30
Anish Sarkar
dc6c18b3f6 refactor: add sorting functionality to document retrieval and enhance DocumentsSidebar for improved search and pagination handling 2026-03-06 11:22:33 +05:30
DESKTOP-RTLN3BA\$punk
ecb0a25cc8 feat: enhance memory management and session handling in database operations
- Introduced a shielded async session context manager to ensure safe session closure during cancellations.
- Updated various database operations to utilize the new shielded session, preventing orphaned connections.
- Added environment variables to optimize glibc memory management, improving overall application performance.
- Implemented a function to trim the native heap, allowing for better memory reclamation on Linux systems.
2026-02-28 23:59:28 -08:00
DESKTOP-RTLN3BA\$punk
dd3da2bc36 refactor: improve session management and cleanup in chat streaming
- Added proper session closure to prevent connection leaks during streaming.
- Implemented a fresh session for cleanup tasks to ensure data integrity.
- Enhanced error handling during session operations to improve robustness.
- Removed unnecessary session parameters from function signatures for clarity.
2026-02-28 23:17:11 -08:00
DESKTOP-RTLN3BA\$punk
d959a6a6c8 feat: optimize document upload process and enhance memory management
- Increased maximum file upload limit from 10 to 50 to improve user experience.
- Implemented batch processing for document uploads to avoid proxy timeouts, splitting files into manageable chunks.
- Enhanced garbage collection in chat streaming functions to prevent memory leaks and improve performance.
- Added memory delta tracking in system snapshots for better monitoring of resource usage.
- Updated LLM router and service configurations to prevent unbounded internal accumulation and improve efficiency.
2026-02-28 17:22:34 -08:00
DESKTOP-RTLN3BA\$punk
0e723a5b8b feat: perf optimizations
- improved search_knowledgebase_tool
- Added new endpoint to batch-fetch comments for multiple messages, reducing the number of API calls.
- Introduced CommentBatchRequest and CommentBatchResponse schemas for handling batch requests and responses.
- Updated chat_comments_service to validate message existence and permissions before fetching comments.
- Enhanced frontend with useBatchCommentsPreload hook to optimize comment loading for assistant messages.
2026-02-27 17:19:25 -08:00
DESKTOP-RTLN3BA\$punk
6f4bf11a32 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-02-26 18:25:05 -08:00
DESKTOP-RTLN3BA\$punk
e9892c8fe9 feat: added configable summary calculation and various improvements
- Replaced direct embedding calls with a utility function across various components to streamline embedding logic.
- Added enable_summary flag to several models and routes to control summary generation behavior.
2026-02-26 18:24:57 -08:00
Rohan Verma
2f08dc9cf4
Merge pull request #839 from AnishSarkar22/feat/document-test
fix: enhanced document upload, page limit, upload limit tests
2026-02-26 13:48:45 -08:00
DESKTOP-RTLN3BA\$punk
23f553ef84 Merge branch 'dev' of https://github.com/MODSetter/SurfSense into dev 2026-02-26 13:01:24 -08:00
DESKTOP-RTLN3BA\$punk
aabc24f82c feat: enhance performance logging and caching in various components
- Introduced slow callback logging in FastAPI to identify blocking calls.
- Added performance logging for agent creation and tool loading processes.
- Implemented caching for MCP tools to reduce redundant server calls.
- Enhanced sandbox management with in-process caching for improved efficiency.
- Refactored several functions for better readability and performance tracking.
- Updated tests to ensure proper functionality of new features and optimizations.
2026-02-26 13:00:31 -08:00
Anish Sarkar
3393e435f9 feat: implement task dispatcher for document processing
- Introduced a TaskDispatcher abstraction to decouple the upload endpoint from Celery, allowing for easier testing with synchronous implementations.
- Updated the create_documents_file_upload function to utilize the new dispatcher for task management.
- Removed direct Celery task imports from the upload function, enhancing modularity.
- Added integration tests for document upload, including page limit enforcement and file size restrictions.
2026-02-26 23:55:47 +05:30
Anish Sarkar
9ccee054a5 chore: ran linting 2026-02-26 03:05:20 +05:30
Anish Sarkar
f59a70f7a5 Merge remote-tracking branch 'upstream/dev' into feat/document-test 2026-02-26 02:22:10 +05:30
DESKTOP-RTLN3BA\$punk
54dd6f904c feat: implement local file persistence for Daytona sandboxes
- Added functionality to persist sandbox files locally before deletion.
- Introduced methods for retrieving and deleting locally stored sandbox files.
- Updated routes to handle local file downloads and background deletion of sandboxes.
- Enhanced streaming tasks to support sandbox file management.
2026-02-25 12:25:59 -08:00
Anish Sarkar
a57ab02900 feat: Implement file upload limits and page limit enforcement in backend
- Added constants for maximum files per upload, per-file size, and total upload size.
- Enhanced document upload route to validate file counts and sizes, returning appropriate HTTP errors.
- Introduced end-to-end tests for upload limits and page limit enforcement, ensuring correct behavior under various scenarios.
- Updated test helpers to support notification retrieval for page limit exceeded scenarios.
2026-02-26 01:25:34 +05:30
DESKTOP-RTLN3BA\$punk
d198c8b89d chore; linting 2026-02-25 01:50:28 -08:00
DESKTOP-RTLN3BA\$punk
d570cae3c6 feat: added file handling for daytona sandboxes
- Added _TimeoutAwareSandbox class to handle per-command timeouts in DaytonaSandbox.
- Updated _find_or_create function to manage sandbox states and restart stopped/archived sandboxes.
- Enhanced get_or_create_sandbox to return the new sandbox class.
- Introduced file download functionality in the frontend, allowing users to download generated files from the sandbox.
- Updated system prompt to include guidelines for sharing generated files.
2026-02-25 01:36:30 -08:00
Rohan Verma
d0ee8b12b6
Merge pull request #834 from CREDO23/google-drive-hitl
[Feature] Add human in the loop for google drive sensitive actions (create:docs,sheets & delete)
2026-02-24 16:34:25 -08:00
CREDO23
24aa7c51a4 use return_url to redirect back after google drive reauth 2026-02-24 12:38:52 +02:00
CREDO23
257fa8c9b3 pass thread_id through reauth state to restore chat after oauth 2026-02-23 22:06:21 +02:00
CREDO23
5036809ee3 misc updates 2026-02-23 21:56:19 +02:00
CREDO23
7b7c7bff86 add google drive reauth endpoint and update callback 2026-02-23 21:50:50 +02:00
CREDO23
04daf0de71 upgrade google drive oauth scope to drive 2026-02-23 16:24:59 +02:00
Anish Sarkar
f3652ad7cf feat: add created_by_email field to document schema and update related components for improved user information display 2026-02-21 23:41:00 +05:30
DESKTOP-RTLN3BA\$punk
08c75127f1 feat: update migration to skip blocknode conversion and update transaction handling in chat routes 2026-02-20 22:43:25 -08:00
DESKTOP-RTLN3BA\$punk
a3cd598e01 feat: added improved llm model selector 2026-02-20 14:28:01 -08:00
Anish Sarkar
a482cc95de chore: ran linting 2026-02-17 12:47:39 +05:30
Anish Sarkar
8b497da130 feat: add source_markdown column to documents and implement migration logic for existing records using a pure-Python BlockNote JSON to Markdown converter 2026-02-17 11:34:11 +05:30
Anish Sarkar
f2a2872995 Merge remote-tracking branch 'upstream/dev' into fix/ui 2026-02-17 03:58:57 +05:30
DESKTOP-RTLN3BA\$punk
1849b451a5 feat: update Celery worker configuration and improve connector deletion process
- Added support for multiple queues in Celery worker configuration.
- Modified connector deletion to handle documents inline instead of using a background task.
- Updated response messages for document creation and connector deletion to reflect new processing status.
- Removed the obsolete connector deletion Celery task file.
2026-02-16 00:07:23 -08:00
DESKTOP-RTLN3BA\$punk
b9159a8329 feat: fixed bugs 2026-02-15 23:36:20 -08:00
Anish Sarkar
1995fe9ec1 feat: add report content update endpoint and integrate Platejs editor for markdown editing 2026-02-16 00:11:34 +05:30
Anish Sarkar
ed28439246 Merge remote-tracking branch 'upstream/dev' into feat/report-artifact 2026-02-14 19:12:01 +05:30
Anish Sarkar
2755c0d7c0 chore: update uv.lock and ran linting 2026-02-14 19:09:45 +05:30
Anish Sarkar
8746051670 feat: enhance system prompts to specify LaTeX notation for mathematical expressions 2026-02-14 14:28:47 +05:30
CREDO23
66a6fb685e Merge upstream/dev into feature/human-in-the-loop 2026-02-13 20:17:59 +02:00
DESKTOP-RTLN3BA\$punk
a8c1aa28c0 feat: remove pandoc and its respective engine dependencies 2026-02-13 01:34:43 -08:00
Anish Sarkar
a2dd5fb671 chore: ran linting 2026-02-13 02:43:26 +05:30
Anish Sarkar
3336626336 chore: update Dockerfiles to install Typst for PDF rendering and remove WeasyPrint dependencies 2026-02-12 15:57:35 +05:30
Anish Sarkar
a668219240 refactor: update report routes and improve export handling
- Revised report routes to clarify functionality for read, export, and delete operations.
- Enhanced the export process to run all blocking I/O in a thread executor, improving async performance.
- Updated error handling in the report panel to provide clearer feedback on loading failures.
2026-02-12 03:41:29 +05:30
Anish Sarkar
adeef35443 feat: add report versioning support with report_group_id 2026-02-12 03:19:38 +05:30
CREDO23
78127243e2 merge upstream/dev: add user_id to configs, provider icons, i18n 2026-02-11 20:05:00 +02:00
Anish Sarkar
e7a73d0570 feat: add report export capabilities with Pandoc and WeasyPrint support
- Updated Dockerfiles to include Pandoc and WeasyPrint runtime libraries for report generation.
- Enhanced report retrieval functionality to include version siblings in the response.
- Modified report export process to utilize WeasyPrint for PDF generation, improving output quality.
2026-02-11 23:24:51 +05:30
Anish Sarkar
e5626342fc feat: add public report content retrieval and enhance report handling 2026-02-11 22:07:31 +05:30
Anish Sarkar
acad8c6d2b feat: implement report generation tool and associated routes for CRUD operations
- Added a new tool for generating structured Markdown reports based on user input.
- Implemented routes for creating, reading, exporting, and deleting reports.
- Integrated report generation into the chat flow, allowing users to generate reports inline.
- Updated schemas to support report data structures and responses.
- Enhanced frontend components to handle report generation and display results.
2026-02-11 17:55:52 +05:30