Commit graph

712 commits

Author SHA1 Message Date
Rohan Verma
26ef83fbaa
Merge pull request #707 from AnishSarkar22/fix/mentions
feat: Revamped search in document mentions
2026-01-18 22:15:28 -08:00
Rohan Verma
87a174a1fd
Merge pull request #706 from AnishSarkar22/fix/drive-index
feat: enhance Google Drive indexing
2026-01-18 22:15:03 -08:00
Anish Sarkar
8654c98afe chore: update redundant comments 2026-01-18 20:13:51 +05:30
Manoj Aggarwal
f78c2a685e add error handling to mcp_tool python files 2026-01-17 09:18:46 -08:00
Anish Sarkar
293de6876a feat: implement fuzzy search in mention document 2026-01-17 20:46:47 +05:30
Anish Sarkar
b001b65067 feat: add pg_trgm indexes and lightweight document title search
- Introduced pg_trgm extension and GIN trigram indexes for efficient document title searches, enhancing performance for mention picker functionality.
- Implemented a new API endpoint for lightweight document title searches, returning only essential fields.
- Updated frontend components to utilize the new title search feature with throttling for improved user experience.
- Added necessary schemas and types for the new search functionality.
2026-01-17 20:45:10 +05:30
Anish Sarkar
e0be1b9133 chore: ran backend and frontend linting 2026-01-17 16:30:07 +05:30
Anish Sarkar
f538d59ca3 feat: enhance Google Drive file metadata handling
- Updated Google Drive API calls to include md5Checksum in file metadata retrieval for improved content tracking.
- Added logic to check for rename-only updates based on md5Checksum, optimizing document processing by preventing unnecessary ETL operations for unchanged content.
- Enhanced existing document update logic to handle renaming and metadata updates more effectively, particularly for Google Drive files.
2026-01-17 16:24:53 +05:30
Anish Sarkar
49efc50767 feat: enhance document processing with content hash deduplication
- Added support for content hash fallback in document migration to prevent duplicate entries from different sources.
- Improved existing document update logic to handle renaming and metadata updates more effectively, particularly for Google Drive files.
- Updated functions to check for existing documents with enhanced logging for better traceability of duplicate content detection.
2026-01-17 15:39:36 +05:30
Anish Sarkar
6550c378b2 feat: enhance Google Drive document handling and UI integration
- Implemented support for both new file_id-based and legacy filename-based hash schemes in document processing.
- Added functions to generate unique identifier hashes and find existing documents with migration support.
- Improved existing document update logic to handle content changes and metadata updates, particularly for Google Drive files.
- Enhanced UI components to display appropriate file icons based on file types in the Google Drive connector.
- Updated document processing functions to accommodate the new connector structure and ensure seamless integration.
2026-01-17 14:57:31 +05:30
Anish Sarkar
7af3d1bc1a feat: improve Google Drive connector handling and UI feedback
- Added logic to refresh connector and notification attributes after indexing to ensure up-to-date information.
- Enhanced periodic sync configuration to disable the option when no folders or files are selected for Google Drive, providing user feedback through a message.
- Updated the connector edit view to reflect the new disabled state for periodic sync based on selected items.
- Implemented validation in the connector dialog to prevent enabling periodic sync without selected items, improving user experience.
2026-01-17 12:59:18 +05:30
Anish Sarkar
a3112a24fe feat: enhance Google Drive indexing with new options
- Updated the Google Drive indexing functionality to include indexing options such as max files per folder, incremental sync, and inclusion of subfolders.
- Modified the API to accept a new 'indexing_options' parameter in the request body.
- Enhanced the UI to allow users to configure these options when selecting folders and files for indexing.
- Updated related components and tasks to support the new indexing options, ensuring a more flexible and efficient indexing process.
2026-01-17 12:33:57 +05:30
Manoj Aggarwal
11b160cee9 resolve conflicts 2026-01-16 15:39:57 -08:00
Manoj Aggarwal
4c07c0fe4f change the flow of mcp connectors 2026-01-16 14:39:44 -08:00
DESKTOP-RTLN3BA\$punk
8aad15d392 Reapply "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 3418c0e026.
2026-01-16 11:32:06 -08:00
Manoj Aggarwal
08366b14bb some reverts 2026-01-16 11:26:28 -08:00
Manoj Aggarwal
c97a3c1ab6 some reverts 2026-01-16 11:25:47 -08:00
Manoj Aggarwal
aa90da602b nit 2026-01-16 11:21:01 -08:00
Manoj Aggarwal
16f79aa88b fix migrations 2026-01-16 11:00:20 -08:00
DESKTOP-RTLN3BA\$punk
3418c0e026 Revert "Merge pull request #686 from AnishSarkar22/feat/replace-logs"
This reverts commit 5963a1125e, reversing
changes made to 0d2a2f8ea1.
2026-01-16 00:49:33 -08:00
Anish Sarkar
eb1f39b365 fix: run automatic alembic migrations for docker-compose 2026-01-15 19:58:26 +05:30
Anish Sarkar
28aa4814bd refactor: improve chat UI and greeting logic
- Simplified chat document processing display by removing the book emoji for a cleaner look.
- Enhanced the greeting function to prioritize user display names over email for a more personalized experience.
- Adjusted the ChatShareButton component by removing unused imports and unnecessary elements for better clarity and performance.
- Updated the title in the Electric SQL documentation for conciseness.
2026-01-15 18:29:30 +05:30
Anish Sarkar
b9dc785a1c chore: ran frontend and backend linting 2026-01-15 15:55:27 +05:30
Anish Sarkar
ab63b23f0a Merge remote-tracking branch 'upstream/dev' into feat/replace-logs 2026-01-15 15:52:47 +05:30
DESKTOP-RTLN3BA\$punk
69e9b6a027 chore: update uv lock 2026-01-15 00:08:52 -08:00
DESKTOP-RTLN3BA\$punk
7ae68455b3 chore: linting 2026-01-15 00:05:53 -08:00
Anish Sarkar
35392c8e62 fix: made migartion idempotent and fixed docker-compose 2026-01-15 13:26:23 +05:30
DESKTOP-RTLN3BA\$punk
bab89274e0 feat: implement LlamaCloud parsing with retry logic for transient errors 2026-01-14 23:53:17 -08:00
Anish Sarkar
32b8bb33f9 feat: add notifications table and configure Electric SQL replication
- Created a new notifications table with necessary fields and indexes.
- Set up Electric SQL replication for notifications, search_source_connectors, and documents tables.
- Implemented idempotent checks for user and publication creation in the migration script.
2026-01-15 11:22:12 +05:30
Anish Sarkar
f7f11877ce Merge remote-tracking branch 'upstream/dev' into feat/replace-logs 2026-01-15 11:05:45 +05:30
DESKTOP-RTLN3BA\$punk
bff37789c8 fix: migrations 2026-01-14 15:19:00 -08:00
Anish Sarkar
94e65129cd chore: ran backend linting 2026-01-15 04:26:34 +05:30
Manoj Aggarwal
c78ea98a68 Add front end logic for MCP connectors 2026-01-14 14:01:23 -08:00
Anish Sarkar
31a5581af1 feat: add notifications table and Electric SQL replication setup
- Introduced a new notifications table with relevant fields and indexes.
- Configured Electric SQL replication for the notifications, search_source_connectors, and documents tables.
- Centralized Electric SQL user credentials in the migration script for better management.
- Ensured idempotency in the migration process for creating users and publications.
2026-01-15 03:28:10 +05:30
Anish Sarkar
2e0f742000 Merge remote-tracking branch 'upstream/dev' into feat/replace-logs 2026-01-15 03:07:20 +05:30
Anish Sarkar
e28be9d78c feat: centralize Electric SQL user credentials in configuration
- Added centralized configuration for Electric SQL user credentials in env.py.
- Updated migration script to utilize these credentials for creating and granting permissions to the Electric SQL user.
2026-01-15 03:03:34 +05:30
Rohan Verma
f3f52170a0
Merge pull request #697 from CREDO23/implement-surfsense-docs-mentions
[Feat] Capture Google profile data, add user profile settings & document mentions picker improvements
2026-01-14 13:19:10 -08:00
Rohan Verma
4fb9017eac
Merge pull request #693 from manojag115/feat/mcp-connector-backend
Add backend code for adding MCPs as a connector
2026-01-14 13:18:12 -08:00
Anish Sarkar
7a9a14aa66 feat: fixed migration for electric-sql 2026-01-14 23:23:45 +05:30
CREDO23
83d6b735fa display user avatar in shared chat messages 2026-01-14 19:46:37 +02:00
CREDO23
a8918b9cca include author info in message response 2026-01-14 18:36:48 +02:00
CREDO23
e9d164007d save author_id when appending message 2026-01-14 18:29:19 +02:00
CREDO23
468feae592 add author fields to NewChatMessageRead schema 2026-01-14 18:27:21 +02:00
CREDO23
efcc394b0c migration: add author_id to messages 2026-01-14 18:24:28 +02:00
CREDO23
d89bcf13c3 add author_id to NewChatMessage model 2026-01-14 17:56:45 +02:00
CREDO23
924e621a6b feat: add migration 0 for initial schema setup 2026-01-14 17:04:37 +02:00
CREDO23
3ad2dbeeaf fix: fetch Google profile with names,photos fields 2026-01-14 15:05:48 +02:00
CREDO23
87e1374c72 add profile fields to UserRead and UserUpdate 2026-01-14 14:37:50 +02:00
CREDO23
acb9ba5a88 capture Google profile in oauth_callback 2026-01-14 14:37:42 +02:00
CREDO23
2e2534ccac migration: add user profile columns 2026-01-14 14:37:29 +02:00