Commit graph

3377 commits

Author SHA1 Message Date
CREDO23
501d08f2f4 feat(routes): register Google Drive OAuth router 2025-12-28 15:55:38 +02:00
CREDO23
1696c7056a feat(indexer): add Google Drive folder indexing with delta sync
- Full folder scan on first index
- Delta sync using change tracking for subsequent indexes
- Process files in parallel batches
- Handle file additions, modifications, and deletions
- Store change tracking token for efficient re-indexing
2025-12-28 15:55:25 +02:00
CREDO23
bf02005d82 feat(routes): add Google Drive OAuth and folder listing endpoints
- OAuth initialization and callback handling
- Folder and file browsing with parent_id support
- Validate credentials and handle token refresh
- Return folder contents with metadata for UI tree view
2025-12-28 15:55:13 +02:00
CREDO23
3e67d5f31e feat(connectors): add Google Drive delta sync with change tracking
- Get start page token for change tracking baseline
- Fetch incremental changes using Google Drive Changes API
- Categorize changes into added, modified, and removed files
- Enable efficient re-indexing of only changed content
2025-12-28 15:55:06 +02:00
CREDO23
84bde67979 feat(connectors): add Google Drive folder browsing and file listing
- List folder contents with full pagination support
- Query root folder or specific parent folder
- Return both folders and files with metadata (size, icons, links)
- Filter out shortcuts and trashed items
2025-12-28 15:54:58 +02:00
CREDO23
40304c6795 feat(connectors): add Google Drive content extraction using existing ETL
- Download files from Google Drive to temporary location
- Export Google Workspace files as PDF
- Delegate content extraction to existing process_file_in_background
- Reuse Surfsense's ETL services (Unstructured, LlamaCloud, Docling)
2025-12-28 15:54:50 +02:00
CREDO23
701c3409b3 feat(connectors): add Google Drive file type detection and mapping
- Detect Google Workspace files (Docs, Sheets, Slides)
- Map to PDF export format to preserve rich content (images, formatting)
- Identify files to skip (shortcuts, unsupported types)
2025-12-28 15:54:42 +02:00
CREDO23
74386affdc feat(connectors): add Google Drive API client wrapper
- Build and manage Google Drive service with credentials
- List files with query support and pagination
- Download binary files and export Google Workspace files as PDF
- Handle HTTP errors gracefully
2025-12-28 15:54:32 +02:00
CREDO23
2c8717b14b feat(connectors): add Google Drive credentials module for OAuth management
- Handle Google OAuth credential initialization and validation
- Automatic token refresh with database persistence
- Reuse existing tokens when valid
2025-12-28 15:54:26 +02:00
CREDO23
2897985127 feat(config): add GOOGLE_DRIVE_REDIRECT_URI environment variable 2025-12-28 15:53:51 +02:00
CREDO23
5dd8838638 feat(db): add idempotent Alembic migration for GOOGLE_DRIVE_CONNECTOR enums 2025-12-28 15:53:44 +02:00
CREDO23
f54079643f feat(db): add GOOGLE_DRIVE_CONNECTOR to DocumentType and SearchSourceConnectorType enums 2025-12-28 15:53:35 +02:00
Rohan Verma
0e1ea9c30f
Merge pull request #639 from MODSetter/dev
fix: docker version mismatch
2025-12-27 15:14:27 -08:00
DESKTOP-RTLN3BA\$punk
dbd9c837e6 fix: docker version mismatch 2025-12-27 15:13:52 -08:00
Rohan Verma
96f82d73ad
Merge pull request #638 from MODSetter/dev
feat: remove google analytics
2025-12-27 14:31:23 -08:00
DESKTOP-RTLN3BA\$punk
0bcccc9fd3 Merge commit 'ed6c83615e' into dev 2025-12-27 14:30:03 -08:00
DESKTOP-RTLN3BA\$punk
f2df655469 chore: Remove unused dependency '@next/third-parties' from package.json and pnpm-lock.yaml, and clean up related code in layout.tsx 2025-12-27 14:29:52 -08:00
Rohan Verma
ed6c83615e
Merge pull request #636 from MODSetter/dev
feat: Replace AsyncChromiumLoader with Playwright for web crawling an…
2025-12-27 13:58:20 -08:00
DESKTOP-RTLN3BA\$punk
9d0721de43 feat: Replace AsyncChromiumLoader with Playwright for web crawling and content extraction in link preview and web crawler connector modules. 2025-12-27 13:58:00 -08:00
Rohan Verma
c2e6bf2018
Merge pull request #635 from MODSetter/dev
feat: sweet UX updates
2025-12-27 13:45:44 -08:00
DESKTOP-RTLN3BA\$punk
528c59ce58 chore: linting 2025-12-27 13:44:23 -08:00
DESKTOP-RTLN3BA\$punk
d154f510a3 fix: Adjust viewport overflow behavior in Thread component for improved scrolling experience 2025-12-27 13:42:37 -08:00
Rohan Verma
4a011af204
Merge pull request #628 from AnishSarkar22/fix/chatpage-ux
more improvements
2025-12-27 12:42:41 -08:00
Anish Sarkar
74f17f61ec feat: Enhance agent system prompt with write_todos examples, and apply minor code formatting across connector pages and hooks. 2025-12-28 01:41:27 +05:30
Anish Sarkar
0164659f7a refactor: comment out ls tool handling, update assistant UI colors and spacing. 2025-12-28 01:30:53 +05:30
Anish Sarkar
2c64fcc38e feat: Enhance sidebar navigation active state logic, introduce static display items, refine active item styling 2025-12-28 01:20:39 +05:30
Anish Sarkar
8b10b0cd24 feat: Display document reindexing status in the sidebar by adding document ID to logs 2025-12-28 01:07:42 +05:30
Anish Sarkar
2570360079 fix: logs now showing in docker builds 2025-12-28 00:37:26 +05:30
Anish Sarkar
2f2e1f9800 feat: Add optional polling support to useLogsSummary hook via refetchInterval option. 2025-12-27 19:48:45 +05:30
Anish Sarkar
ae4ee9ab70 Merge remote-tracking branch 'upstream/dev' into fix/chatpage-ux 2025-12-27 19:48:13 +05:30
Anish Sarkar
71b8860d20 feat: Added active highlighting to chats and notes 2025-12-27 19:41:44 +05:30
Anish Sarkar
a956b5ff87 feat: Introduce document processing indicator UI, update localization. 2025-12-27 19:09:42 +05:30
Anish Sarkar
65dc97df99 feat: updated routes 2025-12-27 19:03:46 +05:30
Anish Sarkar
7ad232dbbe feature: added refresh button in manage documents page with translation 2025-12-27 18:37:30 +05:30
Anish Sarkar
ad47d94b40 refactor: use ChainOfThoughtItem for thinking step display and update dependency lock file. 2025-12-27 16:40:53 +05:30
Anish Sarkar
70383931bb feat: Apply minor UI styling adjustments to sidebar and progress components. Fixed linting for both frontend and backend 2025-12-27 15:27:29 +05:30
Anish Sarkar
c28a90fc29 refactor: integrate TodoListMiddleware and update related components
- Removed the write_todos tool as it is now included by default through TodoListMiddleware in the deep agent.
- Updated the system prompt and documentation to reflect the integration of TodoListMiddleware, clarifying its capabilities for managing planning and todo lists.
- Enhanced the chat handling logic to extract todos directly from the deep agent's command output, ensuring seamless user experience.
- Refactored UI components to align with the new data structure and improve rendering of todo items, including updates to the Plan and TodoItem components.
- Cleaned up code for better maintainability and readability, following recent refactoring efforts.
2025-12-27 15:18:34 +05:30
Rohan Verma
2c2ae40274
Merge pull request #594 from CREDO23/feat/add-jotai-tanstack-connectors
[Feat] Connectors| Add jotai & tanstack
2025-12-26 21:43:11 -08:00
Rohan Verma
9eeecfaf4a
Merge pull request #633 from CREDO23/feat/migrate-tojotai-tanstack-logs
[Feat] Logs | Migrate to jotai & tanstack
2025-12-26 21:42:24 -08:00
Rohan Verma
dc0789edba
Merge pull request #634 from AnishSarkar22/fix/docker
Fixed docker login issue
2025-12-26 21:41:45 -08:00
Anish Sarkar
7e7030ef46 chore: fixed linting 2025-12-27 00:03:03 +05:30
CREDO23
d7ea5a4975 migrate get logs summary handler 2025-12-26 20:14:23 +02:00
CREDO23
cf2dc753bb migrate get logs summary handler 2025-12-26 20:10:39 +02:00
CREDO23
b43e79a797 migrate get logs summary handler 2025-12-26 20:05:19 +02:00
CREDO23
a7bae98e75 feat: migrate get logs handler 2025-12-26 19:55:25 +02:00
Anish Sarkar
30aa44bb91 refactor: update BaseApiService to use dynamic bearer token retrieval
- Replaced static bearerToken property with a getter that retrieves the token from localStorage.
- Updated constructor to remove bearerToken parameter for cleaner initialization.
- Maintained setBearerToken method for backward compatibility, now a no-op.
2025-12-26 23:03:19 +05:30
CREDO23
640d765d90 feat: migrate get logs handler 2025-12-26 19:06:09 +02:00
CREDO23
864ebeea9c user mutation atoms 2025-12-26 18:38:12 +02:00
CREDO23
10f3baca0c feat: add logs cache keys 2025-12-26 17:05:06 +02:00
CREDO23
b0214c901d feat: add log mutation atoms 2025-12-26 16:51:12 +02:00