Commit graph

463 commits

Author SHA1 Message Date
Thierry CH.
c4400a0ec2
Merge branch 'dev' into documents-mentions 2025-12-24 06:31:49 +02:00
DESKTOP-RTLN3BA\$punk
0b86756082 chore: ruff format 2025-12-23 02:56:13 -08:00
DESKTOP-RTLN3BA\$punk
acf0396aa5 feat: fixed migrations
- Migrated data from the old 'chats' table to 'new_chat_threads' and 'new_chat_messages'.
- Dropped the 'chats' table and removed the 'chattype' enum as part of the migration process.
- Updated the migration script to truncate thread titles to 500 characters to comply with database constraints.
- Adjusted the downgrade function to reflect changes in the migration process.
2025-12-23 02:55:37 -08:00
Anish Sarkar
6f330e7b8d Merge remote-tracking branch 'upstream/dev' into pr-611 2025-12-23 15:45:28 +05:30
DESKTOP-RTLN3BA\$punk
4a0c3e368a feat: migrated to surfsense deep agent 2025-12-23 01:16:25 -08:00
Anish Sarkar
ceb01dc544 feat: enhance new chat functionality with document mentions support
- Updated the new chat routes to include handling for mentioned document IDs, allowing users to reference specific documents in their chat.
- Modified the NewChatRequest schema to accommodate optional document IDs.
- Implemented document mention formatting in the chat streaming service for improved context.
- Enhanced the frontend to manage document mentions, including a new atom for state management and UI updates for document selection.
- Refactored the DocumentsDataTable component for better integration with the new mention functionality.
2025-12-23 14:24:36 +05:30
DESKTOP-RTLN3BA\$punk
b14283e300 feat: refactor new chat agent to support configurable tools and remove deprecated components
- Enhanced the new chat agent module to allow for configurable tools, enabling users to customize their experience with various functionalities.
- Removed outdated tools including display image, knowledge base search, link preview, podcast generation, and web scraping, streamlining the codebase.
- Updated the system prompt and agent factory to reflect these changes, ensuring a more cohesive and efficient architecture.
2025-12-22 20:17:08 -08:00
Anish Sarkar
7ca490c740 feat: enhance chain-of-thought display with smart expand/collapse behavior and state management for improved user interaction 2025-12-23 02:21:41 +05:30
Anish Sarkar
24dd52ed99 feat: add web scraping tool to chat agent for extracting and summarizing webpage content 2025-12-23 01:49:29 +05:30
Anish Sarkar
da7cb81252 feat: introduce display image tool for enhanced image rendering in chat with metadata support 2025-12-23 01:11:56 +05:30
Anish Sarkar
4b69fdf214 feat: add link preview tool for enhanced URL metadata display in chat 2025-12-23 00:58:27 +05:30
Anish Sarkar
8a99752f2f feat: enhance chat functionality with chain-of-thought display and thinking steps management 2025-12-22 22:54:22 +05:30
DESKTOP-RTLN3BA\$punk
1cbb1b5d66 refactor: remove chat-related fields and legacy podcast generation function 2025-12-21 23:31:11 -08:00
DESKTOP-RTLN3BA\$punk
c2dcb2045d feat: added attachment support 2025-12-21 22:26:33 -08:00
DESKTOP-RTLN3BA\$punk
bb971460fc feat: migrated old chat to new chat 2025-12-21 19:33:52 -08:00
DESKTOP-RTLN3BA\$punk
b5e20e7515 feat: old chat to new-chat with persistance 2025-12-21 16:32:55 -08:00
DESKTOP-RTLN3BA\$punk
0c3574d049 feat: implement new chat feature with message persistence and UI integration 2025-12-21 16:16:50 -08:00
Anish Sarkar
35463eeab4 Merge remote-tracking branch 'upstream/dev' into feature/podcast-agent 2025-12-21 20:39:21 +05:30
Anish Sarkar
783ee9c154 feat: enhance podcast generation with duplicate request prevention and improved UI feedback 2025-12-21 20:07:04 +05:30
Anish Sarkar
e79e1187b2 feat: implement background podcast generation with Celery and task polling in UI 2025-12-21 19:35:00 +05:30
Anish Sarkar
4c4e4b3c4c feat: add podcast generation capabilities to SurfSense deep agent and UI integration 2025-12-21 19:07:46 +05:30
DESKTOP-RTLN3BA\$punk
73f0f772a8 feat: message history and PostgreSQL checkpointer integration 2025-12-21 03:30:10 -08:00
DESKTOP-RTLN3BA\$punk
947087452f feat: new chat working stateless. Added citation logic. 2025-12-20 23:15:49 -08:00
thierryverse
a4422c0ee4 organize deepagent codebase 2025-12-20 18:35:39 +02:00
thierryverse
c04652a6f9 inject tools at runtime 2025-12-20 18:35:39 +02:00
thierryverse
286d03c8dc toogle the citations 2025-12-20 18:35:39 +02:00
thierryverse
61fc31ef02 make the system promet configurable 2025-12-20 18:35:39 +02:00
DESKTOP-RTLN3BA\$punk
086048a4db refactor: updated chonkie & removed junk code
- Removed all references to the Serper API from the codebase, including related components, hooks, and schemas.
- Updated the `pyproject.toml` to reflect the new version of `chonkie` and other dependencies.
- Cleaned up the configuration and connector management to streamline the application.
2025-12-19 23:26:45 -08:00
DESKTOP-RTLN3BA\$punk
70ca585379 feat: add server side chat search functionality
- Implemented a new endpoint for searching chats by title substring in the backend.
- Updated the frontend to support chat searching with a debounced input.
- Added validation for pagination parameters and search space ID.
- Enhanced API service to handle search requests and return results based on user permissions.
2025-12-19 15:52:53 -08:00
Rohan Verma
b4b53b6625
Merge pull request #597 from AnishSarkar22/fix/chat-ui
Added new Chat UI and fixed global state management for notes
2025-12-19 15:14:24 -08:00
DESKTOP-RTLN3BA\$punk
7e383b3fe2 feat: enhance CSRF cookie configuration for OAuth
- Added support for SameSite attribute in CSRF cookies to handle cross-origin requests.
- Set SameSite to 'none' for secure contexts and 'lax' for local development.
2025-12-19 15:03:12 -08:00
DESKTOP-RTLN3BA\$punk
18a4857c2b feat: enhance CORS configuration for frontend integration
- Updated CORS middleware to allow specific origins based on NEXT_FRONTEND_URL.
- Added support for localhost origins for local development.
- Ensured compatibility with both www and non-www variants of the frontend URL.
2025-12-19 14:49:49 -08:00
DESKTOP-RTLN3BA\$punk
3f2b915cd0 feat: fixed OAUTH issues
- Added BACKEND_URL to .env.example for optional OAuth callback configuration when behind a reverse proxy with HTTPS.
- Updated fastapi-users dependency to version 15.0.3 in pyproject.toml.
- Updated argon2-cffi and email-validator versions in uv.lock.
- Enhanced Google OAuth integration in app.py to handle secure contexts for CSRF cookies.
- Updated GoogleLoginButton component to include credentials in fetch requests.
- Updated documentation to reflect the new BACKEND_URL variable in both docker and manual installation guides.
2025-12-19 14:19:30 -08:00
DESKTOP-RTLN3BA\$punk
8d66d32c07 revert 2025-12-19 13:30:50 -08:00
DESKTOP-RTLN3BA\$punk
10a2180873 hotfix(try): OAUTH_INVALID_STATE 2025-12-19 12:49:40 -08:00
Anish Sarkar
ee46a43afc feat: enhance chat query handling and sidebar updates
- Updated chat query to include ordering by creation date for better organization.
- Improved optimistic updates in chat deletion and creation mutations to ensure UI consistency.
- Invalidate chat queries after mutations to refresh sidebar and components effectively.
- Adjusted cache key structure for chat queries to include additional parameters for better cache management.
2025-12-19 22:37:04 +05:30
CREDO23
f524cf5322 use trafilatura to extrack page content from the chromium result 2025-12-19 10:05:51 +02:00
CREDO23
64cd65bc1f use trafilatura to extrack page content from the chromium result 2025-12-19 10:05:51 +02:00
DESKTOP-RTLN3BA\$punk
c6cc7c2a6a feat: test script of new agent 2025-12-18 23:57:57 -08:00
CREDO23
1f60d1c22f add user agent to AsyncChromiumLoader 2025-12-17 19:43:54 +02:00
CREDO23
c6cb754aac refactor: update the webcrawler index to compare hashes without metadata 2025-12-17 18:44:58 +02:00
CREDO23
4cfeffb38a refactor: update the webcrawler connector formater 2025-12-17 18:42:37 +02:00
DESKTOP-RTLN3BA\$punk
c768730b8c feat: fixed issues of note management
Issues Fixed

- Missing pagination fields in API response schemas (page, page_size, has_more)
- NOTE enum missing from frontend Zod schema
- Missing fields in DocumentRead response construction (content_hash, updated_at)
- BlockNote slash menu clipped by overflow-hidden CSS
- Sidebar click conflicts - hidden action buttons intercepting clicks
- Rewrote All Notes sidebar - replaced fragile custom portal with shadcn Sheet
- Missing translation keys for new UI strings
- Missing NOTE retrieval logic in researcher agent
- Added search to All Notes sidebar
- Removed frontend logging - was causing toasters on every page refresh
- Added backend logging to document reindex Celery task
2025-12-17 00:09:43 -08:00
Anish Sarkar
4cef8cc93f feat: enhance validation and formatting in editor and sidebar components 2025-12-16 21:27:31 +05:30
Anish Sarkar
7bd638668a Merge remote-tracking branch 'upstream/main' into feature/note-management
updating
2025-12-16 20:28:35 +05:30
Anish Sarkar
e8e393a0d5 fix: fixed linting for some files 2025-12-16 20:25:50 +05:30
Anish Sarkar
e1e813702a feat: enhance note creation and editing experience
- Added dynamic title extraction from the first block of BlockNote documents for NOTE type.
- Updated editor routes to support new note creation with a BlockNote editor.
- Implemented unsaved changes dialog for better user experience when navigating away from the editor.
- Refactored BlockNoteEditor to ensure the first block is a heading when creating new notes.
- Removed the old note creation page in favor of the new streamlined editor experience.
2025-12-16 13:57:06 +05:30
Anish Sarkar
8eceb7a5cb feat: add note management functionality with BlockNote support
- Introduced a new ENUM value 'NOTE' for document types in the database.
- Implemented backend routes for creating, listing, and deleting notes.
- Added a new frontend page for creating notes with a BlockNote editor.
- Updated sidebar to include recent notes and an option to add new notes.
- Enhanced API service for notes with validation and request/response schemas.
- Updated translations to support new note-related terms.
2025-12-16 12:28:30 +05:30
DESKTOP-RTLN3BA\$punk
fd1f3eaf60 chore: update langchain
- Updated langchain-unstructured to version 1.0.0 and langchain to 1.2.0.
- Updated litellm to version 1.80.10 and grpcio versions based on Python version.
- Updated fastuuid to version 0.14.0 and langgraph to 1.0.5.
- Updated openai to version 2.12.0 and langgraph-sdk to 0.3.0.
- Added uuid-utils package version 0.12.0.
- Refactored imports in utils.py, chats_routes.py, and query_service.py to use langchain_core.messages.
2025-12-15 21:25:44 -08:00
DESKTOP-RTLN3BA\$punk
fea1837186 roadmap(1.3): Update citation prompt to use new whole document structure
- Modified the document extraction and citation formatting to accommodate a new structure that includes a `chunks` list for each document.
- Enhanced the citation format to reference `chunk_id` instead of `source_id`, ensuring accurate citations in the UI.
- Updated various components, including the connector service and reranker service, to handle the new document format and maintain compatibility with existing functionalities.
- Improved documentation and comments to reflect changes in the data structure and citation requirements.
2025-12-14 22:07:31 -08:00