Commit graph

132 commits

Author SHA1 Message Date
DESKTOP-RTLN3BA\$punk
9d0721de43 feat: Replace AsyncChromiumLoader with Playwright for web crawling and content extraction in link preview and web crawler connector modules. 2025-12-27 13:58:00 -08:00
Anish Sarkar
74f17f61ec feat: Enhance agent system prompt with write_todos examples, and apply minor code formatting across connector pages and hooks. 2025-12-28 01:41:27 +05:30
Anish Sarkar
c28a90fc29 refactor: integrate TodoListMiddleware and update related components
- Removed the write_todos tool as it is now included by default through TodoListMiddleware in the deep agent.
- Updated the system prompt and documentation to reflect the integration of TodoListMiddleware, clarifying its capabilities for managing planning and todo lists.
- Enhanced the chat handling logic to extract todos directly from the deep agent's command output, ensuring seamless user experience.
- Refactored UI components to align with the new data structure and improve rendering of todo items, including updates to the Plan and TodoItem components.
- Cleaned up code for better maintainability and readability, following recent refactoring efforts.
2025-12-27 15:18:34 +05:30
Anish Sarkar
8a3ab3dfac refactor: enhance write_todos tool and system prompt
- Updated the write_todos tool to include an optional description field for todo items, improving task detail management.
- Enhanced the system prompt with clearer guidelines on using the write_todos tool, including refined usage patterns and examples for various user scenarios.
- Improved UI components to support the new description feature, ensuring better visibility of task details during planning and execution.
- Streamlined the code for better readability and maintainability, aligning with recent refactoring efforts.
2025-12-26 19:24:32 +05:30
Anish Sarkar
ebc04f590e refactor: improve write_todos tool and UI components
- Refactored the write_todos tool to enhance argument and result schemas using Zod for better validation and type safety.
- Updated the WriteTodosToolUI to streamline the rendering logic and improve loading states, ensuring a smoother user experience.
- Enhanced the Plan and TodoItem components to better handle streaming states and display progress, providing clearer feedback during task management.
- Cleaned up code formatting and structure for improved readability and maintainability.
2025-12-26 17:49:56 +05:30
Anish Sarkar
2c86287264 refactor: update system prompt for write_todos tool usage
- Enhanced the system prompt with detailed criteria and examples for using the write_todos tool, including valid trigger words and usage patterns.
- Clarified restrictions on when to use the tool, emphasizing the need for multi-phase tasks and explicit user requests.
- Provided specific use cases for different user types to guide appropriate usage of the tool, ensuring better task management and user experience.
2025-12-26 17:27:30 +05:30
Anish Sarkar
eb70c055a4 refactor: introduce write_todos tool for enhanced task management
- Added a new write_todos tool to facilitate the creation and management of planning lists within the chat interface.
- Updated system prompt with detailed instructions on using the write_todos tool, including usage patterns and restrictions.
- Enhanced the chat message handling to support the new tool, ensuring proper integration and user experience.
- Implemented UI components for displaying and interacting with the planning lists, including progress tracking and status indicators.
2025-12-26 14:37:23 +05:30
Anish Sarkar
1dd740bb23 refactor: enhance chat functionality with new tools and attachment handling
- Updated system prompt to clarify usage of the display_image tool, emphasizing valid URL requirements and prohibiting user-uploaded image displays.
- Introduced write_todos tool for creating and updating planning lists, with detailed usage instructions and examples.
- Enhanced message handling to persist attachments and mentioned documents, ensuring they survive page reloads.
- Improved UI components to integrate the new write_todos tool and ensure consistent user experience across chat interactions.
2025-12-26 11:38:32 +05:30
Anish Sarkar
d9df63f57e refactor: enhance web crawling functionality with Firecrawl integration
- Updated WebCrawlerConnector to prioritize Firecrawl API for crawling if an API key is provided, falling back to Chromium if Firecrawl fails.
- Improved error handling to log failures from both Firecrawl and Chromium.
- Enhanced link preview tool to use a random User-Agent for better compatibility with web servers.
- Passed Firecrawl API key to the stream_new_chat function for improved configuration management.
2025-12-26 02:37:20 +05:30
Anish Sarkar
2fdf567b71 refactor: replace DocumentsDataTable with DocumentMentionPicker for improved document selection
- Introduced DocumentMentionPicker component to enhance document selection experience in the chat interface.
- Updated InlineMentionEditor and Composer components to utilize the new DocumentMentionPicker.
- Removed the deprecated DocumentsDataTable component to streamline the codebase and improve maintainability.
- Enhanced type safety and validation in document handling logic.
2025-12-26 00:41:14 +05:30
Anish Sarkar
bea18960a4 refactor: enhance link preview functionality with Chromium fallback
- Added a fallback mechanism using headless Chromium to fetch page content when standard HTTP requests fail.
- Introduced utility functions for unescaping HTML entities and converting relative URLs to absolute.
- Updated HTTP request headers to mimic a browser for better compatibility with web servers.
- Improved error handling and logging for better debugging and user feedback.
- Made various properties in Zod schemas nullable for better type safety and flexibility in handling optional data.
2025-12-26 00:07:45 +05:30
Anish Sarkar
9e7f8d7fe3 feat: enhance chat functionality with improved attachment handling and user experience
- Updated system prompt to clarify usage of the display_image tool, emphasizing URL requirements and restrictions on user-uploaded images.
- Enhanced the streaming chat process to provide more context about user attachments and documents during analysis.
- Implemented state resets when switching between chats to prevent stale data and race conditions.
- Added new components for displaying image previews and document attachments in the chat interface.
- Improved attachment processing to support image data URLs for persistent display after uploads.
2025-12-25 17:52:48 +05:30
DESKTOP-RTLN3BA\$punk
4a0c3e368a feat: migrated to surfsense deep agent 2025-12-23 01:16:25 -08:00
DESKTOP-RTLN3BA\$punk
b14283e300 feat: refactor new chat agent to support configurable tools and remove deprecated components
- Enhanced the new chat agent module to allow for configurable tools, enabling users to customize their experience with various functionalities.
- Removed outdated tools including display image, knowledge base search, link preview, podcast generation, and web scraping, streamlining the codebase.
- Updated the system prompt and agent factory to reflect these changes, ensuring a more cohesive and efficient architecture.
2025-12-22 20:17:08 -08:00
Anish Sarkar
24dd52ed99 feat: add web scraping tool to chat agent for extracting and summarizing webpage content 2025-12-23 01:49:29 +05:30
Anish Sarkar
da7cb81252 feat: introduce display image tool for enhanced image rendering in chat with metadata support 2025-12-23 01:11:56 +05:30
Anish Sarkar
4b69fdf214 feat: add link preview tool for enhanced URL metadata display in chat 2025-12-23 00:58:27 +05:30
DESKTOP-RTLN3BA\$punk
bb971460fc feat: migrated old chat to new chat 2025-12-21 19:33:52 -08:00
DESKTOP-RTLN3BA\$punk
0c3574d049 feat: implement new chat feature with message persistence and UI integration 2025-12-21 16:16:50 -08:00
Anish Sarkar
35463eeab4 Merge remote-tracking branch 'upstream/dev' into feature/podcast-agent 2025-12-21 20:39:21 +05:30
Anish Sarkar
783ee9c154 feat: enhance podcast generation with duplicate request prevention and improved UI feedback 2025-12-21 20:07:04 +05:30
Anish Sarkar
e79e1187b2 feat: implement background podcast generation with Celery and task polling in UI 2025-12-21 19:35:00 +05:30
Anish Sarkar
4c4e4b3c4c feat: add podcast generation capabilities to SurfSense deep agent and UI integration 2025-12-21 19:07:46 +05:30
DESKTOP-RTLN3BA\$punk
73f0f772a8 feat: message history and PostgreSQL checkpointer integration 2025-12-21 03:30:10 -08:00
DESKTOP-RTLN3BA\$punk
947087452f feat: new chat working stateless. Added citation logic. 2025-12-20 23:15:49 -08:00
thierryverse
a4422c0ee4 organize deepagent codebase 2025-12-20 18:35:39 +02:00
thierryverse
c04652a6f9 inject tools at runtime 2025-12-20 18:35:39 +02:00
thierryverse
286d03c8dc toogle the citations 2025-12-20 18:35:39 +02:00
thierryverse
61fc31ef02 make the system promet configurable 2025-12-20 18:35:39 +02:00
DESKTOP-RTLN3BA\$punk
c6cc7c2a6a feat: test script of new agent 2025-12-18 23:57:57 -08:00
DESKTOP-RTLN3BA\$punk
c768730b8c feat: fixed issues of note management
Issues Fixed

- Missing pagination fields in API response schemas (page, page_size, has_more)
- NOTE enum missing from frontend Zod schema
- Missing fields in DocumentRead response construction (content_hash, updated_at)
- BlockNote slash menu clipped by overflow-hidden CSS
- Sidebar click conflicts - hidden action buttons intercepting clicks
- Rewrote All Notes sidebar - replaced fragile custom portal with shadcn Sheet
- Missing translation keys for new UI strings
- Missing NOTE retrieval logic in researcher agent
- Added search to All Notes sidebar
- Removed frontend logging - was causing toasters on every page refresh
- Added backend logging to document reindex Celery task
2025-12-17 00:09:43 -08:00
DESKTOP-RTLN3BA\$punk
fd1f3eaf60 chore: update langchain
- Updated langchain-unstructured to version 1.0.0 and langchain to 1.2.0.
- Updated litellm to version 1.80.10 and grpcio versions based on Python version.
- Updated fastuuid to version 0.14.0 and langgraph to 1.0.5.
- Updated openai to version 2.12.0 and langgraph-sdk to 0.3.0.
- Added uuid-utils package version 0.12.0.
- Refactored imports in utils.py, chats_routes.py, and query_service.py to use langchain_core.messages.
2025-12-15 21:25:44 -08:00
DESKTOP-RTLN3BA\$punk
fea1837186 roadmap(1.3): Update citation prompt to use new whole document structure
- Modified the document extraction and citation formatting to accommodate a new structure that includes a `chunks` list for each document.
- Enhanced the citation format to reference `chunk_id` instead of `source_id`, ensuring accurate citations in the UI.
- Updated various components, including the connector service and reranker service, to handle the new document format and maintain compatibility with existing functionalities.
- Improved documentation and comments to reflect changes in the data structure and citation requirements.
2025-12-14 22:07:31 -08:00
DESKTOP-RTLN3BA\$punk
08fb488995 feat(roadmap-1.2): removed SearchMode enum and combined hybrid search 2025-12-12 04:17:30 -08:00
DESKTOP-RTLN3BA\$punk
919c323ef3 feat: implement time-based filtering for document retrieval using 'updated_at' timestamp 2025-12-12 02:42:20 -08:00
DESKTOP-RTLN3BA\$punk
c97887a63d fix: implement real-time streaming for responses
- Added streaming service support to the Q&A agent for real-time token streaming.
- Updated `answer_question` method to stream responses token-by-token to the frontend.
- Modified `handle_qna_workflow` to handle both custom and values streaming modes.
- Enhanced state management to include streaming service for improved user experience.
2025-12-05 00:14:36 -08:00
DESKTOP-RTLN3BA\$punk
e9d32c3516 feat: Implement Role-Based Access Control (RBAC) for search space resources.
-Introduce granular permissions for documents, chats, podcasts, and logs.
- Update routes to enforce permission checks for creating, reading, updating, and deleting resources. - Refactor user and search space interactions to align with RBAC model, removing ownership checks in favor of permission validation.
2025-11-27 22:45:04 -08:00
DESKTOP-RTLN3BA\$punk
d1c9c533b5 fix: crawled url search 2025-11-26 14:53:44 -08:00
samkul-swe
5afb421d6f Fix issues 2025-11-22 19:40:13 -08:00
samkul-swe
121e2f0c0e Renaming resources 2025-11-22 19:19:00 -08:00
samkul-swe
896e410e2a Webcrawler connector draft 2025-11-21 23:27:21 -08:00
DESKTOP-RTLN3BA\$punk
6648409237 feat: Added Search Space System Instructions
- Added `citations_enabled` and `qna_custom_instructions` fields to the SearchSpace model for better QnA configuration.
- Updated the creation and update schemas to handle new fields with appropriate defaults.
- Refactored QnA handling in the agent to utilize the new SearchSpace fields for improved response customization.
- Adjusted UI components to include settings for managing QnA configurations.
- Enhanced onboarding process to incorporate prompt setup as an optional step.
2025-11-19 15:04:46 -08:00
DESKTOP-RTLN3BA\$punk
3ccb0bc7bb refactor(ux): Enhance podcast and chat panel features
- Updated the welcome dialog in podcast generation to reflect the correct podcast title.
- Improved the Dashboard layout by adding an indicator for active chats on the researcher page.
- Enhanced the breadcrumb component to fetch and display chat details dynamically.
- Adjusted the chat panel width for better visibility.
- Introduced animations and improved user interactions in the chat panel and podcast player components.
- Updated the ConfigModal to provide clearer instructions for user input.
2025-11-11 18:07:32 -08:00
Rohan Verma
0835a192a2
Merge pull request #430 from CREDO23/feat/chat-pannel
[Feature] Add the chat panel
2025-11-11 17:04:39 -08:00
thierryverse
2902fd6d28 inject user instruction in the podcast generation task 2025-11-11 20:08:32 +02:00
thierryverse
cfb62ff73b fix typo 2025-11-11 19:15:45 +02:00
thierryverse
55e5b45a42 fix podcast generation 2025-11-11 04:02:04 +02:00
DESKTOP-RTLN3BA\$punk
7ed159b395 feat: added top_k in chat Interface. 2025-11-06 13:25:05 -08:00
DESKTOP-RTLN3BA\$punk
a2fb9faad6 feat: enhance Azure OpenAI embeddings and add voice support for Azure provider
- Introduced a fixed parameter order for AzureOpenAIEmbeddings to resolve compatibility issues.
- Updated the voice selection logic to include Azure voices in the podcaster utility.
- Modified the page limit service to use a more efficient method for retrieving users.
2025-10-30 22:33:47 -07:00
DESKTOP-RTLN3BA\$punk
0987440893 chore: update configuration for rerankers
- Added RERANKERS_ENABLED option to control reranking functionality.
- Updated rerank_documents function to handle cases when reranking is disabled.
- Enhanced documentation for environment variables related to rerankers in installation guides.
2025-10-29 23:23:08 -07:00