SurfSense/surfsense_backend/app/tasks
Anish Sarkar d9df63f57e refactor: enhance web crawling functionality with Firecrawl integration
- Updated WebCrawlerConnector to prioritize Firecrawl API for crawling if an API key is provided, falling back to Chromium if Firecrawl fails.
- Improved error handling to log failures from both Firecrawl and Chromium.
- Enhanced link preview tool to use a random User-Agent for better compatibility with web servers.
- Passed Firecrawl API key to the stream_new_chat function for improved configuration management.
2025-12-26 02:37:20 +05:30
..
celery_tasks feat: refactor new chat agent to support configurable tools and remove deprecated components 2025-12-22 20:17:08 -08:00
chat refactor: enhance web crawling functionality with Firecrawl integration 2025-12-26 02:37:20 +05:30
connector_indexers refactor: update the webcrawler index to compare hashes without metadata 2025-12-17 18:44:58 +02:00
document_processors feat: update document tracking to use 'updated_at' timestamp instead of 'last_edited_at' 2025-12-12 01:32:14 -08:00
__init__.py feat: SurfSense v0.0.6 init 2025-03-14 18:53:14 -07:00