apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-06-08 20:25:19 +02:00
Code Issues Projects Releases Packages Wiki Activity

use trafilatura to extrack page content from the chromium result

Browse source
This commit is contained in:
CREDO23 2025-12-19 08:51:09 +02:00
parent 64cd65bc1f
commit f524cf5322
1 changed files with 0 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

4
surfsense_backend/app/tasks/connector_indexers/webcrawler_indexer.py
View file

@ -197,10 +197,6 @@ async def index_crawled_urls(
structured_document_for_hash, search_space_id
)
logger.info(
f"structured_document_for_hash {structured_document_for_hash} ========="
)
# Check if document with this unique identifier already exists
existing_document = await check_document_by_unique_identifier(
session, unique_identifier_hash