apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-07-22 23:31:12 +02:00
Code Issues Projects Releases Packages Wiki Activity

refactor: update references from competitive intelligence to open web research across various components and documentation

Browse source
This commit is contained in:
DESKTOP-RTLN3BA\$punk 2026-07-16 19:41:16 -07:00
parent a7903e0b4b
commit 7bc02ce55b
32 changed files with 225 additions and 225 deletions
Download patch file Download diff file Expand all files Collapse all files

2
surfsense_web/content/docs/connectors/native/web-crawl.mdx
View file

@ -51,7 +51,7 @@ curl -X POST "$BASE_URL/api/v1/workspaces/1/scrapers/web/crawl" \
One item per fetched page (in crawl order) with its markdown, metadata (title, description), crawl provenance (depth, referrer), links classified as internal/external/social/email/tel, and page-level contacts. The response also includes a site-wide `contacts` summary that deduplicates every email, phone, and social profile found — `siteWide: true` marks header/footer values (the company's own contacts) versus page-local finds like individual team members.
Contact details often live on about/contact/privacy pages, so crawl with `maxCrawlDepth >= 1` to surface them — useful for lead generation and competitive intelligence.
Contact details often live on about/contact/privacy pages, so crawl with `maxCrawlDepth >= 1` to surface them — useful for lead generation and company research.
Billing is per successfully fetched page.