feat: update environment variables and enhance scraping capabilities

- Adjusted Google Maps and YouTube micro pricing in the .env.example file for better cost management.
- Introduced new environment variables for captcha solving and stealth browser hardening to improve scraping resilience.
- Removed outdated smoke test for scraper API endpoints to streamline testing.
- Enhanced anonymous chat agent's system prompt to clarify capabilities and suggest account creation for advanced features.
- Updated Reddit fetch logic to prioritize new session handling and improve resilience against IP-related issues.
- Added compacting functionality for scraper results to optimize data handling and presentation.
- Improved workspace and document management tools with clearer descriptions and enhanced functionality.
- Introduced new UI components for agent setup guidance in the web application.

docker/.env.example

@@ -445,10 +445,10 @@ SURFSENSE_ENABLE_DOOM_LOOP=true
 # PLATFORM_SCRAPE_BILLING_ENABLED=FALSE
 # REDDIT_SCRAPE_MICROS_PER_ITEM=3500
 # GOOGLE_SEARCH_MICROS_PER_SERP=5500
-# GOOGLE_MAPS_MICROS_PER_PLACE=5000
-# GOOGLE_MAPS_MICROS_PER_REVIEW=2000
-# YOUTUBE_MICROS_PER_VIDEO=3500
-# YOUTUBE_MICROS_PER_COMMENT=3500
+# GOOGLE_MAPS_MICROS_PER_PLACE=3500
+# GOOGLE_MAPS_MICROS_PER_REVIEW=1500
+# YOUTUBE_MICROS_PER_VIDEO=2500
+# YOUTUBE_MICROS_PER_COMMENT=1500
 
 # Safety ceiling on per-call premium reservation, in micro-USD ($1.00 default).
 # QUOTA_MAX_RESERVE_MICROS=1000000
@@ -492,6 +492,28 @@ NOLOGIN_MODE_ENABLED=FALSE
 # PROXY_URL=http://user:pass@host:port
 # PROXY_URLS=http://user:pass@host1:port,http://user:pass@host2:port
 
+# Captcha solving — last-resort bypass tier via captchatools. Only fires on the
+# stealth browser tier when a sitekey is detected AND the flag is TRUE.
+# Cloudflare Turnstile is already solved free in-framework. Off by default.
+# NOTE: automated solving may violate a target site's ToS — opt-in, public
+# data only. See surfsense_backend/.env.example for the full option docs.
+# CAPTCHA_SOLVING_ENABLED=FALSE
+# CAPTCHA_SOLVER_PROVIDER=capsolver
+# CAPTCHA_SOLVER_API_KEY=
+# CAPTCHA_MAX_ATTEMPTS_PER_URL=1
+# CAPTCHA_SOLVE_TIMEOUT_S=120
+# CAPTCHA_TYPE_DEFAULT=v2
+# CAPTCHA_V3_MIN_SCORE=0.7
+# CAPTCHA_V3_ACTION=verify
+
+# Stealth hardening levers on the stealth browser tier. Defaults preserve
+# current behavior; see surfsense_backend/.env.example for per-flag docs.
+# CRAWL_GEOIP_MATCH_ENABLED=FALSE
+# CRAWL_BLOCK_WEBRTC=TRUE
+# CRAWL_HIDE_CANVAS=FALSE
+# CRAWL_GOOGLE_SEARCH_REFERER=TRUE
+# CRAWL_DNS_OVER_HTTPS=FALSE
+
 # ==============================================================================
 # DEV / DEPS-ONLY COMPOSE OVERRIDES
 # These are only needed for docker-compose.dev.yml or docker-compose.deps-only.yml.