mirror of
https://github.com/0xMassi/webclaw.git
synced 2026-06-07 22:15:12 +02:00
Stress testing showed 33% of proxies are dead, causing 30s+ timeouts per request with 3 retries (worst case 94s). Reducing timeout from 30s to 12s and retries from 3 to 2 brings worst case to 25s. Combined with disabling 509 dead proxies from the pool, this should significantly improve response times under load. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| browser.rs | ||
| client.rs | ||
| crawler.rs | ||
| document.rs | ||
| error.rs | ||
| lib.rs | ||
| linkedin.rs | ||
| proxy.rs | ||
| reddit.rs | ||
| sitemap.rs | ||
| tls.rs | ||