mirror of
https://github.com/clucraft/PriceGhost.git
synced 2026-07-14 16:32:14 +02:00
The scraper was going straight to Puppeteer for JS-heavy sites, but Chromium fails to launch in the container (crashpad issue). These sites actually serve product data via JSON-LD in the initial HTML, so plain HTTP requests work fine. Changes: - Try axios HTTP fetch FIRST for ALL sites (including JS-heavy) - Fall back to Puppeteer only on 403 or empty response - Add size check: if HTML < 50KB and site is JS-heavy, try browser |
||
|---|---|---|
| .. | ||
| src | ||
| .dockerignore | ||
| .env.example | ||
| Dockerfile | ||
| package-lock.json | ||
| package.json | ||
| tsconfig.json | ||