feat(fetch): add fetch_smart with Reddit + Akamai rescue paths, bump 0.5.6

This commit is contained in:
Valerio 2026-04-23 14:59:29 +02:00
parent 98a177dec4
commit b413d702b2
4 changed files with 69 additions and 16 deletions

View file

@ -3,6 +3,16 @@
All notable changes to webclaw are documented here.
Format follows [Keep a Changelog](https://keepachangelog.com/).
## [0.5.6] — 2026-04-23
### Added
- `FetchClient::fetch_smart(url)` applies per-site rescue logic and returns the same `FetchResult` shape as `fetch()`. Reddit URLs route to the `.json` API, and Akamai-style challenge pages trigger a homepage cookie warmup plus a retry. Makes `/v1/scrape` on Reddit populate markdown again.
### Fixed
- Regression introduced in 0.5.4 where the production server's `/v1/scrape` bypassed the Reddit `.json` shortcut and Akamai cookie warmup that `fetch_and_extract` had been providing. Both helpers now live in `fetch_smart` and every caller path picks them up.
---
## [0.5.5] — 2026-04-23
### Added