webclaw/crates
devnen 06f065cb08 feat(fetch): periodic progress stderr line on slow fetches
Webclaw's default -t timeout is 30s; slow sites previously sat
silently with no feedback. Now during a fetch, every 10s of elapsed
time webclaw writes one line to stderr:

  # webclaw: still fetching <URL> (Ns)

Fetches completing in under 10s emit nothing (the timer never fires).
Stdout output is untouched - pure feedback signal on stderr.

No timeout change. No new flags. Default behavior is augmented at
stderr only.

Implemented via tokio::select! between the fetch future and a
tokio::time::interval. Latency cost: a single tokio task spawn
and a 10s tick - microseconds on the fast path.

10 new tests in webclaw-fetch::progress::tests (none ignored; the
slow-future test uses a 50ms test interval to keep cargo test fast).
Workspace total 710 -> 720.
2026-05-24 00:24:51 +02:00
..
webclaw-cli feat(fetch): periodic progress stderr line on slow fetches 2026-05-24 00:24:51 +02:00
webclaw-core feat(core): word-count breakdown in header — article vs chrome split 2026-05-23 23:56:14 +02:00
webclaw-fetch feat(fetch): periodic progress stderr line on slow fetches 2026-05-24 00:24:51 +02:00
webclaw-llm fix: support LLM provider compatibility options 2026-05-06 11:36:53 +02:00
webclaw-mcp feat(core): word-count breakdown in header — article vs chrome split 2026-05-23 23:56:14 +02:00
webclaw-pdf Initial release: webclaw v0.1.0 — web content extraction for LLMs 2026-03-23 18:31:11 +01:00
webclaw-server feat(core): word-count breakdown in header — article vs chrome split 2026-05-23 23:56:14 +02:00