apunkt/webclaw
1
0
Fork 0
mirror of https://github.com/0xMassi/webclaw.git synced 2026-06-13 23:15:13 +02:00
Code Issues Projects Releases Packages Wiki Activity
webclaw/crates/webclaw-fetch/src
History
webclaw de899ab3ba feat(search): standalone web search with your own Serper.dev key 
OSS surfaces can now search without the hosted webclaw API. New
webclaw-fetch::search() calls Serper.dev directly with a user-supplied key
and optionally fetches + extracts the result pages. Wired into the CLI
(webclaw search, --serper-key / SERPER_API_KEY), the MCP search tool
(local-first when SERPER_API_KEY is set, cloud fallback otherwise), and the
OSS reference server (POST /v1/search). Adds futures for concurrent result
page scraping.
2026-06-06 14:20:03 +02:00
..
extractors perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
browser.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
client.rs feat(map): layered URL discovery with crawl fallback 2026-06-06 12:08:26 +02:00
cloud.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
crawler.rs feat(map): layered URL discovery with crawl fallback 2026-06-06 12:08:26 +02:00
document.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
error.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
fetcher.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
lib.rs feat(search): standalone web search with your own Serper.dev key 2026-06-06 14:20:03 +02:00
linkedin.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
locale.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
map.rs feat(map): layered URL discovery with crawl fallback 2026-06-06 12:08:26 +02:00
proxy.rs Initial release: webclaw v0.1.0 — web content extraction for LLMs 2026-03-23 18:31:11 +01:00
reddit.rs feat(reddit): parse old.reddit.com HTML instead of the dead .json API 2026-06-04 17:36:02 +02:00
search.rs feat(search): standalone web search with your own Serper.dev key 2026-06-06 14:20:03 +02:00
sitemap.rs feat(map): layered URL discovery with crawl fallback 2026-06-06 12:08:26 +02:00
tls.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00
url_security.rs perf(core): hot-path extraction speedups + senior-grade hardening 2026-06-04 20:22:00 +02:00