feat(search): standalone web search with your own Serper.dev key

OSS surfaces can now search without the hosted webclaw API. New
webclaw-fetch::search() calls Serper.dev directly with a user-supplied key
and optionally fetches + extracts the result pages. Wired into the CLI
(webclaw search, --serper-key / SERPER_API_KEY), the MCP search tool
(local-first when SERPER_API_KEY is set, cloud fallback otherwise), and the
OSS reference server (POST /v1/search). Adds futures for concurrent result
page scraping.
This commit is contained in:
webclaw 2026-06-06 14:20:03 +02:00
parent b7bd1155c6
commit de899ab3ba
14 changed files with 671 additions and 7 deletions

1
Cargo.lock generated
View file

@ -3264,6 +3264,7 @@ dependencies = [
"bytes",
"calamine",
"flate2",
"futures",
"http",
"quick-xml 0.37.5",
"rand 0.8.5",