Commit graph

  • 87d4c14f98 fix(test): serialize env-mutating CloudClient tests to stop flaky CI Valerio 2026-05-19 18:46:12 +02:00
  • 276bfb9154 fix(docker): source CA bundle from distroless instead of apt (fixes arm64 release build) Valerio 2026-05-19 18:36:30 +02:00
  • 3781c2874f feat(core): endpoints module — extract API surface from HTML + JS bundles Valerio 2026-05-19 18:00:56 +02:00
  • be8bcfebd9
    fix: harden resource limits, path safety, and WASM build (#46) v0.6.3 Valerio 2026-05-19 17:03:52 +02:00
  • 5e4970f105 fix: harden resource limits, path safety, and WASM build Valerio 2026-05-19 12:14:45 +02:00
  • aab51bea91 docs: add workflow examples Valerio 2026-05-18 18:56:00 +02:00
  • b75b768ec3 Update Quantum Proxies sponsor copy Valerio 2026-05-18 18:50:38 +02:00
  • 3fabdc1d02
    fix: clean llm output noise v0.6.2 Valerio 2026-05-18 18:39:33 +02:00
  • 8abe4a62e1 fix: clean llm output noise Valerio 2026-05-18 18:16:37 +02:00
  • 5eef8358b0 docs: update sponsor partner details Valerio 2026-05-18 13:09:02 +02:00
  • 7dfd62ec1d docs: add proxy-seller studio partner Valerio 2026-05-18 12:37:28 +02:00
  • 6d886c44f6 docs: enlarge studio partner banner Valerio 2026-05-18 12:27:11 +02:00
  • 8e3ad17428 docs: tighten studio partner layout Valerio 2026-05-18 12:23:19 +02:00
  • 7321549412 docs: add studio partner section Valerio 2026-05-18 12:17:34 +02:00
  • cb31c70465 add network capture endpoint replay karolinnger 2026-05-16 22:22:18 -04:00
  • 920d71f561 Strip more llm output noise: consent walls, bare integers, JSON-LD body duplication devnen 2026-05-16 18:55:28 +02:00
  • 72edb61881
    Merge pull request #42 from jal-co/docs/add-community-plugins Valerio 2026-05-16 11:24:33 +02:00
  • 00d86a12bc docs: refine community plugin copy Valerio 2026-05-16 11:19:15 +02:00
  • c8be5214f6
    docs: add community plugins section with OpenClaw and Hermes integrations Justin Levine 2026-05-15 17:51:22 -07:00
  • 0ea189c5b2 fix(ci): pass repository to release cli v0.6.1 Valerio 2026-05-12 12:28:14 +02:00
  • a629534490
    fix(security): prepare 0.6.1 hardening Valerio 2026-05-12 12:16:42 +02:00
  • fd2e75d509 chore(fetch): satisfy clippy for resolver setup Valerio 2026-05-12 12:09:18 +02:00
  • e2f89941ac chore(release): prepare 0.6.1 Valerio 2026-05-12 12:06:06 +02:00
  • 307b4f980d fix(extractors): harden marketplace host matching Valerio 2026-05-12 12:03:43 +02:00
  • dbf9ce08a6 fix(ci): scope release workflow token permissions Valerio 2026-05-12 11:47:09 +02:00
  • 3bcb288d13 fix(fetch): guard challenge detection before utf8 decoding Valerio 2026-05-12 11:46:33 +02:00
  • a611ae26f3 fix(security): harden local fetch surfaces Valerio 2026-05-12 12:00:25 +02:00
  • 3912de9008 fix(ci): scope release workflow token permissions Valerio 2026-05-12 11:47:09 +02:00
  • 7de5526ac1 fix(extractors): harden amazon/ebay host validation Valerio 2026-05-12 11:46:58 +02:00
  • 73c830aca4 fix(fetch): guard challenge detection before utf8 decoding Valerio 2026-05-12 11:46:33 +02:00
  • af96628dc9
    Revise README for clarity and updated content Valerio 2026-05-10 22:44:57 +02:00
  • e8ca1417d6
    Improve --format llm output quality (#37) v0.6.0 devnen 2026-05-10 15:11:12 +02:00
  • aa561e976a Polish llm output quality fixes Valerio 2026-05-10 15:06:34 +02:00
  • df8bdc96db Improve --format llm output quality on news index pages Nenad Oric 2026-05-10 14:00:54 +02:00
  • 7f75143954 docs: update hosted api trial copy Valerio 2026-05-06 17:16:35 +02:00
  • e6a95f783d chore: bump version to 0.5.9 v0.5.9 Valerio 2026-05-06 11:42:09 +02:00
  • a3aa4bce6f fix: support LLM provider compatibility options Valerio 2026-05-06 11:36:53 +02:00
  • 86183b11e4 docs: credit Windows release contribution Valerio 2026-05-05 11:44:07 +02:00
  • 513b0e493e ci: add Windows release artifacts SURYANSH MISHRA 2026-05-05 11:38:30 +02:00
  • 132f7bcef3 docs: mention Windows release zip Valerio 2026-05-05 11:36:10 +02:00
  • 2237472289 chore: normalize release workflow line endings Valerio 2026-05-05 11:34:58 +02:00
  • 93d3af8186 ci: run windows smoke on pull requests Valerio 2026-05-05 11:23:54 +02:00
  • b791c3597e ci: add temporary windows release smoke Valerio 2026-05-05 11:22:49 +02:00
  • a1242a1c1d docs: credit README badge refresh Valerio 2026-05-05 11:18:58 +02:00
  • a542e45768
    docs: refresh README badges Justin Levine 2026-05-05 02:17:21 -07:00
  • da0f8abeff feat: Add Windows x86_64-pc-windows-msvc binary support to release pipeline notrealsuryansh 2026-05-05 11:37:36 +05:30
  • 5cd5656862
    docs: replace shields.io badges with shieldcn badges Justin Levine 2026-05-03 21:23:55 -07:00
  • 615f326660 docs: update changelog for brand extraction Valerio 2026-05-04 21:52:49 +02:00
  • 72b8dbc285 fix: improve brand extraction signals v0.5.8 Valerio 2026-05-04 21:25:07 +02:00
  • 1c9def2fde fix: validate self-host route URLs consistently Valerio 2026-05-04 14:30:06 +02:00
  • eede2f6953 docs: credit SSRF report Valerio 2026-05-04 12:08:11 +02:00
  • bdf81fe6bf fix: harden fetch URL validation v0.5.7 Valerio 2026-05-04 11:50:57 +02:00
  • 23544f8fac docs(claude): note youtube.rs role and yt-dlp short-circuit in server Valerio 2026-05-03 21:17:23 +02:00
  • 923445f4a8 docs(readme): add h1 brand heading Valerio 2026-04-30 11:46:45 +02:00
  • 0e6c7cdc97
    Add GitHub Sponsors username to FUNDING.yml Valerio 2026-04-27 13:18:22 +02:00
  • 5795c5c422 docs(readme): add star history chart Valerio 2026-04-26 17:55:22 +02:00
  • 4908367720 docs(readme): add hosted API callout above Get Started Valerio 2026-04-26 17:15:44 +02:00
  • a5c3433372 fix(core+server): guard markdown pipe slice + detect trustpilot/reddit verify walls v0.5.6 Valerio 2026-04-23 15:26:31 +02:00
  • 966981bc42 fix(fetch): send bot-identifying UA on reddit .json API to bypass browser UA block Valerio 2026-04-23 15:17:04 +02:00
  • 866fa88aa0 fix(fetch): reject HTML verification pages served at .json reddit URL Valerio 2026-04-23 15:06:35 +02:00
  • b413d702b2 feat(fetch): add fetch_smart with Reddit + Akamai rescue paths, bump 0.5.6 Valerio 2026-04-23 14:59:29 +02:00
  • 98a177dec4 feat(cli): expose safari-ios browser profile + bump to 0.5.5 v0.5.5 Valerio 2026-04-23 13:32:55 +02:00
  • e1af2da509 docs(claude): drop sidecar references, mention ProductionFetcher Valerio 2026-04-23 13:25:23 +02:00
  • 2285c585b1 docs(changelog): simplify 0.5.4 entry v0.5.4 Valerio 2026-04-23 13:01:02 +02:00
  • b77767814a Bump to 0.5.4: SafariIos profile + Chrome fingerprint alignment + locale helper Valerio 2026-04-23 12:58:24 +02:00
  • 4bf11d902f fix(mcp): vertical_scrape uses Firefox profile, not default Chrome v0.5.3 Valerio 2026-04-22 23:18:11 +02:00
  • 0daa2fec1a feat(cli+mcp): vertical extractor support (28 extractors discoverable + callable) v0.5.2 Valerio 2026-04-22 21:41:15 +02:00
  • 058493bc8f feat(fetch): Fetcher trait so vertical extractors work under any HTTP backend v0.5.1 Valerio 2026-04-22 21:17:50 +02:00
  • aaa5103504 docs(claude): fix stale primp references, document wreq + Fetcher trait Valerio 2026-04-22 21:11:18 +02:00
  • 2373162c81 chore: release v0.5.0 (28 vertical extractors + cloud integration) v0.5.0 Valerio 2026-04-22 20:59:01 +02:00
  • b2e7dbf365 fix(extractors): perfect-score follow-ups (trustpilot 2025 schema, amazon/etsy fallbacks, cloud docs) Valerio 2026-04-22 17:49:50 +02:00
  • e10066f527 fix(cloud): synthesize HTML from cloud response instead of requesting raw html Valerio 2026-04-22 17:24:50 +02:00
  • a53578e45c fix(extractors): detect AWS WAF verifying-connection page, add OG fallback to ecommerce_product Valerio 2026-04-22 17:07:31 +02:00
  • 7f5eb93b65 feat(extractors): wave 6b, etsy_listing + HTML fallbacks for substack/youtube Valerio 2026-04-22 16:44:51 +02:00
  • 8cc727c2f2 feat(extractors): wave 6a, 5 easy verticals (27 total) Valerio 2026-04-22 16:33:35 +02:00
  • d8c9274a9c feat(extractors): wave 5 \u2014 Amazon, eBay, Trustpilot via cloud fallback Valerio 2026-04-22 16:16:11 +02:00
  • 0ab891bd6b refactor(cloud): consolidate CloudClient + smart_fetch into webclaw-fetch Valerio 2026-04-22 16:05:44 +02:00
  • 0221c151dc feat(extractors): wave 4 \u2014 ecommerce (shopify + generic JSON-LD) Valerio 2026-04-22 15:36:01 +02:00
  • 3bb0a4bca0 feat(extractors): add LinkedIn + Instagram with profile-to-posts fan-out Valerio 2026-04-22 14:39:49 +02:00
  • b041f3cddd feat(extractors): wave 2 \u2014 8 more verticals (14 total) Valerio 2026-04-22 14:20:21 +02:00
  • 86182ef28a fix(server): switch default browser profile to Firefox Valerio 2026-04-22 14:11:55 +02:00
  • 8ba7538c37 feat(extractors): add vertical extractors module + first 6 verticals Valerio 2026-04-22 14:11:43 +02:00
  • ccdb6d364b fix(ci): release workflow must include webclaw-server v0.4.0 Valerio 2026-04-22 12:44:14 +02:00
  • eff914e84f
    Merge pull request #31 from 0xMassi/feat/oss-webclaw-server Valerio 2026-04-22 12:30:23 +02:00
  • c7e5abea8f docs(changelog): v0.4.0 release notes (#26, #29, #30) Valerio 2026-04-22 12:25:44 +02:00
  • d71eebdacc fix(mcp): silence dead-code warning on tool_router field (closes #30) Valerio 2026-04-22 12:25:39 +02:00
  • d91ad9c1f4 feat(cli): add webclaw bench <url> subcommand (closes #26) Valerio 2026-04-22 12:25:29 +02:00
  • 2ba682adf3 feat(server): add OSS webclaw-server REST API binary (closes #29) Valerio 2026-04-22 12:25:11 +02:00
  • b4bfff120e
    fix(docker): entrypoint shim so child images with custom CMD work (#28) v0.3.19 Valerio 2026-04-17 15:57:47 +02:00
  • 3396dc8ce7 fix(docker): entrypoint shim so child images with custom CMD work Valerio 2026-04-17 15:53:34 +02:00
  • e27ee1f86f
    docs(benchmarks): reproducible 3-way comparison vs trafilatura + firecrawl (#25) Valerio 2026-04-17 14:46:19 +02:00
  • 6116d2b38c docs(benchmarks): reproducible 3-way comparison vs trafilatura + firecrawl Valerio 2026-04-17 14:42:22 +02:00
  • 0463b5e263 style: cargo fmt v0.3.18 Valerio 2026-04-17 12:03:22 +02:00
  • 7f0420bbf0
    fix(core): UTF-8 char boundary panic in find_content_position (#16) (#24) Valerio 2026-04-17 12:02:52 +02:00
  • 12d938fabf fix(core): UTF-8 char boundary panic in find_content_position (#16) Valerio 2026-04-17 11:58:54 +02:00
  • 095ae5d4b1
    polish(fetch,mcp): robots parser + firefox client cache + Acquire ordering (P3) (#23) v0.3.17 Valerio 2026-04-16 20:21:32 +02:00
  • 2214c83782 polish(fetch,mcp): robots parser + firefox client cache + Acquire ordering (P3) Valerio 2026-04-16 20:18:02 +02:00
  • d69c50a31d
    feat(fetch,llm): DoS hardening + glob validation + cleanup (P2) (#22) Valerio 2026-04-16 19:44:08 +02:00
  • 05a2e0eced chore: gitignore CLI research dumps, drop accidentally-tracked file Valerio 2026-04-16 19:40:16 +02:00
  • 98c30365a2 feat(fetch,llm): DoS hardening via response caps + glob validation (P2) Valerio 2026-04-16 19:39:37 +02:00