apunkt/webclaw
1
0
Fork 0
mirror of https://github.com/0xMassi/webclaw.git synced 2026-07-20 06:51:02 +02:00
Code Issues Projects Releases Packages Wiki Activity

Commit graph

  • e27ee1f86f
         docs(benchmarks): reproducible 3-way comparison vs trafilatura + firecrawl (#25) Valerio 2026-04-17 14:46:19 +02:00
  • 6116d2b38c docs(benchmarks): reproducible 3-way comparison vs trafilatura + firecrawl Valerio 2026-04-17 14:42:22 +02:00
  • 0463b5e263 style: cargo fmt v0.3.18 Valerio 2026-04-17 12:03:22 +02:00
  • 7f0420bbf0
         fix(core): UTF-8 char boundary panic in find_content_position (#16) (#24) Valerio 2026-04-17 12:02:52 +02:00
  • 12d938fabf fix(core): UTF-8 char boundary panic in find_content_position (#16) Valerio 2026-04-17 11:58:54 +02:00
  • 095ae5d4b1
         polish(fetch,mcp): robots parser + firefox client cache + Acquire ordering (P3) (#23) v0.3.17 Valerio 2026-04-16 20:21:32 +02:00
  • 2214c83782 polish(fetch,mcp): robots parser + firefox client cache + Acquire ordering (P3) Valerio 2026-04-16 20:18:02 +02:00
  • d69c50a31d
         feat(fetch,llm): DoS hardening + glob validation + cleanup (P2) (#22) Valerio 2026-04-16 19:44:08 +02:00
  • 05a2e0eced chore: gitignore CLI research dumps, drop accidentally-tracked file Valerio 2026-04-16 19:40:16 +02:00
  • 98c30365a2 feat(fetch,llm): DoS hardening via response caps + glob validation (P2) Valerio 2026-04-16 19:39:37 +02:00
  • 7773c8af2a
         fix(fetch): surface semaphore-closed as typed error instead of panic (P1) (#21) Valerio 2026-04-16 19:20:26 +02:00
  • 8a0a6fd8ce fix(fetch): surface semaphore-closed as typed error instead of panic (P1) Valerio 2026-04-16 19:14:00 +02:00
  • 1352f48e05
         fix(cli): close --on-change command injection via sh -c (P0) (#20) Valerio 2026-04-16 18:37:02 +02:00
  • 63e94af2e7 chore(brand): fix clippy 1.95 unnecessary_sort_by errors Valerio 2026-04-16 18:32:27 +02:00
  • 9645239fe8 fix(cli): close --on-change command injection via sh -c (P0) Valerio 2026-04-16 18:17:04 +02:00
  • 6316b1a6e7 fix: handle raw newlines in JSON-LD strings Valerio 2026-04-16 11:40:25 +02:00
  • 78e198a347 fix: use ENTRYPOINT instead of CMD in Dockerfiles for proper arg passthrough v0.3.13 Valerio 2026-04-14 20:24:26 +02:00
  • 050b2ef463 feat: add allow_subdomains and allow_external_links to CrawlConfig v0.3.12 Valerio 2026-04-14 19:33:06 +02:00
  • 2e4343905f fix(noxa-68r.4): replace qdrant-client with plain reqwest REST calls Jacob Magar 2026-04-12 08:48:47 -04:00
  • 5217b99601 feat(noxa-68r.8): daemon binary + README Jacob Magar 2026-04-12 07:23:33 -04:00
  • 9cde0d66ca feat(noxa-68r.7): filesystem watcher pipeline Jacob Magar 2026-04-12 07:21:37 -04:00
  • d66522b8ae feat(noxa-68r.6): factory and TOML config Jacob Magar 2026-04-12 07:18:53 -04:00
  • 20e880eea5 feat(noxa-68r.2,noxa-68r.3,noxa-68r.4): chunker, TEI provider, Qdrant store Jacob Magar 2026-04-12 07:17:57 -04:00
  • 62554b8f12 feat(noxa-68r.1): crate scaffold, traits, and core types Jacob Magar 2026-04-12 07:13:19 -04:00
  • adf4b6ba55 feat(llm): add Gemini CLI provider as primary; set qwen3.5:9b as default Ollama model Jacob Magar 2026-04-12 00:52:53 -04:00
  • 464eb1baec
         Merge pull request #2 from jmagar/feature/noxa-mcp-subcommand jmagar 2026-04-11 21:38:16 -04:00
  • a25103667e refactor: add noxa mcp subcommand Jacob Magar 2026-04-11 20:44:25 -04:00
  • 251979edfe perf(gemini-cli): skip MCP server startup via workspace settings override Jacob Magar 2026-04-11 20:23:33 -04:00
  • c018ea4a61 Sync env example with env contract Jacob Magar 2026-04-11 19:30:51 -04:00
  • 042feb7887 refactor(llm): move timing to dispatch layer; keep CLI eprintln Jacob Magar 2026-04-11 17:06:53 -04:00
  • 534855955b feat(cli): print LLM elapsed time to stderr Jacob Magar 2026-04-11 16:52:13 -04:00
  • b8fc1d7c75 chore: update Cargo.lock after adding serde to noxa-cli Jacob Magar 2026-04-11 12:35:49 -04:00
  • 1c112459bc fix: error on explicit missing config path; update env.example; add README config docs Jacob Magar 2026-04-11 12:35:21 -04:00
  • 10364416c1 chore: slim .env.example to secrets/URLs only Jacob Magar 2026-04-11 12:29:05 -04:00
  • 9acecba314 chore: add config.example.json and gitignore config.json Jacob Magar 2026-04-11 12:29:00 -04:00
  • f22051491f fix: use resolved config in raw_html selector guard; remove dead path_prefix fallback Jacob Magar 2026-04-11 12:28:29 -04:00
  • bac13fc1b5 feat: wire ResolvedConfig into main.rs via clap ValueSource Jacob Magar 2026-04-11 12:24:44 -04:00
  • e7583a5c51 docs: clarify doc comments on ResolvedConfig selector and raw_html fields Jacob Magar 2026-04-11 12:18:53 -04:00
  • 3bc6a9920b feat: add NoxaConfig and ResolvedConfig with load() Jacob Magar 2026-04-11 12:16:56 -04:00
  • cc1617a3a9 fix(gemini-cli): correct CLI invocation to match gemini v0.36 interface Jacob Magar 2026-04-11 12:16:21 -04:00
  • cfe455b752 feat: derive Deserialize on OutputFormat, Browser, PdfModeArg Jacob Magar 2026-04-11 12:13:25 -04:00
  • af304eda7f docs(noxa-9fw.4): describe gemini cli as primary llm backend Jacob Magar 2026-04-11 07:36:19 -04:00
  • 993fd6c45d feat(noxa-9fw.3): validate structured extraction output with one retry Jacob Magar 2026-04-11 07:34:58 -04:00
  • 420a1d7522 feat(noxa-9fw.2): make gemini cli the primary llm backend Jacob Magar 2026-04-11 07:32:24 -04:00
  • d800c37bfd feat(noxa-9fw.1): add gemini cli provider adapter Jacob Magar 2026-04-11 07:30:41 -04:00
  • 8674b60b4e chore: rebrand webclaw to noxa Jacob Magar 2026-04-11 00:10:38 -04:00
  • a4c351d5ae feat: add fallback sitemap paths for broader discovery v0.3.11 Valerio 2026-04-10 18:22:57 +02:00
  • 25b6282d5f style: fix rustfmt for 2-element delay array v0.3.10 Valerio 2026-04-10 17:21:53 +02:00
  • 954aabe3e8 perf: reduce fetch timeout to 12s and retries to 2 Valerio 2026-04-10 17:18:57 +02:00
  • 5ea646a332 fix: resolve clippy warnings from #14 (collapsible_if, manual_inspect) v0.3.9 Valerio 2026-04-04 15:28:59 +02:00
  • 3cf9dbaf2a chore: bump to 0.3.9, fix formatting from #14 Valerio 2026-04-04 15:24:17 +02:00
  • 87ecf4241f
         fix: layout tables, stack overflow, and noise filter (#14) Valerio 2026-04-04 15:20:08 +02:00
  • 70c67f2ed6 fix: prevent noise filter from swallowing content in malformed HTML devnen 2026-04-04 01:33:11 +02:00
  • 74bac87435 fix: prevent stack overflow on deeply nested HTML pages devnen 2026-04-03 23:45:19 +02:00
  • 95a6681b02 fix: detect layout tables and render as sections instead of markdown tables devnen 2026-04-03 22:24:35 +02:00
  • 1d2018c98e fix: MCP research saves to file, returns compact response v0.3.8 Valerio 2026-04-03 16:05:45 +02:00
  • f7cc0cc5cf feat: CLI --research flag + MCP cloud fallback + structured research output v0.3.7 Valerio 2026-04-03 14:04:04 +02:00
  • 344eea74d9 feat: structured data in markdown/LLM output + v0.3.6 v0.3.6 Valerio 2026-04-02 19:16:56 +02:00
  • b219fc3648 fix(ci): update all 4 Homebrew checksums after Docker build completes Valerio 2026-04-02 19:02:27 +02:00
  • 8d29382b25 feat: extract __NEXT_DATA__ into structured_data v0.3.5 Valerio 2026-04-02 16:04:51 +02:00
  • 4e81c3430d docs: update npm package license to AGPL-3.0 Valerio 2026-04-02 11:33:43 +02:00
  • c43da982c3 docs: update README license references from MIT to AGPL-3.0 Valerio 2026-04-02 11:28:40 +02:00
  • 84b2e6092e feat: SvelteKit data extraction + license change to AGPL-3.0 v0.3.4 Valerio 2026-04-01 20:37:56 +02:00
  • b4800e681c ci: fix aarch64 cross-compilation for BoringSSL (boring-sys2) v0.3.3 Valerio 2026-04-01 18:39:43 +02:00
  • a1b9a55048 chore: add SKILL.md to repo root for skills.sh discoverability Valerio 2026-04-01 18:27:17 +02:00
  • 124352e0b4 style: cargo fmt Valerio 2026-04-01 18:25:40 +02:00
  • 1a5d3d8aaf chore: remove reqwest_unstable rustflag (no longer needed) Valerio 2026-04-01 18:15:05 +02:00
  • 11b8f68f51 fix: update Dockerfile for BoringSSL build deps (cmake, clang) Valerio 2026-04-01 18:13:18 +02:00
  • aaf51eddef feat: replace custom TLS stack with wreq (BoringSSL), bump v0.3.3 Valerio 2026-04-01 18:04:55 +02:00
  • 7e2f65b939 docs: add webclaw-api documentation and DOKPLOY.md Rodrigo Motta 2026-03-31 21:54:49 -03:00
  • f76df1fdba feat: add webclaw-api rest server with axum Rodrigo Motta 2026-03-31 21:52:17 -03:00
  • cb4a7f3f06 feat: add support for SvelteKit and JS object literal extraction in structured data Rodrigo Motta 2026-03-31 19:44:25 -03:00
  • 0d0da265ab chore: bump to v0.3.2, update changelog v0.3.2 Valerio 2026-03-31 10:56:51 +02:00
  • da1d76c97a feat: add --cookie-file support for JSON cookie files Valerio 2026-03-31 10:54:53 +02:00
  • 44f23332cc style: collapse nested if per clippy v0.3.1 Valerio 2026-03-30 14:13:55 +02:00
  • 20c810b8d2 chore: bump v0.3.1, update CHANGELOG, fix fmt Valerio 2026-03-30 14:11:54 +02:00
  • 7041a1d992 feat: cookie warmup fallback for Akamai-protected pages Valerio 2026-03-30 14:09:31 +02:00
  • 75e0a9cdef chore: update webclaw-tls dependencies github-actions[bot] 2026-03-30 12:03:06 +00:00
  • b784a3fa1b chore: update webclaw-tls dependencies github-actions[bot] 2026-03-30 11:48:44 +00:00
  • 4cba36337b style: fix fmt in client.rs test Valerio 2026-03-30 12:18:57 +02:00
  • 199dab6dfa fix: adapt to webclaw-tls v0.1.1 HeaderMap API change Valerio 2026-03-30 12:09:50 +02:00
  • 68b9406ff5 chore: update webclaw-tls dependencies github-actions[bot] 2026-03-30 09:53:03 +00:00
  • 31f35fd895 ci: fix ambiguous reqwest version in dependency sync Valerio 2026-03-30 11:52:35 +02:00
  • 4f0c59ac7f ci: replace stale primp check with webclaw-tls dependency sync Valerio 2026-03-30 11:39:55 +02:00
  • ee3c714aa9 docs: update CONTRIBUTING.md for v0.3.0 architecture Valerio 2026-03-30 10:17:26 +02:00
  • e3b0d0bd74 fix: make reddit and linkedin modules public for server access Valerio 2026-03-29 16:54:35 +02:00
  • 7051d2193b docs: add v0.3.0 changelog entry Valerio 2026-03-29 16:47:04 +02:00
  • f275a93bec fix: clippy empty-line-after-doc-comment in browser.rs Valerio 2026-03-29 16:45:05 +02:00
  • 140234c139 style: cargo fmt Valerio 2026-03-29 16:43:11 +02:00
  • f13cb83c73 feat: replace primp with webclaw-tls, bump to v0.3.0 v0.3.0 Valerio 2026-03-29 16:40:10 +02:00
  • 17d805fb6d fix: add danger_accept_invalid_certs to plain TLS fallback clients djimenez18 2026-03-28 21:14:00 -05:00
  • 77e93441c0 fix(ci): add QEMU for arm64 apt-get in Docker build v0.2.3 Valerio 2026-03-27 20:51:51 +01:00
  • 8cf021a00b fix(ci): single Docker job with plain docker build + manifest Valerio 2026-03-27 20:45:05 +01:00
  • 78810793cf chore: align Cargo.toml version with v0.2.3 tag Valerio 2026-03-27 20:41:02 +01:00
  • ef120f6ec7 fix(ci): fix Docker binary path extraction from release tarball Valerio 2026-03-27 20:39:14 +01:00
  • 48a3c45b36 ci: use pre-built binaries for Docker instead of QEMU cross-compilation Valerio 2026-03-27 20:32:50 +01:00
  • dfcddd1973 ci: build multi-platform Docker images (amd64 + arm64) Valerio 2026-03-27 19:18:49 +01:00
  • 341f4737e1 test: v0.2.2 pre-release check v0.2.2 Valerio 2026-03-27 18:48:15 +01:00
  • 8b82ad12d0 ci: add weekly primp compatibility check Valerio 2026-03-27 18:45:45 +01:00
  • 76cb6b6cd7 fix: add reqwest to patch list, sync with primp 1.2.0 Valerio 2026-03-27 18:45:28 +01:00