mirror of
https://github.com/0xMassi/webclaw.git
synced 2026-07-19 06:41:02 +02:00
fix: handle raw newlines in JSON-LD strings
Some checks are pending
CI / Test (push) Waiting to run
CI / Lint (push) Waiting to run
CI / Docs (push) Waiting to run
Some checks are pending
CI / Test (push) Waiting to run
CI / Lint (push) Waiting to run
CI / Docs (push) Waiting to run
Sites like Bluesky emit JSON-LD with literal newline characters inside string values (technically invalid JSON). Add sanitize_json_newlines() fallback that escapes control characters inside quoted strings before retrying the parse. This recovers ProfilePage, Product, and other structured data that was previously silently dropped. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
parent
78e198a347
commit
6316b1a6e7
5 changed files with 1266 additions and 8 deletions
24
smithery.yaml
Normal file
24
smithery.yaml
Normal file
|
|
@ -0,0 +1,24 @@
|
|||
# Smithery configuration — https://smithery.ai/docs/build/project-config
|
||||
# webclaw MCP server: web extraction for AI agents with bot-protection bypass
|
||||
|
||||
startCommand:
|
||||
type: stdio
|
||||
configSchema:
|
||||
type: object
|
||||
properties:
|
||||
apiKey:
|
||||
type: string
|
||||
description: >
|
||||
webclaw API key from webclaw.io. Optional — the server works
|
||||
locally without one. Set this for automatic fallback to the
|
||||
webclaw cloud API when a site has bot protection or requires
|
||||
JS rendering.
|
||||
secret: true
|
||||
commandFunction: |
|
||||
(config) => ({
|
||||
command: 'webclaw-mcp',
|
||||
args: [],
|
||||
env: config.apiKey ? { WEBCLAW_API_KEY: config.apiKey } : {}
|
||||
})
|
||||
exampleConfig:
|
||||
apiKey: wc_your_api_key_here
|
||||
Loading…
Add table
Add a link
Reference in a new issue