apunkt/webclaw
1
0
Fork 0
mirror of https://github.com/0xMassi/webclaw.git synced 2026-06-07 22:15:12 +02:00
Code Issues Projects Releases Packages Wiki Activity

feat: SvelteKit data extraction + license change to AGPL-3.0

Browse source 
- Extract structured JSON from SvelteKit kit.start() data arrays
- Convert JS object literals (unquoted keys) to valid JSON
- Data appears in structured_data field (machine-readable)
- License changed from MIT to AGPL-3.0
- Bump to v0.3.4

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Valerio 2026-04-01 20:37:56 +02:00
parent b4800e681c
commit 84b2e6092e
7 changed files with 846 additions and 31 deletions
Download patch file Download diff file Expand all files Collapse all files

5
crates/webclaw-core/src/lib.rs
View file

@ -179,8 +179,9 @@ pub fn extract_with_options(
let domain_type = domain::detect(url, html);
let domain_data = Some(DomainData { domain_type });
// JSON-LD structured data (Schema.org Product, Article, etc.)
let structured_data = structured_data::extract_json_ld(html);
// Structured data: JSON-LD + SvelteKit data islands
let mut structured_data = structured_data::extract_json_ld(html);
structured_data.extend(structured_data::extract_sveltekit(html));
Ok(ExtractionResult {
metadata: meta,