Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
...
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Anish Sarkar
78fe22735e
test(amazon): update proxy configuration in AmazonScrapeInput to use residential proxy
2026-07-15 16:04:02 +05:30
Anish Sarkar
22d5a42e8d
test: update BookStack connector test to disable deprecated indexing
2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b
test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units
2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd
chore: ran linting
2026-07-15 15:48:54 +05:30
Anish Sarkar
aa3c62b754
feat(amazon): enhance playground with Amazon-specific field options and hints
2026-07-15 15:46:43 +05:30
Anish Sarkar
4abf95427b
feat(web): surface eu marketplaces in amazon connector page
2026-07-15 15:33:07 +05:30
Anish Sarkar
92055846d1
docs(web): document amazon eu marketplace support
2026-07-15 15:32:58 +05:30
Anish Sarkar
07fe0203e3
test(amazon): cover localized scraper flows
2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907
test(amazon): cover block detection and localized price parsing
2026-07-15 15:32:29 +05:30
Anish Sarkar
6e4678c420
feat(amazon): apply marketplace locale across scraper flows
2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6
fix(amazon): parse eu and us price decimal formats
2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834
feat(amazon): route fetches through marketplace geo and language
2026-07-15 15:32:06 +05:30
Anish Sarkar
b47566c68d
test(amazon): cover marketplace locale helpers
2026-07-15 15:31:59 +05:30
Anish Sarkar
952aca3de5
feat(amazon): add marketplace locale mapping
2026-07-15 15:31:53 +05:30
Anish Sarkar
e19c9b292f
test(amazon): cover sticky proxy country rewrite
2026-07-15 15:31:48 +05:30
Anish Sarkar
b11fcfe57e
test(proxy): cover dataimpulse geo country routing
2026-07-15 15:31:44 +05:30
Anish Sarkar
4fac1a20c3
feat(proxy): add geo country routing to proxy urls
2026-07-15 15:31:38 +05:30
Anish Sarkar
2265fcc513
refactor(connectors): update SVG icons for Google services
2026-07-15 13:39:33 +05:30
Anish Sarkar
94b16a8334
fix(amazon): update anti-bot detection logic to include soft responses
2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b
feat(amazon): enhance product fetching and parsing logic for better offer retrieval
...
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
8331440f4b
test(amazon): cover amazon subagent composition
2026-07-15 10:24:55 +05:30
Anish Sarkar
69848b4c71
feat(amazon): register amazon subagent
2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb
feat(amazon): add subagent builder
2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160
docs(amazon): add subagent description and system prompt
2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b
feat(amazon): add subagent capability tools
2026-07-15 10:24:22 +05:30
Anish Sarkar
2d9ee68285
feat(amazon): add Amazon Product API connector with detailed documentation and use cases
2026-07-15 10:15:48 +05:30
Anish Sarkar
8d7ea2b269
feat(selfcheck): register Amazon scraper tool in self-check configuration
2026-07-15 10:15:27 +05:30
Anish Sarkar
964ad2e083
feat(amazon): implement Amazon product scraper tool and register scraping functionality
2026-07-15 10:15:19 +05:30
Anish Sarkar
441f671ebc
feat(amazon): add documentation for Amazon scraper API endpoint and input parameters
2026-07-15 10:14:15 +05:30
Rohan Verma
d5b5c9cda2
Merge pull request #1600 from AnishSarkar22/fix/onboarding
...
fix(onboarding): make LLM setup server-authoritative with recovery-aware gate
2026-07-14 21:38:07 -07:00
Anish Sarkar
46a10f22a9
chore(env): update environment variable documentation to include Amazon scraping rates
2026-07-15 09:59:45 +05:30
Anish Sarkar
564ac3180d
feat(amazon): add Amazon SVG icon and update TikTok SVG for improved styling
2026-07-15 02:09:07 +05:30
Anish Sarkar
16404cb9d0
feat(web): add amazon platform to playground catalog
2026-07-15 01:57:57 +05:30
Anish Sarkar
e8010065f2
feat(amazon): add live e2e scraper script
2026-07-15 01:57:47 +05:30
Anish Sarkar
cdd9102cac
test(amazon): cover capability schema, executor, registry
2026-07-15 01:57:41 +05:30
Anish Sarkar
21a7a0a0b0
feat(amazon): register scrape capability
2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027
feat(amazon): add scrape capability schema, executor, definition
2026-07-15 01:57:24 +05:30
Anish Sarkar
b5b700c853
test(proxy): cover dataimpulse sticky-session urls
2026-07-15 01:57:12 +05:30
Anish Sarkar
f1ee166f19
test(amazon): cover orchestrator flows
2026-07-15 01:57:05 +05:30
Anish Sarkar
a7e854c815
test(amazon): cover html parsers against fixtures
2026-07-15 01:56:55 +05:30
Anish Sarkar
3dfcee697b
test(amazon): cover schema and url-resolver contract
2026-07-15 01:56:45 +05:30
Anish Sarkar
e8d4d8a1f9
test(amazon): add offline html fixtures
2026-07-15 01:56:42 +05:30
Anish Sarkar
118411ebca
docs(amazon): add module status readme
2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10
feat(amazon): expose public module api
2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea
feat(amazon): add scraper orchestrator flows
2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3
feat(amazon): add proxy-aware fetch with captcha rotate
2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc
feat(amazon): add pure html parsers
2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768
feat(amazon): add start-url resolver
2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05
feat(amazon): add scrape input and output schemas
2026-07-15 01:55:09 +05:30