Commit graph

7686 commits

Author SHA1 Message Date
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Anish Sarkar
78fe22735e test(amazon): update proxy configuration in AmazonScrapeInput to use residential proxy 2026-07-15 16:04:02 +05:30
Anish Sarkar
22d5a42e8d test: update BookStack connector test to disable deprecated indexing 2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units 2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd chore: ran linting 2026-07-15 15:48:54 +05:30
Anish Sarkar
aa3c62b754 feat(amazon): enhance playground with Amazon-specific field options and hints 2026-07-15 15:46:43 +05:30
Anish Sarkar
4abf95427b feat(web): surface eu marketplaces in amazon connector page 2026-07-15 15:33:07 +05:30
Anish Sarkar
92055846d1 docs(web): document amazon eu marketplace support 2026-07-15 15:32:58 +05:30
Anish Sarkar
07fe0203e3 test(amazon): cover localized scraper flows 2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907 test(amazon): cover block detection and localized price parsing 2026-07-15 15:32:29 +05:30
Anish Sarkar
6e4678c420 feat(amazon): apply marketplace locale across scraper flows 2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6 fix(amazon): parse eu and us price decimal formats 2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834 feat(amazon): route fetches through marketplace geo and language 2026-07-15 15:32:06 +05:30
Anish Sarkar
b47566c68d test(amazon): cover marketplace locale helpers 2026-07-15 15:31:59 +05:30
Anish Sarkar
952aca3de5 feat(amazon): add marketplace locale mapping 2026-07-15 15:31:53 +05:30
Anish Sarkar
e19c9b292f test(amazon): cover sticky proxy country rewrite 2026-07-15 15:31:48 +05:30
Anish Sarkar
b11fcfe57e test(proxy): cover dataimpulse geo country routing 2026-07-15 15:31:44 +05:30
Anish Sarkar
4fac1a20c3 feat(proxy): add geo country routing to proxy urls 2026-07-15 15:31:38 +05:30
Anish Sarkar
2265fcc513 refactor(connectors): update SVG icons for Google services 2026-07-15 13:39:33 +05:30
Anish Sarkar
94b16a8334 fix(amazon): update anti-bot detection logic to include soft responses 2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b feat(amazon): enhance product fetching and parsing logic for better offer retrieval
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
8331440f4b test(amazon): cover amazon subagent composition 2026-07-15 10:24:55 +05:30
Anish Sarkar
69848b4c71 feat(amazon): register amazon subagent 2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb feat(amazon): add subagent builder 2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160 docs(amazon): add subagent description and system prompt 2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b feat(amazon): add subagent capability tools 2026-07-15 10:24:22 +05:30
Anish Sarkar
2d9ee68285 feat(amazon): add Amazon Product API connector with detailed documentation and use cases 2026-07-15 10:15:48 +05:30
Anish Sarkar
8d7ea2b269 feat(selfcheck): register Amazon scraper tool in self-check configuration 2026-07-15 10:15:27 +05:30
Anish Sarkar
964ad2e083 feat(amazon): implement Amazon product scraper tool and register scraping functionality 2026-07-15 10:15:19 +05:30
Anish Sarkar
441f671ebc feat(amazon): add documentation for Amazon scraper API endpoint and input parameters 2026-07-15 10:14:15 +05:30
Rohan Verma
d5b5c9cda2
Merge pull request #1600 from AnishSarkar22/fix/onboarding
fix(onboarding): make LLM setup server-authoritative with recovery-aware gate
2026-07-14 21:38:07 -07:00
Anish Sarkar
46a10f22a9 chore(env): update environment variable documentation to include Amazon scraping rates 2026-07-15 09:59:45 +05:30
Anish Sarkar
564ac3180d feat(amazon): add Amazon SVG icon and update TikTok SVG for improved styling 2026-07-15 02:09:07 +05:30
Anish Sarkar
16404cb9d0 feat(web): add amazon platform to playground catalog 2026-07-15 01:57:57 +05:30
Anish Sarkar
e8010065f2 feat(amazon): add live e2e scraper script 2026-07-15 01:57:47 +05:30
Anish Sarkar
cdd9102cac test(amazon): cover capability schema, executor, registry 2026-07-15 01:57:41 +05:30
Anish Sarkar
21a7a0a0b0 feat(amazon): register scrape capability 2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027 feat(amazon): add scrape capability schema, executor, definition 2026-07-15 01:57:24 +05:30
Anish Sarkar
b5b700c853 test(proxy): cover dataimpulse sticky-session urls 2026-07-15 01:57:12 +05:30
Anish Sarkar
f1ee166f19 test(amazon): cover orchestrator flows 2026-07-15 01:57:05 +05:30
Anish Sarkar
a7e854c815 test(amazon): cover html parsers against fixtures 2026-07-15 01:56:55 +05:30
Anish Sarkar
3dfcee697b test(amazon): cover schema and url-resolver contract 2026-07-15 01:56:45 +05:30
Anish Sarkar
e8d4d8a1f9 test(amazon): add offline html fixtures 2026-07-15 01:56:42 +05:30
Anish Sarkar
118411ebca docs(amazon): add module status readme 2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10 feat(amazon): expose public module api 2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea feat(amazon): add scraper orchestrator flows 2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3 feat(amazon): add proxy-aware fetch with captcha rotate 2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc feat(amazon): add pure html parsers 2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768 feat(amazon): add start-url resolver 2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05 feat(amazon): add scrape input and output schemas 2026-07-15 01:55:09 +05:30