Commit graph

3393 commits

Author SHA1 Message Date
Anish Sarkar
94b16a8334 fix(amazon): update anti-bot detection logic to include soft responses 2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b feat(amazon): enhance product fetching and parsing logic for better offer retrieval
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
8331440f4b test(amazon): cover amazon subagent composition 2026-07-15 10:24:55 +05:30
Anish Sarkar
69848b4c71 feat(amazon): register amazon subagent 2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb feat(amazon): add subagent builder 2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160 docs(amazon): add subagent description and system prompt 2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b feat(amazon): add subagent capability tools 2026-07-15 10:24:22 +05:30
Anish Sarkar
46a10f22a9 chore(env): update environment variable documentation to include Amazon scraping rates 2026-07-15 09:59:45 +05:30
Anish Sarkar
e8010065f2 feat(amazon): add live e2e scraper script 2026-07-15 01:57:47 +05:30
Anish Sarkar
cdd9102cac test(amazon): cover capability schema, executor, registry 2026-07-15 01:57:41 +05:30
Anish Sarkar
21a7a0a0b0 feat(amazon): register scrape capability 2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027 feat(amazon): add scrape capability schema, executor, definition 2026-07-15 01:57:24 +05:30
Anish Sarkar
b5b700c853 test(proxy): cover dataimpulse sticky-session urls 2026-07-15 01:57:12 +05:30
Anish Sarkar
f1ee166f19 test(amazon): cover orchestrator flows 2026-07-15 01:57:05 +05:30
Anish Sarkar
a7e854c815 test(amazon): cover html parsers against fixtures 2026-07-15 01:56:55 +05:30
Anish Sarkar
3dfcee697b test(amazon): cover schema and url-resolver contract 2026-07-15 01:56:45 +05:30
Anish Sarkar
e8d4d8a1f9 test(amazon): add offline html fixtures 2026-07-15 01:56:42 +05:30
Anish Sarkar
118411ebca docs(amazon): add module status readme 2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10 feat(amazon): expose public module api 2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea feat(amazon): add scraper orchestrator flows 2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3 feat(amazon): add proxy-aware fetch with captcha rotate 2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc feat(amazon): add pure html parsers 2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768 feat(amazon): add start-url resolver 2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05 feat(amazon): add scrape input and output schemas 2026-07-15 01:55:09 +05:30
Anish Sarkar
dafb0099c9 feat(proxy): add sticky-session proxy url support 2026-07-15 01:55:01 +05:30
Anish Sarkar
01fd6172ce feat(billing): add amazon product billing unit and rate 2026-07-15 01:54:49 +05:30
CREDO23
0089bb9001 test: assert youtube billing units 2026-07-14 21:50:52 +02:00
CREDO23
ffc0675ac2 test: assert google_maps billing units 2026-07-14 21:50:52 +02:00
CREDO23
dc945aa14d test: assert reddit.scrape billing unit 2026-07-14 21:50:52 +02:00
CREDO23
695a7d69e0 test: indeed.scrape executor mapping 2026-07-14 21:49:31 +02:00
CREDO23
d029bc0cb8 test: indeed.scrape registration 2026-07-14 21:49:31 +02:00
CREDO23
725cb8a82b test: indeed.scrape test package 2026-07-14 21:49:31 +02:00
CREDO23
4171248f51 test: indeed capability test package 2026-07-14 21:49:31 +02:00
CREDO23
ad49e9004e feat: register indeed namespace on routes 2026-07-14 21:49:23 +02:00
CREDO23
8c410d8682 feat: indeed capability namespace 2026-07-14 21:49:23 +02:00
CREDO23
17159172ee feat: indeed.scrape verb package 2026-07-14 21:49:23 +02:00
CREDO23
3f91a006cd feat: register indeed.scrape capability 2026-07-14 21:49:23 +02:00
CREDO23
b457599fd4 feat: indeed.scrape executor 2026-07-14 21:49:23 +02:00
CREDO23
e887c1cae7 feat: indeed.scrape io schemas 2026-07-14 21:49:23 +02:00
CREDO23
d89ca141a4 feat: meter indeed_job billing unit 2026-07-14 21:49:23 +02:00
CREDO23
e25d09c25e feat: add indeed per-job scrape rate config 2026-07-14 21:49:23 +02:00
CREDO23
05bfc6a10e feat: add INDEED_JOB billing unit 2026-07-14 21:49:23 +02:00
CREDO23
063faf4bd6 test: indeed scraper orchestration 2026-07-14 21:42:00 +02:00
CREDO23
a60aba112c test: indeed fetch rotation resilience 2026-07-14 21:42:00 +02:00
CREDO23
91e868fc26 test: indeed url resolver 2026-07-14 21:42:00 +02:00
CREDO23
37963c64f1 test: indeed parsers 2026-07-14 21:42:00 +02:00
CREDO23
3d6da91bf3 test: indeed trimmed jobcards fixture 2026-07-14 21:42:00 +02:00
CREDO23
794b127136 test: indeed_jobs test package 2026-07-14 21:42:00 +02:00
CREDO23
1d367148d0 feat: indeed_jobs package exports 2026-07-14 21:41:54 +02:00
CREDO23
824041ef7f feat: indeed scraper orchestrator with pagination and dedupe 2026-07-14 21:41:54 +02:00