DESKTOP-RTLN3BA\$punk
87b0ba86e4
feat: bumped version to 0.0.34
2026-07-17 19:42:10 -07:00
DESKTOP-RTLN3BA\$punk
2cbe6fc111
feat: bumped version to 0.0.33
2026-07-17 17:23:21 -07:00
DESKTOP-RTLN3BA\$punk
bd7647b314
refactor: update README files and system prompts to include Amazon as a data source for AI agents, enhancing the platform's capabilities for live web research
2026-07-17 16:44:11 -07:00
DESKTOP-RTLN3BA\$punk
8a5d37a4db
refactor: implement cross-country proxy rotation for Reddit and TikTok scrapers, enhancing resilience against IP blocks and improving search query handling
2026-07-17 16:30:26 -07:00
DESKTOP-RTLN3BA\$punk
c0ebb62fb2
chore: linting
2026-07-17 14:39:39 -07:00
DESKTOP-RTLN3BA\$punk
68d1832f10
refactor: enhance Google search scraping capabilities with warm sticky-IP pool and improved captcha handling
2026-07-17 03:27:43 -07:00
DESKTOP-RTLN3BA\$punk
7bc02ce55b
refactor: update references from competitive intelligence to open web research across various components and documentation
2026-07-16 19:41:16 -07:00
DESKTOP-RTLN3BA\$punk
1917d76e10
refactor: update Google search system prompt and add Amazon route prefix
2026-07-16 17:39:08 -07:00
Rohan Verma
2de275f597
Merge pull request #1607 from Benebo7/fix/csrf-selfhosted-sameorigin
...
fix: add same origin check on csrf middleware
2026-07-15 16:31:00 -07:00
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
...
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Benebo7
67a8d50d6f
fix: add same origin check on csrf middleware
2026-07-15 17:01:27 -03:00
Anish Sarkar
78fe22735e
test(amazon): update proxy configuration in AmazonScrapeInput to use residential proxy
2026-07-15 16:04:02 +05:30
Anish Sarkar
22d5a42e8d
test: update BookStack connector test to disable deprecated indexing
2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b
test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units
2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd
chore: ran linting
2026-07-15 15:48:54 +05:30
Anish Sarkar
07fe0203e3
test(amazon): cover localized scraper flows
2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907
test(amazon): cover block detection and localized price parsing
2026-07-15 15:32:29 +05:30
Anish Sarkar
6e4678c420
feat(amazon): apply marketplace locale across scraper flows
2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6
fix(amazon): parse eu and us price decimal formats
2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834
feat(amazon): route fetches through marketplace geo and language
2026-07-15 15:32:06 +05:30
Anish Sarkar
b47566c68d
test(amazon): cover marketplace locale helpers
2026-07-15 15:31:59 +05:30
Anish Sarkar
952aca3de5
feat(amazon): add marketplace locale mapping
2026-07-15 15:31:53 +05:30
Anish Sarkar
e19c9b292f
test(amazon): cover sticky proxy country rewrite
2026-07-15 15:31:48 +05:30
Anish Sarkar
b11fcfe57e
test(proxy): cover dataimpulse geo country routing
2026-07-15 15:31:44 +05:30
Anish Sarkar
4fac1a20c3
feat(proxy): add geo country routing to proxy urls
2026-07-15 15:31:38 +05:30
Anish Sarkar
94b16a8334
fix(amazon): update anti-bot detection logic to include soft responses
2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b
feat(amazon): enhance product fetching and parsing logic for better offer retrieval
...
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
8331440f4b
test(amazon): cover amazon subagent composition
2026-07-15 10:24:55 +05:30
Anish Sarkar
69848b4c71
feat(amazon): register amazon subagent
2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb
feat(amazon): add subagent builder
2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160
docs(amazon): add subagent description and system prompt
2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b
feat(amazon): add subagent capability tools
2026-07-15 10:24:22 +05:30
Anish Sarkar
46a10f22a9
chore(env): update environment variable documentation to include Amazon scraping rates
2026-07-15 09:59:45 +05:30
Anish Sarkar
e8010065f2
feat(amazon): add live e2e scraper script
2026-07-15 01:57:47 +05:30
Anish Sarkar
cdd9102cac
test(amazon): cover capability schema, executor, registry
2026-07-15 01:57:41 +05:30
Anish Sarkar
21a7a0a0b0
feat(amazon): register scrape capability
2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027
feat(amazon): add scrape capability schema, executor, definition
2026-07-15 01:57:24 +05:30
Anish Sarkar
b5b700c853
test(proxy): cover dataimpulse sticky-session urls
2026-07-15 01:57:12 +05:30
Anish Sarkar
f1ee166f19
test(amazon): cover orchestrator flows
2026-07-15 01:57:05 +05:30
Anish Sarkar
a7e854c815
test(amazon): cover html parsers against fixtures
2026-07-15 01:56:55 +05:30
Anish Sarkar
3dfcee697b
test(amazon): cover schema and url-resolver contract
2026-07-15 01:56:45 +05:30
Anish Sarkar
e8d4d8a1f9
test(amazon): add offline html fixtures
2026-07-15 01:56:42 +05:30
Anish Sarkar
118411ebca
docs(amazon): add module status readme
2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10
feat(amazon): expose public module api
2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea
feat(amazon): add scraper orchestrator flows
2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3
feat(amazon): add proxy-aware fetch with captcha rotate
2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc
feat(amazon): add pure html parsers
2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768
feat(amazon): add start-url resolver
2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05
feat(amazon): add scrape input and output schemas
2026-07-15 01:55:09 +05:30
Anish Sarkar
dafb0099c9
feat(proxy): add sticky-session proxy url support
2026-07-15 01:55:01 +05:30
