Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
...
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Anish Sarkar
78fe22735e
test(amazon): update proxy configuration in AmazonScrapeInput to use residential proxy
2026-07-15 16:04:02 +05:30
Anish Sarkar
22d5a42e8d
test: update BookStack connector test to disable deprecated indexing
2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b
test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units
2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd
chore: ran linting
2026-07-15 15:48:54 +05:30
Anish Sarkar
07fe0203e3
test(amazon): cover localized scraper flows
2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907
test(amazon): cover block detection and localized price parsing
2026-07-15 15:32:29 +05:30
Anish Sarkar
6e4678c420
feat(amazon): apply marketplace locale across scraper flows
2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6
fix(amazon): parse eu and us price decimal formats
2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834
feat(amazon): route fetches through marketplace geo and language
2026-07-15 15:32:06 +05:30
Anish Sarkar
b47566c68d
test(amazon): cover marketplace locale helpers
2026-07-15 15:31:59 +05:30
Anish Sarkar
952aca3de5
feat(amazon): add marketplace locale mapping
2026-07-15 15:31:53 +05:30
Anish Sarkar
e19c9b292f
test(amazon): cover sticky proxy country rewrite
2026-07-15 15:31:48 +05:30
Anish Sarkar
b11fcfe57e
test(proxy): cover dataimpulse geo country routing
2026-07-15 15:31:44 +05:30
Anish Sarkar
4fac1a20c3
feat(proxy): add geo country routing to proxy urls
2026-07-15 15:31:38 +05:30
Anish Sarkar
94b16a8334
fix(amazon): update anti-bot detection logic to include soft responses
2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b
feat(amazon): enhance product fetching and parsing logic for better offer retrieval
...
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
8331440f4b
test(amazon): cover amazon subagent composition
2026-07-15 10:24:55 +05:30
Anish Sarkar
69848b4c71
feat(amazon): register amazon subagent
2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb
feat(amazon): add subagent builder
2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160
docs(amazon): add subagent description and system prompt
2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b
feat(amazon): add subagent capability tools
2026-07-15 10:24:22 +05:30
Anish Sarkar
46a10f22a9
chore(env): update environment variable documentation to include Amazon scraping rates
2026-07-15 09:59:45 +05:30
Anish Sarkar
e8010065f2
feat(amazon): add live e2e scraper script
2026-07-15 01:57:47 +05:30
Anish Sarkar
cdd9102cac
test(amazon): cover capability schema, executor, registry
2026-07-15 01:57:41 +05:30
Anish Sarkar
21a7a0a0b0
feat(amazon): register scrape capability
2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027
feat(amazon): add scrape capability schema, executor, definition
2026-07-15 01:57:24 +05:30
Anish Sarkar
b5b700c853
test(proxy): cover dataimpulse sticky-session urls
2026-07-15 01:57:12 +05:30
Anish Sarkar
f1ee166f19
test(amazon): cover orchestrator flows
2026-07-15 01:57:05 +05:30
Anish Sarkar
a7e854c815
test(amazon): cover html parsers against fixtures
2026-07-15 01:56:55 +05:30
Anish Sarkar
3dfcee697b
test(amazon): cover schema and url-resolver contract
2026-07-15 01:56:45 +05:30
Anish Sarkar
e8d4d8a1f9
test(amazon): add offline html fixtures
2026-07-15 01:56:42 +05:30
Anish Sarkar
118411ebca
docs(amazon): add module status readme
2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10
feat(amazon): expose public module api
2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea
feat(amazon): add scraper orchestrator flows
2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3
feat(amazon): add proxy-aware fetch with captcha rotate
2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc
feat(amazon): add pure html parsers
2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768
feat(amazon): add start-url resolver
2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05
feat(amazon): add scrape input and output schemas
2026-07-15 01:55:09 +05:30
Anish Sarkar
dafb0099c9
feat(proxy): add sticky-session proxy url support
2026-07-15 01:55:01 +05:30
Anish Sarkar
01fd6172ce
feat(billing): add amazon product billing unit and rate
2026-07-15 01:54:49 +05:30
Anish Sarkar
2d837ea18c
Merge remote-tracking branch 'upstream/dev' into fix/onboarding
2026-07-14 10:18:03 +05:30
DESKTOP-RTLN3BA\$punk
2b018c4474
refactor: streamline TikTok and Instagram scraping logic by removing search_queries and enhancing documentation for clarity
2026-07-13 17:11:25 -07:00
DESKTOP-RTLN3BA\$punk
1131da5ed7
feat: bumped version to 0.0.32
2026-07-13 16:29:39 -07:00
Rohan Verma
d3da875658
Merge pull request #1599 from Thibaultjaigu/feat/requesty-provider
...
feat: add Requesty as a model provider
2026-07-13 13:03:20 -07:00
Rohan Verma
d1fa9306cb
Merge pull request #1597 from zzh-github/feature/openai-compatible-raw
...
Add raw OpenAI-compatible provider without /v1 normalization
2026-07-13 13:02:19 -07:00
Anish Sarkar
91531286b2
fix: update terminology from "language model" to "chat model" across various components
2026-07-14 01:09:00 +05:30
Anish Sarkar
5ef944c574
test(model-connections): cover recovery stage and setup stamping
2026-07-14 00:14:59 +05:30
Anish Sarkar
2f048d87bc
feat(model-connections): stamp own-model readiness and derive setup stage
2026-07-14 00:14:51 +05:30
Anish Sarkar
88d3d336bf
feat(schemas): add stage field to LlmSetupStatusRead
2026-07-14 00:14:34 +05:30
