Commit graph

3267 commits

Author SHA1 Message Date
Anish Sarkar
22d5a42e8d test: update BookStack connector test to disable deprecated indexing 2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units 2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd chore: ran linting 2026-07-15 15:48:54 +05:30
Anish Sarkar
07fe0203e3 test(amazon): cover localized scraper flows 2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907 test(amazon): cover block detection and localized price parsing 2026-07-15 15:32:29 +05:30
Anish Sarkar
6e4678c420 feat(amazon): apply marketplace locale across scraper flows 2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6 fix(amazon): parse eu and us price decimal formats 2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834 feat(amazon): route fetches through marketplace geo and language 2026-07-15 15:32:06 +05:30
Anish Sarkar
b47566c68d test(amazon): cover marketplace locale helpers 2026-07-15 15:31:59 +05:30
Anish Sarkar
952aca3de5 feat(amazon): add marketplace locale mapping 2026-07-15 15:31:53 +05:30
Anish Sarkar
e19c9b292f test(amazon): cover sticky proxy country rewrite 2026-07-15 15:31:48 +05:30
Anish Sarkar
b11fcfe57e test(proxy): cover dataimpulse geo country routing 2026-07-15 15:31:44 +05:30
Anish Sarkar
4fac1a20c3 feat(proxy): add geo country routing to proxy urls 2026-07-15 15:31:38 +05:30
Anish Sarkar
94b16a8334 fix(amazon): update anti-bot detection logic to include soft responses 2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b feat(amazon): enhance product fetching and parsing logic for better offer retrieval
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
8331440f4b test(amazon): cover amazon subagent composition 2026-07-15 10:24:55 +05:30
Anish Sarkar
69848b4c71 feat(amazon): register amazon subagent 2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb feat(amazon): add subagent builder 2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160 docs(amazon): add subagent description and system prompt 2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b feat(amazon): add subagent capability tools 2026-07-15 10:24:22 +05:30
Anish Sarkar
46a10f22a9 chore(env): update environment variable documentation to include Amazon scraping rates 2026-07-15 09:59:45 +05:30
Anish Sarkar
e8010065f2 feat(amazon): add live e2e scraper script 2026-07-15 01:57:47 +05:30
Anish Sarkar
cdd9102cac test(amazon): cover capability schema, executor, registry 2026-07-15 01:57:41 +05:30
Anish Sarkar
21a7a0a0b0 feat(amazon): register scrape capability 2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027 feat(amazon): add scrape capability schema, executor, definition 2026-07-15 01:57:24 +05:30
Anish Sarkar
b5b700c853 test(proxy): cover dataimpulse sticky-session urls 2026-07-15 01:57:12 +05:30
Anish Sarkar
f1ee166f19 test(amazon): cover orchestrator flows 2026-07-15 01:57:05 +05:30
Anish Sarkar
a7e854c815 test(amazon): cover html parsers against fixtures 2026-07-15 01:56:55 +05:30
Anish Sarkar
3dfcee697b test(amazon): cover schema and url-resolver contract 2026-07-15 01:56:45 +05:30
Anish Sarkar
e8d4d8a1f9 test(amazon): add offline html fixtures 2026-07-15 01:56:42 +05:30
Anish Sarkar
118411ebca docs(amazon): add module status readme 2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10 feat(amazon): expose public module api 2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea feat(amazon): add scraper orchestrator flows 2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3 feat(amazon): add proxy-aware fetch with captcha rotate 2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc feat(amazon): add pure html parsers 2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768 feat(amazon): add start-url resolver 2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05 feat(amazon): add scrape input and output schemas 2026-07-15 01:55:09 +05:30
Anish Sarkar
dafb0099c9 feat(proxy): add sticky-session proxy url support 2026-07-15 01:55:01 +05:30
Anish Sarkar
01fd6172ce feat(billing): add amazon product billing unit and rate 2026-07-15 01:54:49 +05:30
DESKTOP-RTLN3BA\$punk
2b018c4474 refactor: streamline TikTok and Instagram scraping logic by removing search_queries and enhancing documentation for clarity 2026-07-13 17:11:25 -07:00
DESKTOP-RTLN3BA\$punk
1131da5ed7 feat: bumped version to 0.0.32 2026-07-13 16:29:39 -07:00
Rohan Verma
d3da875658
Merge pull request #1599 from Thibaultjaigu/feat/requesty-provider
feat: add Requesty as a model provider
2026-07-13 13:03:20 -07:00
Rohan Verma
d1fa9306cb
Merge pull request #1597 from zzh-github/feature/openai-compatible-raw
Add raw OpenAI-compatible provider without /v1 normalization
2026-07-13 13:02:19 -07:00
Thibault Jaigu
2ff7ea4cb6 feat: add Requesty as a model provider
Add Requesty (https://requesty.ai), an OpenAI-compatible LLM router, as a
model provider by mirroring the existing OpenRouter integration.

Backend:
- app/services/requesty_model_normalizer.py: normalizes Requesty's /v1/models
  catalogue, mapping its flat capability booleans (supports_tool_calling/
  supports_vision/supports_image_generation) and context_window field onto the
  shared normalized shape (Requesty differs from OpenRouter's architecture +
  supported_parameters + context_length layout)
- provider_registry.py: Requesty ProviderSpec (OpenAI-compatible, base URL
  https://router.requesty.ai/v1, REQUESTY_API_KEY bearer auth)
- model_connection_service.py: key verification + live model discovery
- quality_score.py: Requesty score entry
- unit tests mirroring the OpenRouter normalizer coverage

Frontend:
- Requesty provider icon + registration, metadata entry, and base-url hint

Signed-off-by: Thibault Jaigu <thibault.jaigu@gmail.com>
2026-07-13 09:42:30 +01:00
zzh
a172e9c162 Add raw OpenAI-compatible provider without /v1 normalization 2026-07-13 00:08:30 +08:00
Benebo7
6e0b8516dc fix: correct invalid placeholder values in backed .env.example 2026-07-11 14:53:35 -03:00
Anish Sarkar
e38ca19b18 Merge remote-tracking branch 'upstream/dev' into feat/instagram-scraper 2026-07-11 04:31:11 +05:30
Anish Sarkar
819486ac46 docs(instagram): document PolarisMedia extraction and richer media fields 2026-07-11 03:44:38 +05:30
Anish Sarkar
75c3addd2b test(instagram): cover PolarisMedia relay parsing and enriched media fields 2026-07-11 03:44:33 +05:30
Anish Sarkar
d3c65a37b1 refactor(instagram): drop unused slug field and mark share links unsupported 2026-07-11 03:44:28 +05:30