DESKTOP-RTLN3BA\$punk
68d1832f10
refactor: enhance Google search scraping capabilities with warm sticky-IP pool and improved captcha handling
2026-07-17 03:27:43 -07:00
DESKTOP-RTLN3BA\$punk
7bc02ce55b
refactor: update references from competitive intelligence to open web research across various components and documentation
2026-07-16 19:41:16 -07:00
DESKTOP-RTLN3BA\$punk
1917d76e10
refactor: update Google search system prompt and add Amazon route prefix
2026-07-16 17:39:08 -07:00
Rohan Verma
2de275f597
Merge pull request #1607 from Benebo7/fix/csrf-selfhosted-sameorigin
...
fix: add same origin check on csrf middleware
2026-07-15 16:31:00 -07:00
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
...
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Benebo7
67a8d50d6f
fix: add same origin check on csrf middleware
2026-07-15 17:01:27 -03:00
Anish Sarkar
01308055dd
chore: ran linting
2026-07-15 15:48:54 +05:30
Anish Sarkar
6e4678c420
feat(amazon): apply marketplace locale across scraper flows
2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6
fix(amazon): parse eu and us price decimal formats
2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834
feat(amazon): route fetches through marketplace geo and language
2026-07-15 15:32:06 +05:30
Anish Sarkar
952aca3de5
feat(amazon): add marketplace locale mapping
2026-07-15 15:31:53 +05:30
Anish Sarkar
4fac1a20c3
feat(proxy): add geo country routing to proxy urls
2026-07-15 15:31:38 +05:30
Anish Sarkar
94b16a8334
fix(amazon): update anti-bot detection logic to include soft responses
2026-07-15 13:00:53 +05:30
Anish Sarkar
603c94c80b
feat(amazon): enhance product fetching and parsing logic for better offer retrieval
...
- Updated the fetch function to correctly construct the URL for the all-offers panel.
- Improved the product parser to include additional selectors for price and seller information.
- Added a fallback mechanism to retrieve seller information from the buy-box when not available in the standard link.
2026-07-15 11:04:46 +05:30
Anish Sarkar
69848b4c71
feat(amazon): register amazon subagent
2026-07-15 10:24:45 +05:30
Anish Sarkar
6888f0b8bb
feat(amazon): add subagent builder
2026-07-15 10:24:40 +05:30
Anish Sarkar
5a34435160
docs(amazon): add subagent description and system prompt
2026-07-15 10:24:34 +05:30
Anish Sarkar
03cd99194b
feat(amazon): add subagent capability tools
2026-07-15 10:24:22 +05:30
Anish Sarkar
21a7a0a0b0
feat(amazon): register scrape capability
2026-07-15 01:57:32 +05:30
Anish Sarkar
3e0caa2027
feat(amazon): add scrape capability schema, executor, definition
2026-07-15 01:57:24 +05:30
Anish Sarkar
118411ebca
docs(amazon): add module status readme
2026-07-15 01:56:34 +05:30
Anish Sarkar
f69a573d10
feat(amazon): expose public module api
2026-07-15 01:56:29 +05:30
Anish Sarkar
0cb15272ea
feat(amazon): add scraper orchestrator flows
2026-07-15 01:56:19 +05:30
Anish Sarkar
165f7464b3
feat(amazon): add proxy-aware fetch with captcha rotate
2026-07-15 01:56:02 +05:30
Anish Sarkar
1b6383f9bc
feat(amazon): add pure html parsers
2026-07-15 01:55:22 +05:30
Anish Sarkar
a0ab303768
feat(amazon): add start-url resolver
2026-07-15 01:55:15 +05:30
Anish Sarkar
4e5b039a05
feat(amazon): add scrape input and output schemas
2026-07-15 01:55:09 +05:30
Anish Sarkar
dafb0099c9
feat(proxy): add sticky-session proxy url support
2026-07-15 01:55:01 +05:30
Anish Sarkar
01fd6172ce
feat(billing): add amazon product billing unit and rate
2026-07-15 01:54:49 +05:30
Anish Sarkar
2d837ea18c
Merge remote-tracking branch 'upstream/dev' into fix/onboarding
2026-07-14 10:18:03 +05:30
DESKTOP-RTLN3BA\$punk
2b018c4474
refactor: streamline TikTok and Instagram scraping logic by removing search_queries and enhancing documentation for clarity
2026-07-13 17:11:25 -07:00
DESKTOP-RTLN3BA\$punk
1131da5ed7
feat: bumped version to 0.0.32
2026-07-13 16:29:39 -07:00
Rohan Verma
d3da875658
Merge pull request #1599 from Thibaultjaigu/feat/requesty-provider
...
feat: add Requesty as a model provider
2026-07-13 13:03:20 -07:00
Rohan Verma
d1fa9306cb
Merge pull request #1597 from zzh-github/feature/openai-compatible-raw
...
Add raw OpenAI-compatible provider without /v1 normalization
2026-07-13 13:02:19 -07:00
Anish Sarkar
91531286b2
fix: update terminology from "language model" to "chat model" across various components
2026-07-14 01:09:00 +05:30
Anish Sarkar
2f048d87bc
feat(model-connections): stamp own-model readiness and derive setup stage
2026-07-14 00:14:51 +05:30
Anish Sarkar
88d3d336bf
feat(schemas): add stage field to LlmSetupStatusRead
2026-07-14 00:14:34 +05:30
Anish Sarkar
007629443b
feat(db): add llm_setup_completed_at column to workspace
2026-07-14 00:14:28 +05:30
Thibault Jaigu
2ff7ea4cb6
feat: add Requesty as a model provider
...
Add Requesty (https://requesty.ai ), an OpenAI-compatible LLM router, as a
model provider by mirroring the existing OpenRouter integration.
Backend:
- app/services/requesty_model_normalizer.py: normalizes Requesty's /v1/models
catalogue, mapping its flat capability booleans (supports_tool_calling/
supports_vision/supports_image_generation) and context_window field onto the
shared normalized shape (Requesty differs from OpenRouter's architecture +
supported_parameters + context_length layout)
- provider_registry.py: Requesty ProviderSpec (OpenAI-compatible, base URL
https://router.requesty.ai/v1 , REQUESTY_API_KEY bearer auth)
- model_connection_service.py: key verification + live model discovery
- quality_score.py: Requesty score entry
- unit tests mirroring the OpenRouter normalizer coverage
Frontend:
- Requesty provider icon + registration, metadata entry, and base-url hint
Signed-off-by: Thibault Jaigu <thibault.jaigu@gmail.com>
2026-07-13 09:42:30 +01:00
zzh
a172e9c162
Add raw OpenAI-compatible provider without /v1 normalization
2026-07-13 00:08:30 +08:00
Anish Sarkar
561bc76a9a
feat(workspaces): return llm_setup on workspace create
2026-07-12 20:29:31 +05:30
Anish Sarkar
ff676519ea
feat(model-connections): derive workspace LLM setup status server-side
2026-07-12 20:29:26 +05:30
Anish Sarkar
1c2c480b92
feat(schemas): add LlmSetupStatusRead for server-authoritative onboarding
2026-07-12 20:29:19 +05:30
Anish Sarkar
e38ca19b18
Merge remote-tracking branch 'upstream/dev' into feat/instagram-scraper
2026-07-11 04:31:11 +05:30
Anish Sarkar
819486ac46
docs(instagram): document PolarisMedia extraction and richer media fields
2026-07-11 03:44:38 +05:30
Anish Sarkar
d3c65a37b1
refactor(instagram): drop unused slug field and mark share links unsupported
2026-07-11 03:44:28 +05:30
Anish Sarkar
4bc3d43b56
refactor(instagram): remove unused share-link redirect resolver
2026-07-11 03:44:23 +05:30
Anish Sarkar
452fe30aa4
refactor(instagram): drop login-walled comment fields and note search_type aliasing
2026-07-11 03:44:15 +05:30
Anish Sarkar
cb4adab852
feat(instagram): extract PolarisMedia relay JSON with carousel, tags, and location
2026-07-11 03:44:10 +05:30
Anish Sarkar
b1fe739308
docs(instagram): update platform scraper README
2026-07-11 03:25:36 +05:30
