Commit graph

3393 commits

Author SHA1 Message Date
Sanjay Santhanam
5cc05d90f0 fix: avoid blocking audio writes
TTS responses were written synchronously from the async presentation pipeline, blocking concurrent requests. Offload byte writes to a worker thread and add a regression test that keeps the event loop responsive.
2026-07-18 17:46:31 -07:00
CREDO23
91aa265afb Merge remote-tracking branch 'upstream/dev' into feature-indeed-jobs-scraper
# Conflicts:
#	README.es.md
#	README.hi.md
#	README.md
#	README.pt-BR.md
#	README.zh-CN.md
#	surfsense_backend/tests/unit/capabilities/google_maps/test_registry.py
#	surfsense_backend/tests/unit/capabilities/reddit/test_registry.py
#	surfsense_backend/tests/unit/capabilities/youtube/test_registry.py
#	surfsense_mcp/mcp_server/features/scrapers/__init__.py
#	surfsense_web/content/docs/connectors/index.mdx
#	surfsense_web/content/docs/connectors/native/index.mdx
#	surfsense_web/content/docs/connectors/native/meta.json
#	surfsense_web/content/docs/how-to/mcp-server.mdx
#	surfsense_web/lib/connectors-marketing/index.ts
#	surfsense_web/lib/playground/catalog.ts
2026-07-18 22:11:30 +02:00
DESKTOP-RTLN3BA\$punk
87b0ba86e4 feat: bumped version to 0.0.34 2026-07-17 19:42:10 -07:00
DESKTOP-RTLN3BA\$punk
2cbe6fc111 feat: bumped version to 0.0.33 2026-07-17 17:23:21 -07:00
DESKTOP-RTLN3BA\$punk
bd7647b314 refactor: update README files and system prompts to include Amazon as a data source for AI agents, enhancing the platform's capabilities for live web research 2026-07-17 16:44:11 -07:00
DESKTOP-RTLN3BA\$punk
8a5d37a4db refactor: implement cross-country proxy rotation for Reddit and TikTok scrapers, enhancing resilience against IP blocks and improving search query handling 2026-07-17 16:30:26 -07:00
DESKTOP-RTLN3BA\$punk
c0ebb62fb2 chore: linting 2026-07-17 14:39:39 -07:00
DESKTOP-RTLN3BA\$punk
68d1832f10 refactor: enhance Google search scraping capabilities with warm sticky-IP pool and improved captcha handling 2026-07-17 03:27:43 -07:00
DESKTOP-RTLN3BA\$punk
7bc02ce55b refactor: update references from competitive intelligence to open web research across various components and documentation 2026-07-16 19:41:16 -07:00
DESKTOP-RTLN3BA\$punk
1917d76e10 refactor: update Google search system prompt and add Amazon route prefix 2026-07-16 17:39:08 -07:00
Anish Sarkar
2c4ebaeb7f feat(zero): publish thread title, visibility, created_by columns 2026-07-16 18:09:50 +05:30
Anish Sarkar
38b784fbac feat(workspaces): implement workspace limits feature with backend integration and UI updates 2026-07-16 15:44:49 +05:30
Rohan Verma
2de275f597
Merge pull request #1607 from Benebo7/fix/csrf-selfhosted-sameorigin
fix: add same origin check on csrf middleware
2026-07-15 16:31:00 -07:00
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Benebo7
67a8d50d6f fix: add same origin check on csrf middleware 2026-07-15 17:01:27 -03:00
CREDO23
c485fe4c43 fix: scrape indeed first page only, steer subagent to one query 2026-07-15 20:54:37 +02:00
CREDO23
6180b96912 fix: fail fast on gated indeed pagination, keep collected pages 2026-07-15 20:24:22 +02:00
CREDO23
b171002d15 test: add live indeed scraper e2e harness 2026-07-15 19:57:19 +02:00
CREDO23
b53f00231d fix: parse indeed /viewjob detail from window._rootProps 2026-07-15 19:57:19 +02:00
CREDO23
e19c876fbc feat: wire indeed connector into env, readmes, playground and marketing 2026-07-15 19:03:51 +02:00
CREDO23
9e37960243 test: pin indeed in subagent roster 2026-07-15 18:46:55 +02:00
CREDO23
3a9b0405c3 feat: add indeed to required-connector map 2026-07-15 18:46:55 +02:00
CREDO23
238d2767c5 feat: register indeed subagent in registry 2026-07-15 18:46:55 +02:00
CREDO23
e193867e77 feat: indeed subagent builder 2026-07-15 18:46:55 +02:00
CREDO23
e0cc816f67 feat: indeed subagent system prompt 2026-07-15 18:46:55 +02:00
CREDO23
723eb8c6cb feat: indeed subagent routing description 2026-07-15 18:46:55 +02:00
CREDO23
ada83efedf feat: wire indeed.scrape into subagent tools 2026-07-15 18:46:55 +02:00
CREDO23
7cbd8345f9 feat: indeed subagent tools package 2026-07-15 18:46:55 +02:00
CREDO23
2ade6bb903 feat: indeed subagent package 2026-07-15 18:46:55 +02:00
CREDO23
d2af2402b4 test: indeed detail and enrichment flow 2026-07-15 17:54:38 +02:00
CREDO23
38c98ba0e4 test: indeed detail parser 2026-07-15 17:54:38 +02:00
CREDO23
0b73581cbe test: indeed viewjob detail fixture 2026-07-15 17:54:38 +02:00
CREDO23
ec258d8387 feat: map scrape_job_details in indeed executor 2026-07-15 17:54:38 +02:00
CREDO23
81f535e9d0 feat: add scrape_job_details to indeed.scrape input 2026-07-15 17:54:38 +02:00
CREDO23
51c7220321 feat: indeed job-detail and enrichment flow 2026-07-15 17:54:38 +02:00
CREDO23
6ee95e5b2c feat: parse indeed /viewjob detail page 2026-07-15 17:54:38 +02:00
Anish Sarkar
78fe22735e test(amazon): update proxy configuration in AmazonScrapeInput to use residential proxy 2026-07-15 16:04:02 +05:30
Anish Sarkar
22d5a42e8d test: update BookStack connector test to disable deprecated indexing 2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units 2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd chore: ran linting 2026-07-15 15:48:54 +05:30
Anish Sarkar
07fe0203e3 test(amazon): cover localized scraper flows 2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907 test(amazon): cover block detection and localized price parsing 2026-07-15 15:32:29 +05:30
Anish Sarkar
6e4678c420 feat(amazon): apply marketplace locale across scraper flows 2026-07-15 15:32:21 +05:30
Anish Sarkar
53ccf575a6 fix(amazon): parse eu and us price decimal formats 2026-07-15 15:32:11 +05:30
Anish Sarkar
82e4272834 feat(amazon): route fetches through marketplace geo and language 2026-07-15 15:32:06 +05:30
Anish Sarkar
b47566c68d test(amazon): cover marketplace locale helpers 2026-07-15 15:31:59 +05:30
Anish Sarkar
952aca3de5 feat(amazon): add marketplace locale mapping 2026-07-15 15:31:53 +05:30
Anish Sarkar
e19c9b292f test(amazon): cover sticky proxy country rewrite 2026-07-15 15:31:48 +05:30
Anish Sarkar
b11fcfe57e test(proxy): cover dataimpulse geo country routing 2026-07-15 15:31:44 +05:30
Anish Sarkar
4fac1a20c3 feat(proxy): add geo country routing to proxy urls 2026-07-15 15:31:38 +05:30