Commit graph

3419 commits

Author SHA1 Message Date
CREDO23
3401b0ae0e add OKF package api 2026-07-21 19:58:52 +02:00
CREDO23
f448100888 add OKF conformance validator 2026-07-21 19:58:52 +02:00
CREDO23
d694bcd191 add OKF serializer 2026-07-21 19:58:52 +02:00
CREDO23
444839b0ec add OKF type mapping 2026-07-21 19:58:52 +02:00
CREDO23
ca317c4686 Merge remote-tracking branch 'upstream/dev' into feature-walmart-scraper
# Conflicts:
#	docker/.env.example
#	surfsense_backend/app/capabilities/core/billing.py
#	surfsense_backend/app/capabilities/core/types.py
#	surfsense_backend/app/config/__init__.py
#	surfsense_mcp/mcp_server/features/scrapers/__init__.py
#	surfsense_web/content/docs/connectors/index.mdx
#	surfsense_web/content/docs/connectors/native/index.mdx
#	surfsense_web/content/docs/how-to/mcp-server.mdx
2026-07-21 02:42:41 +02:00
Rohan Verma
2eed9b2ac8
Merge pull request #1613 from Sanjays2402/fix/nonblocking-audio-write
fix: avoid blocking audio writes
2026-07-19 16:17:05 -07:00
CREDO23
f6970b90e8 fix(walmart): parse category breadcrumb path into breadCrumbs and category 2026-07-19 09:10:03 +02:00
CREDO23
07721bda40 test(walmart): cover capability registry, schemas, and executors for both verbs 2026-07-19 08:49:10 +02:00
CREDO23
b5cddcfb2b docs(walmart): document billing rates in env examples 2026-07-19 08:49:10 +02:00
CREDO23
d7c30cac2f refactor(walmart): align reviews executor docstring 2026-07-19 08:45:27 +02:00
CREDO23
56e8fa13e6 feat(walmart): route product-review questions to marketplace specialists 2026-07-19 08:45:27 +02:00
CREDO23
cabc5b5c86 feat(walmart): register subagent in roster and connector map 2026-07-19 08:45:27 +02:00
CREDO23
f6a8a2a566 feat(walmart): add chat subagent with scrape and reviews tools 2026-07-19 08:45:27 +02:00
CREDO23
7b5e09c528 test(walmart): add parser and flow tests with e2e harness 2026-07-19 08:19:22 +02:00
CREDO23
a3f8a7e741 feat(walmart): register routes and MCP tools 2026-07-19 08:19:22 +02:00
CREDO23
9b9091ae97 feat(walmart): add scrape and reviews capabilities 2026-07-19 08:19:22 +02:00
CREDO23
d446aa32ec feat(walmart): add scrape and review orchestration 2026-07-19 08:19:22 +02:00
CREDO23
661bb8c187 feat(walmart): add JSON parsers 2026-07-19 08:19:22 +02:00
CREDO23
34b6885ba2 feat(walmart): add fetch with proxy rotation and block detection 2026-07-19 08:19:21 +02:00
CREDO23
dd3dba66af feat(walmart): add __NEXT_DATA__ extraction 2026-07-19 08:19:21 +02:00
CREDO23
be1fd0491f feat(walmart): add url resolver 2026-07-19 08:19:21 +02:00
CREDO23
a72cc3436c feat(walmart): add product and review schemas 2026-07-19 08:19:21 +02:00
CREDO23
0d2c8df5bd feat(walmart): add billing units and rate config 2026-07-19 08:19:21 +02:00
Sanjay Santhanam
5cc05d90f0 fix: avoid blocking audio writes
TTS responses were written synchronously from the async presentation pipeline, blocking concurrent requests. Offload byte writes to a worker thread and add a regression test that keeps the event loop responsive.
2026-07-18 17:46:31 -07:00
CREDO23
91aa265afb Merge remote-tracking branch 'upstream/dev' into feature-indeed-jobs-scraper
# Conflicts:
#	README.es.md
#	README.hi.md
#	README.md
#	README.pt-BR.md
#	README.zh-CN.md
#	surfsense_backend/tests/unit/capabilities/google_maps/test_registry.py
#	surfsense_backend/tests/unit/capabilities/reddit/test_registry.py
#	surfsense_backend/tests/unit/capabilities/youtube/test_registry.py
#	surfsense_mcp/mcp_server/features/scrapers/__init__.py
#	surfsense_web/content/docs/connectors/index.mdx
#	surfsense_web/content/docs/connectors/native/index.mdx
#	surfsense_web/content/docs/connectors/native/meta.json
#	surfsense_web/content/docs/how-to/mcp-server.mdx
#	surfsense_web/lib/connectors-marketing/index.ts
#	surfsense_web/lib/playground/catalog.ts
2026-07-18 22:11:30 +02:00
DESKTOP-RTLN3BA\$punk
87b0ba86e4 feat: bumped version to 0.0.34 2026-07-17 19:42:10 -07:00
DESKTOP-RTLN3BA\$punk
2cbe6fc111 feat: bumped version to 0.0.33 2026-07-17 17:23:21 -07:00
DESKTOP-RTLN3BA\$punk
bd7647b314 refactor: update README files and system prompts to include Amazon as a data source for AI agents, enhancing the platform's capabilities for live web research 2026-07-17 16:44:11 -07:00
DESKTOP-RTLN3BA\$punk
8a5d37a4db refactor: implement cross-country proxy rotation for Reddit and TikTok scrapers, enhancing resilience against IP blocks and improving search query handling 2026-07-17 16:30:26 -07:00
DESKTOP-RTLN3BA\$punk
c0ebb62fb2 chore: linting 2026-07-17 14:39:39 -07:00
DESKTOP-RTLN3BA\$punk
68d1832f10 refactor: enhance Google search scraping capabilities with warm sticky-IP pool and improved captcha handling 2026-07-17 03:27:43 -07:00
DESKTOP-RTLN3BA\$punk
7bc02ce55b refactor: update references from competitive intelligence to open web research across various components and documentation 2026-07-16 19:41:16 -07:00
DESKTOP-RTLN3BA\$punk
1917d76e10 refactor: update Google search system prompt and add Amazon route prefix 2026-07-16 17:39:08 -07:00
Anish Sarkar
2c4ebaeb7f feat(zero): publish thread title, visibility, created_by columns 2026-07-16 18:09:50 +05:30
Anish Sarkar
38b784fbac feat(workspaces): implement workspace limits feature with backend integration and UI updates 2026-07-16 15:44:49 +05:30
Rohan Verma
2de275f597
Merge pull request #1607 from Benebo7/fix/csrf-selfhosted-sameorigin
fix: add same origin check on csrf middleware
2026-07-15 16:31:00 -07:00
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Benebo7
67a8d50d6f fix: add same origin check on csrf middleware 2026-07-15 17:01:27 -03:00
CREDO23
c485fe4c43 fix: scrape indeed first page only, steer subagent to one query 2026-07-15 20:54:37 +02:00
CREDO23
6180b96912 fix: fail fast on gated indeed pagination, keep collected pages 2026-07-15 20:24:22 +02:00
CREDO23
b171002d15 test: add live indeed scraper e2e harness 2026-07-15 19:57:19 +02:00
CREDO23
b53f00231d fix: parse indeed /viewjob detail from window._rootProps 2026-07-15 19:57:19 +02:00
CREDO23
e19c876fbc feat: wire indeed connector into env, readmes, playground and marketing 2026-07-15 19:03:51 +02:00
CREDO23
9e37960243 test: pin indeed in subagent roster 2026-07-15 18:46:55 +02:00
CREDO23
3a9b0405c3 feat: add indeed to required-connector map 2026-07-15 18:46:55 +02:00
CREDO23
238d2767c5 feat: register indeed subagent in registry 2026-07-15 18:46:55 +02:00
CREDO23
e193867e77 feat: indeed subagent builder 2026-07-15 18:46:55 +02:00
CREDO23
e0cc816f67 feat: indeed subagent system prompt 2026-07-15 18:46:55 +02:00
CREDO23
723eb8c6cb feat: indeed subagent routing description 2026-07-15 18:46:55 +02:00
CREDO23
ada83efedf feat: wire indeed.scrape into subagent tools 2026-07-15 18:46:55 +02:00