DESKTOP-RTLN3BA\$punk
1c8a15dfab
refactor: consolidate browser loop management across Google Search, Indeed Jobs, and Reddit platforms
2026-07-24 15:01:01 -07:00
DESKTOP-RTLN3BA\$punk
4a727a2c57
chore: linting
2026-07-24 14:30:46 -07:00
Anish Sarkar
6068472ecc
feat(tests): add unit tests for community listing scraping and name normalization
2026-07-25 02:55:12 +05:30
Anish Sarkar
a2d5467023
Merge remote-tracking branch 'upstream/dev' into fix/models
2026-07-25 00:32:12 +05:30
CREDO23
06c7e27c72
Merge remote-tracking branch 'upstream/dev' into fixes-playground-ui
...
# Conflicts:
# surfsense_web/lib/apis/base-api.service.ts
2026-07-24 08:29:39 +02:00
CREDO23
0118744c20
fix: strip 'body' root from validation error summary
2026-07-23 19:39:15 +02:00
CREDO23
6330d5a789
fix: reject spoofed non-YouTube URLs
2026-07-23 18:52:50 +02:00
CREDO23
a123c95703
feat: validate web.crawl start URLs
2026-07-23 18:52:32 +02:00
CREDO23
797dd2df47
feat: add HttpUrlStr shared URL validator
2026-07-23 18:52:32 +02:00
DESKTOP-RTLN3BA\$punk
dbedf0cfa5
feat(backend): integrate PostHog analytics for enhanced observability
...
- Added PostHog configuration options to .env.example files for both Docker and Surfsense backend.
- Introduced PostHog dependency in pyproject.toml.
- Implemented analytics middleware to capture various events across the application, including user authentication, automation runs, and API requests.
- Enhanced existing routes and services to emit analytics events, providing insights into user interactions and system performance.
- Ensured graceful shutdown of analytics clients in worker processes and application lifecycles.
2026-07-22 22:16:28 -07:00
Rohan Verma
ca4f231577
Merge pull request #1619 from CREDO23/feat-run-citations
...
[Feat] Cite scraper runs as verifiable sources in chat
2026-07-22 14:53:45 -07:00
Rohan Verma
110102c3c0
Merge pull request #1609 from AnishSarkar22/fix/tabs
...
refactor(tabs): pointer-based tabs with live react-query resolution, workspace limits, and UI polish
2026-07-22 14:53:29 -07:00
CREDO23
47d35faeed
test: guard capability tool runtime injection
2026-07-22 20:06:18 +02:00
CREDO23
d356605a0d
test: capability tool mints run citation
2026-07-22 19:35:04 +02:00
CREDO23
120eb1f31b
test: cover run citation registration
2026-07-22 19:35:04 +02:00
Rohan Verma
08d431454f
Merge pull request #1617 from CREDO23/feature-okf
...
[Feat] Serve the knowledge base in Open Knowledge Format (OKF)
2026-07-21 15:39:59 -07:00
Anish Sarkar
9fd5d3571c
Merge remote-tracking branch 'upstream/dev' into fix/tabs
2026-07-22 00:02:26 +05:30
CREDO23
9a18392484
test: tidy concept-identity roundtrip docstring
2026-07-21 19:59:01 +02:00
CREDO23
bdc03670a5
test: OKF bundle conformance audit
2026-07-21 19:59:01 +02:00
CREDO23
5d2f9f1ca8
test: connector document is OKF concept
2026-07-21 19:59:01 +02:00
CREDO23
863d9a2248
test: per-type OKF conformance
2026-07-21 19:59:00 +02:00
CREDO23
7c53909b49
test: OKF serializer self-checks
2026-07-21 19:59:00 +02:00
CREDO23
ca317c4686
Merge remote-tracking branch 'upstream/dev' into feature-walmart-scraper
...
# Conflicts:
# docker/.env.example
# surfsense_backend/app/capabilities/core/billing.py
# surfsense_backend/app/capabilities/core/types.py
# surfsense_backend/app/config/__init__.py
# surfsense_mcp/mcp_server/features/scrapers/__init__.py
# surfsense_web/content/docs/connectors/index.mdx
# surfsense_web/content/docs/connectors/native/index.mdx
# surfsense_web/content/docs/how-to/mcp-server.mdx
2026-07-21 02:42:41 +02:00
Rohan Verma
2eed9b2ac8
Merge pull request #1613 from Sanjays2402/fix/nonblocking-audio-write
...
fix: avoid blocking audio writes
2026-07-19 16:17:05 -07:00
CREDO23
f6970b90e8
fix(walmart): parse category breadcrumb path into breadCrumbs and category
2026-07-19 09:10:03 +02:00
CREDO23
07721bda40
test(walmart): cover capability registry, schemas, and executors for both verbs
2026-07-19 08:49:10 +02:00
CREDO23
cabc5b5c86
feat(walmart): register subagent in roster and connector map
2026-07-19 08:45:27 +02:00
CREDO23
7b5e09c528
test(walmart): add parser and flow tests with e2e harness
2026-07-19 08:19:22 +02:00
Sanjay Santhanam
5cc05d90f0
fix: avoid blocking audio writes
...
TTS responses were written synchronously from the async presentation pipeline, blocking concurrent requests. Offload byte writes to a worker thread and add a regression test that keeps the event loop responsive.
2026-07-18 17:46:31 -07:00
CREDO23
91aa265afb
Merge remote-tracking branch 'upstream/dev' into feature-indeed-jobs-scraper
...
# Conflicts:
# README.es.md
# README.hi.md
# README.md
# README.pt-BR.md
# README.zh-CN.md
# surfsense_backend/tests/unit/capabilities/google_maps/test_registry.py
# surfsense_backend/tests/unit/capabilities/reddit/test_registry.py
# surfsense_backend/tests/unit/capabilities/youtube/test_registry.py
# surfsense_mcp/mcp_server/features/scrapers/__init__.py
# surfsense_web/content/docs/connectors/index.mdx
# surfsense_web/content/docs/connectors/native/index.mdx
# surfsense_web/content/docs/connectors/native/meta.json
# surfsense_web/content/docs/how-to/mcp-server.mdx
# surfsense_web/lib/connectors-marketing/index.ts
# surfsense_web/lib/playground/catalog.ts
2026-07-18 22:11:30 +02:00
DESKTOP-RTLN3BA\$punk
87b0ba86e4
feat: bumped version to 0.0.34
2026-07-17 19:42:10 -07:00
DESKTOP-RTLN3BA\$punk
2cbe6fc111
feat: bumped version to 0.0.33
2026-07-17 17:23:21 -07:00
DESKTOP-RTLN3BA\$punk
8a5d37a4db
refactor: implement cross-country proxy rotation for Reddit and TikTok scrapers, enhancing resilience against IP blocks and improving search query handling
2026-07-17 16:30:26 -07:00
DESKTOP-RTLN3BA\$punk
c0ebb62fb2
chore: linting
2026-07-17 14:39:39 -07:00
DESKTOP-RTLN3BA\$punk
68d1832f10
refactor: enhance Google search scraping capabilities with warm sticky-IP pool and improved captcha handling
2026-07-17 03:27:43 -07:00
Anish Sarkar
38b784fbac
feat(workspaces): implement workspace limits feature with backend integration and UI updates
2026-07-16 15:44:49 +05:30
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
...
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
CREDO23
c485fe4c43
fix: scrape indeed first page only, steer subagent to one query
2026-07-15 20:54:37 +02:00
CREDO23
6180b96912
fix: fail fast on gated indeed pagination, keep collected pages
2026-07-15 20:24:22 +02:00
CREDO23
b53f00231d
fix: parse indeed /viewjob detail from window._rootProps
2026-07-15 19:57:19 +02:00
CREDO23
9e37960243
test: pin indeed in subagent roster
2026-07-15 18:46:55 +02:00
CREDO23
d2af2402b4
test: indeed detail and enrichment flow
2026-07-15 17:54:38 +02:00
CREDO23
38c98ba0e4
test: indeed detail parser
2026-07-15 17:54:38 +02:00
CREDO23
0b73581cbe
test: indeed viewjob detail fixture
2026-07-15 17:54:38 +02:00
Anish Sarkar
78fe22735e
test(amazon): update proxy configuration in AmazonScrapeInput to use residential proxy
2026-07-15 16:04:02 +05:30
Anish Sarkar
22d5a42e8d
test: update BookStack connector test to disable deprecated indexing
2026-07-15 15:59:44 +05:30
Anish Sarkar
505bc64c0b
test: update Google Maps, Reddit, and YouTube capabilities to reflect billing units
2026-07-15 15:58:07 +05:30
Anish Sarkar
01308055dd
chore: ran linting
2026-07-15 15:48:54 +05:30
Anish Sarkar
07fe0203e3
test(amazon): cover localized scraper flows
2026-07-15 15:32:50 +05:30
Anish Sarkar
799ec5a907
test(amazon): cover block detection and localized price parsing
2026-07-15 15:32:29 +05:30
