DESKTOP-RTLN3BA\$punk
dbedf0cfa5
feat(backend): integrate PostHog analytics for enhanced observability
...
- Added PostHog configuration options to .env.example files for both Docker and Surfsense backend.
- Introduced PostHog dependency in pyproject.toml.
- Implemented analytics middleware to capture various events across the application, including user authentication, automation runs, and API requests.
- Enhanced existing routes and services to emit analytics events, providing insights into user interactions and system performance.
- Ensured graceful shutdown of analytics clients in worker processes and application lifecycles.
2026-07-22 22:16:28 -07:00
Rohan Verma
ca4f231577
Merge pull request #1619 from CREDO23/feat-run-citations
...
[Feat] Cite scraper runs as verifiable sources in chat
2026-07-22 14:53:45 -07:00
Rohan Verma
110102c3c0
Merge pull request #1609 from AnishSarkar22/fix/tabs
...
refactor(tabs): pointer-based tabs with live react-query resolution, workspace limits, and UI polish
2026-07-22 14:53:29 -07:00
CREDO23
6c8d109d76
test: parse run citation tokens
2026-07-22 19:35:04 +02:00
CREDO23
57d6182ca3
feat: parse run citation tokens
2026-07-22 19:35:04 +02:00
Anish Sarkar
9fd5d3571c
Merge remote-tracking branch 'upstream/dev' into fix/tabs
2026-07-22 00:02:26 +05:30
CREDO23
ca317c4686
Merge remote-tracking branch 'upstream/dev' into feature-walmart-scraper
...
# Conflicts:
# docker/.env.example
# surfsense_backend/app/capabilities/core/billing.py
# surfsense_backend/app/capabilities/core/types.py
# surfsense_backend/app/config/__init__.py
# surfsense_mcp/mcp_server/features/scrapers/__init__.py
# surfsense_web/content/docs/connectors/index.mdx
# surfsense_web/content/docs/connectors/native/index.mdx
# surfsense_web/content/docs/how-to/mcp-server.mdx
2026-07-21 02:42:41 +02:00
CREDO23
bfde1b8741
feat(walmart): list walmart across marketing surfaces and example prompts
2026-07-19 09:01:18 +02:00
CREDO23
2a512e0015
feat(walmart): add connector marketing page
2026-07-19 09:01:11 +02:00
CREDO23
1c50a33647
feat(walmart): add playground catalog entry and icon
2026-07-19 09:01:04 +02:00
CREDO23
91aa265afb
Merge remote-tracking branch 'upstream/dev' into feature-indeed-jobs-scraper
...
# Conflicts:
# README.es.md
# README.hi.md
# README.md
# README.pt-BR.md
# README.zh-CN.md
# surfsense_backend/tests/unit/capabilities/google_maps/test_registry.py
# surfsense_backend/tests/unit/capabilities/reddit/test_registry.py
# surfsense_backend/tests/unit/capabilities/youtube/test_registry.py
# surfsense_mcp/mcp_server/features/scrapers/__init__.py
# surfsense_web/content/docs/connectors/index.mdx
# surfsense_web/content/docs/connectors/native/index.mdx
# surfsense_web/content/docs/connectors/native/meta.json
# surfsense_web/content/docs/how-to/mcp-server.mdx
# surfsense_web/lib/connectors-marketing/index.ts
# surfsense_web/lib/playground/catalog.ts
2026-07-18 22:11:30 +02:00
DESKTOP-RTLN3BA\$punk
1dc69cdfb3
refactor: update branding and descriptions across documentation and components to emphasize SurfSense as the open-source NotebookLM alternative for web research
2026-07-17 17:18:11 -07:00
DESKTOP-RTLN3BA\$punk
bd7647b314
refactor: update README files and system prompts to include Amazon as a data source for AI agents, enhancing the platform's capabilities for live web research
2026-07-17 16:44:11 -07:00
DESKTOP-RTLN3BA\$punk
c0ebb62fb2
chore: linting
2026-07-17 14:39:39 -07:00
DESKTOP-RTLN3BA\$punk
065020c814
refactor: update community references in README files and connector to reflect transition from 'webscraping' to 'SaaS'
2026-07-16 20:27:23 -07:00
DESKTOP-RTLN3BA\$punk
7af4bc0b49
refactor: enhance announcements functionality to include expired announcements in hooks and components
2026-07-16 20:03:09 -07:00
DESKTOP-RTLN3BA\$punk
7bc02ce55b
refactor: update references from competitive intelligence to open web research across various components and documentation
2026-07-16 19:41:16 -07:00
DESKTOP-RTLN3BA\$punk
a7903e0b4b
refactor: update README files to reflect the transition of SurfSense to an open web research platform for AI agents
2026-07-16 18:52:00 -07:00
DESKTOP-RTLN3BA\$punk
1917d76e10
refactor: update Google search system prompt and add Amazon route prefix
2026-07-16 17:39:08 -07:00
Anish Sarkar
38b784fbac
feat(workspaces): implement workspace limits feature with backend integration and UI updates
2026-07-16 15:44:49 +05:30
Rohan Verma
d1d839a491
Merge pull request #1604 from AnishSarkar22/feat/amazon-scraper
...
feat(amazon): add public multi-marketplace product scraping capability
2026-07-15 16:29:03 -07:00
Anish Sarkar
918133a4be
feat(chat): add CanSubmitChat interface and logic to determine chat submission eligibility
2026-07-16 01:29:32 +05:30
CREDO23
e19c876fbc
feat: wire indeed connector into env, readmes, playground and marketing
2026-07-15 19:03:51 +02:00
Anish Sarkar
a466fdcf5d
refactor(AllChatsSidebar): replace timestamp formatting with relative date display and adjust button styles
2026-07-15 21:12:51 +05:30
Anish Sarkar
01308055dd
chore: ran linting
2026-07-15 15:48:54 +05:30
Anish Sarkar
aa3c62b754
feat(amazon): enhance playground with Amazon-specific field options and hints
2026-07-15 15:46:43 +05:30
Anish Sarkar
4abf95427b
feat(web): surface eu marketplaces in amazon connector page
2026-07-15 15:33:07 +05:30
Anish Sarkar
2d9ee68285
feat(amazon): add Amazon Product API connector with detailed documentation and use cases
2026-07-15 10:15:48 +05:30
Anish Sarkar
16404cb9d0
feat(web): add amazon platform to playground catalog
2026-07-15 01:57:57 +05:30
Anish Sarkar
2d837ea18c
Merge remote-tracking branch 'upstream/dev' into fix/onboarding
2026-07-14 10:18:03 +05:30
DESKTOP-RTLN3BA\$punk
2b018c4474
refactor: streamline TikTok and Instagram scraping logic by removing search_queries and enhancing documentation for clarity
2026-07-13 17:11:25 -07:00
DESKTOP-RTLN3BA\$punk
e8b3692b54
chore: linting
2026-07-13 16:30:37 -07:00
DESKTOP-RTLN3BA\$punk
ab5970fab1
feat: updating messaging of instagram and tiktok pages
2026-07-13 14:42:11 -07:00
CREDO23
f4870ad1c2
feat(chat): add shared formatMessageTimestamp helper
2026-07-13 23:17:23 +02:00
CREDO23
a44c67da97
docs(chat): tighten engine comments to intent
2026-07-13 23:17:23 +02:00
CREDO23
204b3aa56c
feat(chat): add stream engine driving turns into the store
2026-07-13 23:17:22 +02:00
CREDO23
9984a88d6d
feat(chat): extract shared stream-engine helpers
2026-07-13 23:17:22 +02:00
CREDO23
0fb577b71f
feat(chat): add useChatStream hook over the stream store
2026-07-13 23:17:22 +02:00
CREDO23
b5cefd25ef
feat(chat): add module-level chat stream store for resumable streaming
2026-07-13 23:17:22 +02:00
Thibault Jaigu
2ff7ea4cb6
feat: add Requesty as a model provider
...
Add Requesty (https://requesty.ai ), an OpenAI-compatible LLM router, as a
model provider by mirroring the existing OpenRouter integration.
Backend:
- app/services/requesty_model_normalizer.py: normalizes Requesty's /v1/models
catalogue, mapping its flat capability booleans (supports_tool_calling/
supports_vision/supports_image_generation) and context_window field onto the
shared normalized shape (Requesty differs from OpenRouter's architecture +
supported_parameters + context_length layout)
- provider_registry.py: Requesty ProviderSpec (OpenAI-compatible, base URL
https://router.requesty.ai/v1 , REQUESTY_API_KEY bearer auth)
- model_connection_service.py: key verification + live model discovery
- quality_score.py: Requesty score entry
- unit tests mirroring the OpenRouter normalizer coverage
Frontend:
- Requesty provider icon + registration, metadata entry, and base-url hint
Signed-off-by: Thibault Jaigu <thibault.jaigu@gmail.com>
2026-07-13 09:42:30 +01:00
Anish Sarkar
aca243ba43
refactor(onboarding): remove client-side onboarding helper
2026-07-12 20:30:23 +05:30
Anish Sarkar
ad28bd912c
feat(model-connections): add setupStatus cache key and api fetcher
2026-07-12 20:29:53 +05:30
Anish Sarkar
e38ca19b18
Merge remote-tracking branch 'upstream/dev' into feat/instagram-scraper
2026-07-11 04:31:11 +05:30
Anish Sarkar
ec3f47abf8
feat(web): surface carousel, tagged users, and location in connector marketing
2026-07-11 03:44:51 +05:30
Anish Sarkar
3e8f31152e
feat(web): update Instagram marketing copy
2026-07-11 03:25:34 +05:30
Anish Sarkar
42d03fdbc7
feat(web): update Instagram marketing and playground catalog
2026-07-11 02:21:08 +05:30
CREDO23
903502296e
fix(tiktok-marketing): stop advertising keyword search as a video source
...
The hero, intro, use case, API-reference fields, and two FAQs all listed search as a video path, contradicting the FAQ that admits keyword video search is login-walled. Reconcile every claim to one truth: videos via hashtag/profile/URL; keyword search returns no videos; keyword -> user_search for accounts.
2026-07-10 17:46:08 +02:00
Anish Sarkar
abb2ea2d3b
feat(auth-utils): add Instagram to public route prefixes for monitoring
2026-07-10 09:24:06 +05:30
CREDO23
6b15d610d9
feat(tiktok): surface comments, user_search, trending across all product surfaces
...
Brings the three newer verbs to parity with tiktok.scrape everywhere it was
wired: MCP tools (+ selfcheck manifest), the chat subagent prompt/description,
the playground catalog, the native docs page, and the SEO marketing page. Also
adds live e2e stages for comments, user search, and trending. Docs/FAQ now
state the real contract: profile metadata is reliable while its video list can
be withheld, and keyword video search is walled (use user search for accounts).
2026-07-09 19:09:00 +02:00
Anish Sarkar
4e86710b26
feat(web): cross-link Instagram from sibling connectors
2026-07-09 16:07:34 +05:30