Commit graph

3633 commits

Author SHA1 Message Date
Anish Sarkar
cb256729a3 chore: Enhance SurfSense MCP server documentation and toolset by adding TikTok scraping capabilities, including comments, user search, and trending features. Updated README and documentation to reflect the addition of 24 native tools. 2026-07-11 04:38:42 +05:30
Anish Sarkar
e38ca19b18 Merge remote-tracking branch 'upstream/dev' into feat/instagram-scraper 2026-07-11 04:31:11 +05:30
Anish Sarkar
ec3f47abf8 feat(web): surface carousel, tagged users, and location in connector marketing 2026-07-11 03:44:51 +05:30
Anish Sarkar
42f9f35ec7 docs(web): document new media fields and search_type aliasing 2026-07-11 03:44:45 +05:30
Anish Sarkar
3e8f31152e feat(web): update Instagram marketing copy 2026-07-11 03:25:34 +05:30
Anish Sarkar
b75ab81261 docs(web): refresh Instagram connector docs 2026-07-11 03:25:30 +05:30
Anish Sarkar
42d03fdbc7 feat(web): update Instagram marketing and playground catalog 2026-07-11 02:21:08 +05:30
Anish Sarkar
69a8433910 docs(web): refresh Instagram connector and MCP docs 2026-07-11 02:21:05 +05:30
CREDO23
903502296e fix(tiktok-marketing): stop advertising keyword search as a video source
The hero, intro, use case, API-reference fields, and two FAQs all listed search as a video path, contradicting the FAQ that admits keyword video search is login-walled. Reconcile every claim to one truth: videos via hashtag/profile/URL; keyword search returns no videos; keyword -> user_search for accounts.
2026-07-10 17:46:08 +02:00
Anish Sarkar
abb2ea2d3b feat(auth-utils): add Instagram to public route prefixes for monitoring 2026-07-10 09:24:06 +05:30
Anish Sarkar
2a6715e2a3 feat(homepage): update hero section description and add Instagram use case
Enhanced the hero section by including Instagram in the list of platforms monitored by SurfSense. Additionally, introduced a new use case for "Social sentiment mining" that details the capabilities of pulling public posts and analyzing audience reactions on Instagram.
2026-07-10 09:23:53 +05:30
CREDO23
867e940911 Merge upstream/dev into feature/tiktok-scraper
Sync with the advanced dev tip so the PR compares against current dev
(drops already-merged commits from the diff). No history rewritten.
2026-07-09 20:15:20 +02:00
CREDO23
6b15d610d9 feat(tiktok): surface comments, user_search, trending across all product surfaces
Brings the three newer verbs to parity with tiktok.scrape everywhere it was
wired: MCP tools (+ selfcheck manifest), the chat subagent prompt/description,
the playground catalog, the native docs page, and the SEO marketing page. Also
adds live e2e stages for comments, user search, and trending. Docs/FAQ now
state the real contract: profile metadata is reliable while its video list can
be withheld, and keyword video search is walled (use user search for accounts).
2026-07-09 19:09:00 +02:00
Anish Sarkar
5551ebbda7 chore(instagram): modify instagram svg 2026-07-09 19:08:00 +05:30
Anish Sarkar
ba83d16cba docs(web): add Instagram to MCP server tool docs 2026-07-09 16:07:50 +05:30
Anish Sarkar
f5aad487ac docs(web): document Instagram native connector 2026-07-09 16:07:42 +05:30
Anish Sarkar
4e86710b26 feat(web): cross-link Instagram from sibling connectors 2026-07-09 16:07:34 +05:30
Anish Sarkar
fa2ac406f3 feat(web): add Instagram connector marketing page 2026-07-09 16:07:19 +05:30
Anish Sarkar
d00030d97c feat(web): add Instagram playground platform and brand icon 2026-07-09 16:03:34 +05:30
Rohan Verma
3eb485ff31
Merge pull request #1575 from SyntaxSawdust/feature/1354-embedding-base-url
Support separate embedding base URL configuration
2026-07-08 17:11:42 -07:00
CREDO23
f731d371ab feat(tiktok): add TikTok SEO landing page and site-wide marketing parity 2026-07-08 20:36:46 +02:00
CREDO23
5f9472b122 feat(tiktok): advertise tiktok across agent prompts, MCP instructions, docs 2026-07-08 20:30:38 +02:00
CREDO23
ea6befdf59 docs(tiktok): native connector page + nav card 2026-07-08 20:21:29 +02:00
CREDO23
ed1c3a1f3d feat(tiktok): expose tiktok.scrape on MCP, chat subagent, playground 2026-07-08 20:20:20 +02:00
Anish Sarkar
1ae927a7db
Merge pull request #1588 from AnishSarkar22/fix/ci-ui-changes
feat(api-keys): implement API keys management interface and access control
2026-07-08 10:44:45 +05:30
Anish Sarkar
719c2da525 feat(api-keys): implement API keys management interface and access control
- Added a new WorkspaceApiAccessControl component for managing API key access within workspaces.
- Enhanced the PlaygroundApiKeysPage to display API key creation options and access information.
- Updated PlaygroundIndex and PlaygroundSidebar to include links to the new API keys management section.
- Improved user feedback with alerts and descriptions regarding API key usage and requirements.
2026-07-08 10:43:11 +05:30
Anish Sarkar
7faa58a953
Merge pull request #1587 from AnishSarkar22/fix/ci-ui-changes
feat(playground): improve API Playground navigation and sidebar UX
2026-07-08 10:31:35 +05:30
Anish Sarkar
9a18c7771e refactor(sidebar): replace FolderInput with FilePlus in DocumentsSidebar
- Updated the import of FolderInput to FilePlus for improved icon representation in the sidebar.
- Enhanced the button for document import to align with the new iconography, improving visual consistency.
2026-07-08 10:28:53 +05:30
Anish Sarkar
53d3b304d3 refactor(playground): improve API reference and playground runner UI
- Adjusted text formatting in the API reference for better readability.
- Simplified import statements in PlaygroundRunner for cleaner code.
- Enhanced button styling and layout in PlaygroundRunner for improved user experience.
- Streamlined output display logic in PlaygroundRunner for better clarity.
2026-07-08 10:17:01 +05:30
Anish Sarkar
33e685c6ed feat(sidebar): add isPlaygroundSidebarOpen prop for improved sidebar state management
- Introduced isPlaygroundSidebarOpen prop to Sidebar component for better control of sidebar visibility.
- Updated LayoutShell to manage playground sidebar state, enhancing user experience and navigation consistency.
2026-07-08 10:08:37 +05:30
Anish Sarkar
2fa8b76b56 feat(playground): enhance Playground layout with new sidebar and navigation functions
- Introduced PlaygroundSidebar component for improved navigation within the API Playground.
- Added utility functions for generating navigation items and groups, enhancing modularity and reusability.
- Updated PlaygroundLayoutShell to utilize new navigation functions, streamlining the layout structure.
- Enhanced RoutedSectionShell to support optional desktop navigation, improving responsiveness and user experience.
2026-07-08 10:06:41 +05:30
Anish Sarkar
ba08d6392f
Merge pull request #1585 from AnishSarkar22/fix/ci-ui-changes
feat(ui): Unify notifications, sidebar, and API playground UX
2026-07-08 04:14:49 +05:30
Anish Sarkar
3eb963b8b3 fix(placeholder): update placeholder text for clarity in assistant UI and hero chat demo
- Revised placeholder text to improve readability and user understanding by replacing the dash with a period and adding "Use" for prompts and docs.
2026-07-08 04:09:47 +05:30
Anish Sarkar
248e622478 feat(playground): enhance schema form and artifacts library UI
- Replaced required/optional text with Badge component in schema form for better visual distinction.
- Updated EmptyState in artifacts library to include a more informative and visually appealing layout with an icon and description.
2026-07-08 03:53:41 +05:30
Anish Sarkar
7ba77c6b86 feat(capabilities): add documentation URLs to Google Maps, YouTube, and web crawl capabilities
- Introduced a `docs_url` field to the Google Maps reviews, scrape, YouTube comments, YouTube scrape, and web crawl capabilities for improved documentation access.
- Simplified descriptions for each capability to enhance clarity and user understanding.
2026-07-08 03:38:08 +05:30
Anish Sarkar
3b9c806c90 feat(capabilities): add documentation URL to capabilities and enhance Reddit scrape capability
- Introduced a `docs_url` field to the `Capability` and `CapabilitySummary` classes for better documentation access.
- Updated the `REDDIT_SCRAPE` capability to include a specific documentation link.
- Enhanced the PlaygroundRunner component to display the documentation link when available, improving user guidance.
2026-07-08 03:35:32 +05:30
Anish Sarkar
7268eae7fa refactor(playground): update terminology and enhance UI components for API runs
- Changed label from "Runs" to "API Runs" in PlaygroundLayoutShell and PlaygroundIndex for clarity.
- Improved the API reference UI by adding a ChevronRight icon for expandable sections and enhancing the summary layout.
- Introduced an EndpointCopyButton component for easier copying of API endpoint details, improving user experience.
2026-07-08 03:08:39 +05:30
Anish Sarkar
bcfa3c5ef5 refactor(user-settings): update terminology for auto-reload and credit features
- Replaced instances of "auto-reload" with "top-ups" for consistency and clarity across user settings and pricing sections.
- Enhanced user feedback messages related to credit balance and top-up settings.
- Improved comments and descriptions in the Purchase History and Credit Balance Display components for better understanding.
2026-07-08 02:51:23 +05:30
Anish Sarkar
d54e21e066 feat(runs-table): add alert component for API runs overview
- Introduced an Alert component to provide a concise description of API runs in the workspace.
- Replaced the previous header and description with the new alert for improved clarity and user experience.
2026-07-08 02:37:31 +05:30
Anish Sarkar
0c2db7dfd5 refactor(layout): streamline layout components with RoutedSectionShell
- Introduced RoutedSectionShell to unify navigation structure across Playground, User Settings, and Workspace Settings layouts.
- Replaced individual navigation implementations with a more cohesive and reusable component.
- Updated navigation items to include href properties for better routing.
- Enhanced mobile navigation experience with drawer support and improved scroll handling.
2026-07-08 02:29:33 +05:30
Anish Sarkar
9109f0aa05 refactor(playground): enhance PlaygroundLayoutShell with improved navigation and component structure
- Added new TopLevelNavLink and ProviderNavGroup components for better organization of navigation items.
- Updated state management for expanded providers and active navigation items.
- Refactored navigation item structure to simplify rendering and improve clarity.
- Integrated ChevronRight icon for visual indication of expandable sections.
2026-07-08 02:07:44 +05:30
Anish Sarkar
7ec33171c7 feat(playground): enhance API Playground with alert component and updated Reddit SVG 2026-07-08 01:17:09 +05:30
Anish Sarkar
e48b1c1f90 refactor(playground): remove API Keys section and update navigation
- Deleted the ApiKeysSection component to streamline the Playground layout.
- Updated PlaygroundLayoutShell and PlaygroundIndex to remove references to API Keys.
- Redirected API Keys page to User Settings for improved navigation flow.
2026-07-08 01:02:05 +05:30
Anish Sarkar
c31f72e5bb refactor(sidebar): simplify NotificationsDropdown aria-label and adjust Sidebar layout
- Updated aria-label in NotificationsDropdown for improved accessibility and clarity.
- Adjusted Sidebar layout to enhance spacing and visual consistency.
2026-07-08 00:59:16 +05:30
CREDO23
116291a3b6 refactor(mcp): flatten to mcp_server package, drop src layout
Rename the import package surfsense_mcp -> mcp_server and remove the
src/ layer so the project mirrors the backend's shape (project folder
!= package name, e.g. surfsense_backend/app). Kills the redundant
surfsense_mcp/src/surfsense_mcp nesting.

Distribution name and console command (surfsense-mcp) are unchanged;
only python -m and internal import paths move to mcp_server. Dockerfile
CMD updated; no PYTHONPATH added since the editable install already
makes the package importable.
2026-07-07 20:24:53 +02:00
Dustin Persek
41edac7641 Merge remote-tracking branch 'upstream/dev' into feature/1354-embedding-base-url
# Conflicts:
#	surfsense_web/content/docs/docker-installation/docker-compose.mdx
#	surfsense_web/content/docs/manual-installation.mdx
2026-07-07 14:19:40 -04:00
Anish Sarkar
803577436f refactor(playground): simplify API Playground description for clarity
- Removed redundant text from the API Playground description to enhance readability.
- Improved layout in FolderNode by adding dropdown state management for better user interaction.
- Updated Sidebar component styles for improved visual consistency and user experience.
2026-07-07 23:12:08 +05:30
Anish Sarkar
2927a9484e refactor(assistant-ui): simplify ConnectedScraperIcons and update ConnectAgentDialog UI
- Removed unused `useReducedMotion` hook from ConnectedScraperIcons for cleaner code.
- Replaced `Cable` icon with a masked SVG in ConnectAgentDialog for improved visual representation.
- Enhanced layout in ConnectAgentDialog to include a badge indicating new items, improving user awareness.
2026-07-07 22:56:09 +05:30
Anish Sarkar
d6fbbb97d4 feat(sidebar): introduce SidebarButtonBadge for improved badge display
- Added SidebarButtonBadge component to encapsulate badge styling and functionality.
- Updated Sidebar to utilize SidebarButtonBadge for displaying new item notifications, enhancing visual clarity.
- Adjusted SidebarUserProfile layout for better alignment in collapsed view.
2026-07-07 22:48:23 +05:30
Anish Sarkar
2670ad96c8 feat(sidebar): highlight active chat items for improved user interaction 2026-07-07 22:41:32 +05:30