Commit graph

115 commits

Author SHA1 Message Date
Anish Sarkar
4e00f24a03 feat(docker): add ZERO_AUTO_RESET configuration for improved replication safety
- Introduced the ZERO_AUTO_RESET environment variable to enable automatic reset of the SQLite replica in case of replication halts.
- Updated Docker Compose files to include ZERO_AUTO_RESET in service configurations.
- Enhanced documentation to clarify the purpose and usage of the new variable.
2026-06-06 14:21:14 +05:30
Anish Sarkar
19fabaf011 feat(docker): enhance banner display to installation scripts 2026-06-06 01:49:41 +05:30
Anish Sarkar
4bfa04ed57 feat(docker): add interactive Watchtower update preference to installation scripts 2026-06-06 01:45:27 +05:30
Anish Sarkar
c5afce3873 feat(docker): add GPU support and enhance installation scripts
- Introduced a new docker-compose.gpu.yml file to define GPU resource reservations for backend services.
- Updated .env.example to include GPU-related environment variables and usage instructions.
- Enhanced install.ps1 and install.sh scripts to support GPU variant selection and validation for GPU count.
- Improved error handling and user feedback for invalid GPU configurations.
2026-06-06 01:15:04 +05:30
Anish Sarkar
7e4077d67a chore(docker): remove commented-out flower service from Docker Compose files 2026-06-06 00:45:56 +05:30
Anish Sarkar
c1ee5fabf9 feat(docker): enhance multi-architecture and CUDA support in Docker workflows
- Added support for multiple image variants (CPU, CUDA 12.8, CUDA 12.6) in the Docker build workflow.
- Updated Docker Compose configuration to utilize the new SURFSENSE_VARIANT environment variable for selecting image variants.
- Enhanced documentation to clarify usage of backend image variants and their corresponding environment variable settings.
2026-06-05 23:39:42 +05:30
Anish Sarkar
54fc2d4619 chore(docker): comment out whatsapp-bridge service in docker-compose.yml 2026-06-05 02:24:14 +05:30
Anish Sarkar
3c82200e89 chore(docker): comment out otel-collector service in docker-compose.yml 2026-06-04 22:29:39 +05:30
CREDO23
a4f3af7ed8 chore(dev): document storage env vars and add azurite service 2026-06-02 16:10:50 +02:00
Anish Sarkar
ebddf4506a feat(messaging): introduce comprehensive setup docs for Telegram, WhatsApp, Slack, and Discord messaging channels 2026-06-02 00:25:49 +05:30
Anish Sarkar
20994671bc feat(gateway): add configuration options for Telegram, WhatsApp, Slack, and Discord gateways 2026-06-02 00:03:26 +05:30
Anish Sarkar
799a83239f feat(gateway): add Slack and Telegram gateway configuration and enablement checks 2026-06-01 23:58:28 +05:30
Anish Sarkar
9143cb6ad1 feat(gateway): update WhatsApp bridge configuration and expose port 9929 2026-05-29 11:39:11 +05:30
Anish Sarkar
51bf2a8361 feat(gateway): wire WhatsApp bridge runtime 2026-05-29 10:20:25 +05:30
Anish Sarkar
4c8d47617d feat(env): add SURFSENSE_ENV variable for deployment environment and update observability resource attributes 2026-05-23 02:13:24 +05:30
Anish Sarkar
df698e0216 feat(observability): integrate OpenTelemetry collector and configuration for enhanced telemetry 2026-05-23 00:17:23 +05:30
Anish Sarkar
60049936e3 chore(dev): add local OpenTelemetry backend configuration 2026-05-21 23:00:56 +05:30
DESKTOP-RTLN3BA\$punk
b285293b4e fix: docker one click setup 2026-05-20 01:25:07 -07:00
Anish Sarkar
af1d2fa430 Merge remote-tracking branch 'upstream/dev' into fix/zero-cache-stale-replica-1355 2026-05-16 19:30:09 +05:30
Anish Sarkar
ce4531461c chore: update zero-cache image and dependencies to version 1.4.0 2026-05-12 15:24:19 +05:30
Anish Sarkar
315329f344 chore: update E2E tests workflow to capture logs on cancellation and add shared volume for backend services 2026-05-12 01:35:33 +05:30
Anish Sarkar
b247ff37df chore: implement test-only token mint endpoint and update E2E test authentication flow 2026-05-11 19:48:18 +05:30
Anish Sarkar
83e40c5aea chore: update Docker configuration to include pnpm workspace and refine dependency management 2026-05-11 15:31:24 +05:30
Anish Sarkar
99e667f3f9 chore: refine E2E tests workflow by removing pnpm version specification and updating Docker Compose for backend build reference 2026-05-11 13:01:20 +05:30
Anish Sarkar
242925d8e5 chore: update Docker configurations to streamline backend build and enhance E2E testing environment 2026-05-11 12:31:15 +05:30
Anish Sarkar
68f45335bc chore: implement E2E testing setup with Docker Compose and update workflow for backend and Redis services 2026-05-11 03:09:01 +05:30
CREDO23
78f4747382 refactor(chat): stream agent events via stream_output and remove parity v2 flag 2026-05-07 19:40:10 +02:00
DESKTOP-RTLN3BA\$punk
c938d39277 feat: moved most things behind correct feature flag 2026-05-02 23:10:48 -07:00
DESKTOP-RTLN3BA\$punk
ae9d36d77f feat: unified credits and its cost calculations 2026-05-02 14:34:23 -07:00
CREDO23
a7d3e4ff18 Extend desktop package scripts and local dependency compose 2026-04-24 19:15:02 +02:00
Anish Sarkar
59f8696eac feat: add extra_hosts configuration for Docker services 2026-04-21 23:17:26 +05:30
Anish Sarkar
2657c9e871 feat: add internal backend URL configuration 2026-04-21 21:03:38 +05:30
DESKTOP-RTLN3BA\$punk
ff4e0f9b62 feat: no login experience and prem tokens
Some checks are pending
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
Anish Sarkar
20fa93f0ba refactor: make Azure Document Intelligence an internal LLAMACLOUD accelerator instead of a standalone ETL service 2026-04-08 03:26:24 +05:30
Anish Sarkar
1fa8d1220b feat: add support for Azure Document Intelligence in ETL pipeline 2026-04-08 00:59:12 +05:30
CREDO23
10e0e733af fix: configure zero-cache sync workers, connection limits, and publication 2026-04-01 10:18:51 +02:00
DESKTOP-RTLN3BA\$punk
f9a79d5a5f feat: add Stripe configuration options for docker 2026-03-31 22:26:47 -07:00
Anish Sarkar
54828522f8 feat: add Dropbox integration support with configuration and connector updates 2026-03-30 22:16:41 +05:30
Anish Sarkar
028c88be72 feat: add integration and unit tests for OneDrive indexing pipeline and parallel downloads 2026-03-28 16:39:47 +05:30
Anish Sarkar
7004e764a9 chore: refactor Microsoft OAuth configuration to unify client ID and secret for Teams and OneDrive in environment files and related code 2026-03-28 16:37:23 +05:30
Anish Sarkar
bb894ee158 chore: update environment variable names for Microsoft OAuth integration in Docker and SurfSense backend 2026-03-28 16:35:36 +05:30
CREDO23
5c98f1c717 add ZERO_MUTATE_URL and no-op mutate endpoint for zero-cache auth passthrough 2026-03-24 16:25:13 +02:00
CREDO23
cab33d9f4c fix: make ZERO_QUERY_URL portable across all environments
- Default to Docker service networking (http://frontend:3000) in both
  compose files — works when all services run in Docker
- Add extra_hosts (host.docker.internal:host-gateway) for cross-platform
  host access when running frontend outside Docker
- Document override examples in .env.example for local dev and
  custom domain setups
2026-03-24 15:06:58 +02:00
CREDO23
8dd539c384 feat: add Zero query endpoint and configure ZERO_QUERY_URL
- Create app/api/zero/query/route.ts — resolves named queries to ZQL
  using handleQueryRequest and mustGetQuery from @rocicorp/zero
- Add ZERO_QUERY_URL to both docker-compose files:
  - dev: http://host.docker.internal:3000 (reaches local Next.js from Docker)
  - prod: http://frontend:3000 (Docker service networking)

Without this endpoint, zero-cache cannot resolve named queries and
no data syncs to the client.
2026-03-23 20:58:42 +02:00
CREDO23
f29a3edcab chore: update postgresql.conf and contracts comments for Zero
- Replace Electric SQL references in postgresql.conf with Zero-cache
- Clean Electric SQL comments in chat-comments.types.ts and chat-messages.types.ts
2026-03-23 18:30:49 +02:00
CREDO23
f9ba7e52d9 feat: add Zero infra — docker-compose, env vars, Dockerfile, CI workflows
- Add zero-cache service to docker-compose.yml and docker-compose.dev.yml
- Add ZERO_* env vars to docker/.env.example
- Add NEXT_PUBLIC_ZERO_CACHE_URL to surfsense_web/.env.example
- Add NEXT_PUBLIC_ZERO_CACHE_URL placeholder ARG/ENV to Dockerfile
- Add NEXT_PUBLIC_ZERO_CACHE_URL runtime substitution to docker-entrypoint.js
- Add NEXT_PUBLIC_ZERO_CACHE_URL build arg to docker-build.yml and desktop-release.yml
2026-03-23 18:27:18 +02:00
CREDO23
61610106f4 feat: add zero-cache service to production docker-compose
- Add rocicorp/zero:0.26.2 service with Postgres connection,
  SQLite replica volume, healthcheck, and admin password
- Add NEXT_PUBLIC_ZERO_CACHE_URL to frontend env vars
- Frontend now depends on zero-cache health
2026-03-23 18:19:37 +02:00
CREDO23
2b7465cdaa chore: remove Electric SQL plumbing and infrastructure
Remove all Electric SQL client code, Docker service, env vars, CI build
args, install scripts, and documentation. Feature hooks that depend on
Electric are intentionally left in place to be rewritten with Rocicorp
Zero in subsequent commits.

Deleted:
- lib/electric/ (client.ts, context.ts, auth.ts, baseline.ts)
- ElectricProvider.tsx
- docker/scripts/init-electric-user.sh
- content/docs/how-to/electric-sql.mdx

Cleaned:
- package.json (4 @electric-sql/* deps)
- app/layout.tsx, UserDropdown.tsx, LayoutDataProvider.tsx
- docker-compose.yml, docker-compose.dev.yml
- Dockerfile, docker-entrypoint.js
- .env.example (frontend, docker, backend)
- CI workflows, install scripts, docs
2026-03-23 16:53:20 +02:00
Anish Sarkar
bc1f31b481 feat: enhance SearxNG settings and improve loading indicators
- Added new search engines (qwant news, qwant images, qwant videos, mojeek images, mojeek news) to the default settings for better search results.
- Updated outgoing request settings by removing the decimal from `extra_proxy_timeout` for consistency.
- Integrated a `Spinner` component in `LayoutDataProvider` to improve loading feedback during chat deletion processes.
2026-03-17 04:35:13 +05:30
Anish Sarkar
543fe45540 feat: update SearxNG settings for enhanced search engine management
- Removed specific engines (ahmia, torch, qwant, mojeek) from default settings.
- Added new configuration options for search engine failure handling, including ban times and retries.
- Introduced additional search engines (bing, yahoo, stackoverflow) with retry logic for HTTP errors.
- Updated request timeout settings for outgoing requests to improve performance.
2026-03-17 04:27:36 +05:30