Commit graph

82 commits

Author SHA1 Message Date
Anish Sarkar
20fa93f0ba refactor: make Azure Document Intelligence an internal LLAMACLOUD accelerator instead of a standalone ETL service 2026-04-08 03:26:24 +05:30
Anish Sarkar
1fa8d1220b feat: add support for Azure Document Intelligence in ETL pipeline 2026-04-08 00:59:12 +05:30
CREDO23
10e0e733af fix: configure zero-cache sync workers, connection limits, and publication 2026-04-01 10:18:51 +02:00
DESKTOP-RTLN3BA\$punk
f9a79d5a5f feat: add Stripe configuration options for docker 2026-03-31 22:26:47 -07:00
Anish Sarkar
54828522f8 feat: add Dropbox integration support with configuration and connector updates 2026-03-30 22:16:41 +05:30
Anish Sarkar
028c88be72 feat: add integration and unit tests for OneDrive indexing pipeline and parallel downloads 2026-03-28 16:39:47 +05:30
Anish Sarkar
7004e764a9 chore: refactor Microsoft OAuth configuration to unify client ID and secret for Teams and OneDrive in environment files and related code 2026-03-28 16:37:23 +05:30
Anish Sarkar
bb894ee158 chore: update environment variable names for Microsoft OAuth integration in Docker and SurfSense backend 2026-03-28 16:35:36 +05:30
CREDO23
5c98f1c717 add ZERO_MUTATE_URL and no-op mutate endpoint for zero-cache auth passthrough 2026-03-24 16:25:13 +02:00
CREDO23
cab33d9f4c fix: make ZERO_QUERY_URL portable across all environments
- Default to Docker service networking (http://frontend:3000) in both
  compose files — works when all services run in Docker
- Add extra_hosts (host.docker.internal:host-gateway) for cross-platform
  host access when running frontend outside Docker
- Document override examples in .env.example for local dev and
  custom domain setups
2026-03-24 15:06:58 +02:00
CREDO23
8dd539c384 feat: add Zero query endpoint and configure ZERO_QUERY_URL
- Create app/api/zero/query/route.ts — resolves named queries to ZQL
  using handleQueryRequest and mustGetQuery from @rocicorp/zero
- Add ZERO_QUERY_URL to both docker-compose files:
  - dev: http://host.docker.internal:3000 (reaches local Next.js from Docker)
  - prod: http://frontend:3000 (Docker service networking)

Without this endpoint, zero-cache cannot resolve named queries and
no data syncs to the client.
2026-03-23 20:58:42 +02:00
CREDO23
f29a3edcab chore: update postgresql.conf and contracts comments for Zero
- Replace Electric SQL references in postgresql.conf with Zero-cache
- Clean Electric SQL comments in chat-comments.types.ts and chat-messages.types.ts
2026-03-23 18:30:49 +02:00
CREDO23
f9ba7e52d9 feat: add Zero infra — docker-compose, env vars, Dockerfile, CI workflows
- Add zero-cache service to docker-compose.yml and docker-compose.dev.yml
- Add ZERO_* env vars to docker/.env.example
- Add NEXT_PUBLIC_ZERO_CACHE_URL to surfsense_web/.env.example
- Add NEXT_PUBLIC_ZERO_CACHE_URL placeholder ARG/ENV to Dockerfile
- Add NEXT_PUBLIC_ZERO_CACHE_URL runtime substitution to docker-entrypoint.js
- Add NEXT_PUBLIC_ZERO_CACHE_URL build arg to docker-build.yml and desktop-release.yml
2026-03-23 18:27:18 +02:00
CREDO23
61610106f4 feat: add zero-cache service to production docker-compose
- Add rocicorp/zero:0.26.2 service with Postgres connection,
  SQLite replica volume, healthcheck, and admin password
- Add NEXT_PUBLIC_ZERO_CACHE_URL to frontend env vars
- Frontend now depends on zero-cache health
2026-03-23 18:19:37 +02:00
CREDO23
2b7465cdaa chore: remove Electric SQL plumbing and infrastructure
Remove all Electric SQL client code, Docker service, env vars, CI build
args, install scripts, and documentation. Feature hooks that depend on
Electric are intentionally left in place to be rewritten with Rocicorp
Zero in subsequent commits.

Deleted:
- lib/electric/ (client.ts, context.ts, auth.ts, baseline.ts)
- ElectricProvider.tsx
- docker/scripts/init-electric-user.sh
- content/docs/how-to/electric-sql.mdx

Cleaned:
- package.json (4 @electric-sql/* deps)
- app/layout.tsx, UserDropdown.tsx, LayoutDataProvider.tsx
- docker-compose.yml, docker-compose.dev.yml
- Dockerfile, docker-entrypoint.js
- .env.example (frontend, docker, backend)
- CI workflows, install scripts, docs
2026-03-23 16:53:20 +02:00
Anish Sarkar
bc1f31b481 feat: enhance SearxNG settings and improve loading indicators
- Added new search engines (qwant news, qwant images, qwant videos, mojeek images, mojeek news) to the default settings for better search results.
- Updated outgoing request settings by removing the decimal from `extra_proxy_timeout` for consistency.
- Integrated a `Spinner` component in `LayoutDataProvider` to improve loading feedback during chat deletion processes.
2026-03-17 04:35:13 +05:30
Anish Sarkar
543fe45540 feat: update SearxNG settings for enhanced search engine management
- Removed specific engines (ahmia, torch, qwant, mojeek) from default settings.
- Added new configuration options for search engine failure handling, including ban times and retries.
- Introduced additional search engines (bing, yahoo, stackoverflow) with retry logic for HTTP errors.
- Updated request timeout settings for outgoing requests to improve performance.
2026-03-17 04:27:36 +05:30
Anish Sarkar
a548c96550 chore: update SearXNG installation scripts and directory structure
- Updated the Docker Compose file to use the latest SearXNG image version 2026.3.13-3c1f68c59.
- Added creation of the 'searxng' directory in installation scripts for better organization.
- Included new configuration files (settings.yml and limiter.toml) in the installation process.
2026-03-15 04:05:04 +05:30
Anish Sarkar
cc841a5af4 chore: update SearXNG engine settings and example configuration 2026-03-14 21:27:09 +05:30
Anish Sarkar
4376f74127 chore: update SearXNG service configuration in Docker and documentation
- Updated SearXNG image version to 2026.3.13-3c1f68c59 in the Docker Compose file.
- Added port mapping for SearXNG service to allow access on a configurable port.
- Enhanced the .env.example file with comments for SearXNG configuration and usage instructions.
2026-03-14 21:03:25 +05:30
Anish Sarkar
d9e312ddaa refactor: simplify SearXNG service configuration in Docker setup
- Consolidated volume mappings for SearXNG to use a single directory.
- Removed unnecessary port mappings and legacy data volume definitions.
- Updated web search service documentation to clarify Redis usage and circuit breaker implementation, eliminating Redis dependency for circuit breaker logic.
2026-03-14 20:34:34 +05:30
Anish Sarkar
d40c6bf743 feat: integrate SearXNG web search service with platform capabilities
- Added SearXNG service configuration to Docker setup, including environment variables and health checks.
- Introduced new settings management for web search in the frontend, allowing users to enable/disable and configure search engines and language preferences.
- Updated backend to support web search functionality, including database schema changes and service integration.
- Implemented health check endpoint for the web search service and integrated it into the application.
- Removed legacy SearXNG API connector references in favor of the new platform service approach.
2026-03-14 20:25:25 +05:30
Anish Sarkar
933c767806 Merge remote-tracking branch 'upstream/dev' into fix/docker-dev 2026-03-10 11:25:54 +05:30
Anish Sarkar
4e0886e06d chore: rename services and volumes in docker-compose.dev.yml for clarity and consistency in local development environment 2026-03-10 02:57:44 +05:30
Anish Sarkar
ab0f75f8ab chore: update port configurations in Docker setup to avoid conflicts and improve local development environment 2026-03-09 23:08:27 +05:30
DESKTOP-RTLN3BA\$punk
33f88bf46c fix: remove Out-Null from docker compose command in install.ps1 to allow output visibility 2026-03-03 14:55:31 -08:00
DESKTOP-RTLN3BA\$punk
01a1c17b09 fix: update SURFSENSE_VERSION to latest and change repository URL to main branch in installation scripts 2026-03-03 13:53:28 -08:00
DESKTOP-RTLN3BA\$punk
441421c009 fix: update version display message in installation scripts to reflect new branding 2026-03-03 13:51:13 -08:00
DESKTOP-RTLN3BA\$punk
c2a8d43281 fix: update dump file handling in install.ps1 to read content directly for PostgreSQL restoration 2026-03-03 13:42:20 -08:00
DESKTOP-RTLN3BA\$punk
1541cb3c7b fix: update dump file handling in install.ps1 to use resolved path for PostgreSQL restoration 2026-03-03 13:32:43 -08:00
DESKTOP-RTLN3BA\$punk
0cffa206ad fix: correct dump content retrieval in migrate-database.ps1 to ensure proper handling of PostgreSQL dump files 2026-03-03 13:13:25 -08:00
DESKTOP-RTLN3BA\$punk
b88122fc17 refactor: implement Invoke-NativeSafe function in installation and migration scripts to streamline error handling for Docker commands 2026-03-03 13:08:37 -08:00
DESKTOP-RTLN3BA\$punk
59d8afca4f fix: enhance error handling in migrate-database.ps1 by implementing try-finally for Docker info command 2026-03-03 13:00:10 -08:00
DESKTOP-RTLN3BA\$punk
8238c56b3f fix: improve error handling in Docker installation script for Windows by using try-finally blocks 2026-03-03 12:56:07 -08:00
DESKTOP-RTLN3BA\$punk
01f8a3ed80 chore: update SURFSENSE_VERSION in .env.example to 0.0.13.9 for testing 2026-03-03 12:40:35 -08:00
Anish Sarkar
533519b343 refactor: enhance version display logic in installation scripts to read from .env file 2026-03-03 19:43:55 +05:30
Anish Sarkar
0fd1d37ed4 chore: update installation script to improve error handling and suppress output in Docker commands 2026-03-03 19:33:21 +05:30
Anish Sarkar
e7d6e5f5bd feat: add Windows installation script and update README for Linux/MacOS users 2026-03-03 19:13:59 +05:30
Anish Sarkar
d9ebc2c599 chore: update GitHub Actions workflow to include 'dev' branch and change installation script to use 'dev' repository URL 2026-03-03 03:35:29 +05:30
Anish Sarkar
6e1ca96d57 feat: add migration completion tracking to installation script 2026-02-27 22:59:51 +05:30
Anish Sarkar
57a1c71582 chore: upgrade Redis to version 8-alpine and ElectricSQL to version 1.4.10 in Docker Compose configuration 2026-02-27 22:26:02 +05:30
Anish Sarkar
848ad55071 chore: update URL links for production 2026-02-27 22:21:44 +05:30
Anish Sarkar
6626a0221c chore: update Redis and ElectricSQL Docker images to latest versions 2026-02-27 21:49:42 +05:30
Anish Sarkar
494307b2b9 refactor: encapsulate installation script logic in a main function for improved structure and readability 2026-02-27 21:40:49 +05:30
Anish Sarkar
fbef820377 fix: redirect stdin to /dev/null in Docker commands to suppress unwanted input prompts 2026-02-27 21:22:15 +05:30
Anish Sarkar
9124b19ee9 chore: update Docker image references for testing 2026-02-27 20:46:16 +05:30
Anish Sarkar
66d9cd570b fix: suppress benign output during database restoration in installation script 2026-02-27 04:59:12 +05:30
Anish Sarkar
4e401fdb92 feat: enhance installation script to include automatic Watchtower setup with customizable interval 2026-02-27 04:41:08 +05:30
Anish Sarkar
48ee5e86aa chore: updated links to the main branch for production 2026-02-27 04:17:37 +05:30
Anish Sarkar
ccae5ffeb1 fix: add error handling for missing dump file in migration script and update logging for migration step 2026-02-27 04:06:01 +05:30