Commit graph

3505 commits

Author SHA1 Message Date
Anish Sarkar
20ebb0703f chore: add icons to documentation metadata for improved visual representation 2026-02-27 02:15:21 +05:30
Anish Sarkar
78dcce3e06 refactor: update testing documentation for clarity and structure 2026-02-27 02:07:14 +05:30
Anish Sarkar
836d5293df refactor: remove unused TestStatusPolling class from document upload integration tests 2026-02-27 01:52:35 +05:30
Anish Sarkar
fd032f3709 refactor: simplify and clarify documentation in document upload integration tests 2026-02-27 01:48:25 +05:30
Anish Sarkar
7c09958ddc refactor: enhance document upload integration tests for API contract validation 2026-02-27 01:24:20 +05:30
Anish Sarkar
1068ea25a7 refactor: standardize test database configuration across test files 2026-02-27 00:45:51 +05:30
Anish Sarkar
f09b5b0ea4 refactor: replace hardcoded embedding dimension with dynamic configuration
- Updated the embedding dimension in test configurations to use the value from the application config, enhancing maintainability and consistency across tests.
2026-02-27 00:17:39 +05:30
Anish Sarkar
223c2de0d2 refactor: update database connection handling in test configurations 2026-02-27 00:05:21 +05:30
Anish Sarkar
87711ee381 chore: clean up .env.example and pyproject.toml
- Removed commented-out testing configuration from .env.example to streamline the file.
- Updated markers in pyproject.toml to remove the e2e test marker, clarifying the purpose of the remaining markers.
2026-02-26 23:56:01 +05:30
Anish Sarkar
3393e435f9 feat: implement task dispatcher for document processing
- Introduced a TaskDispatcher abstraction to decouple the upload endpoint from Celery, allowing for easier testing with synchronous implementations.
- Updated the create_documents_file_upload function to utilize the new dispatcher for task management.
- Removed direct Celery task imports from the upload function, enhancing modularity.
- Added integration tests for document upload, including page limit enforcement and file size restrictions.
2026-02-26 23:55:47 +05:30
Anish Sarkar
232622f9b3 docs: enhance Docker installation documentation with development compose file details and health check information 2026-02-26 20:17:19 +05:30
Anish Sarkar
06e6c1c1be chore: add healthcheck configuration for backend and update service dependencies to ensure healthy startup 2026-02-26 20:08:18 +05:30
Anish Sarkar
bc3db01778 docs: update SurfSense version comment in .env.example to clarify versioning options 2026-02-26 19:40:36 +05:30
Anish Sarkar
32d092b293 feat: Add clean GHCR version tags alongside build tags; also update docker installation docs 2026-02-26 19:39:07 +05:30
Anish Sarkar
7d99dbc0d5 docs: update connector documentation to specify adding credentials to .env file instead of Docker run command 2026-02-26 19:24:55 +05:30
Anish Sarkar
2e8e85a4ef docs: enhance Docker installation and migration documentation with updated steps and options for managing updates 2026-02-26 19:11:57 +05:30
Anish Sarkar
90f18fac38 chore: update Docker image references to new repository for backend and frontend services 2026-02-26 18:54:44 +05:30
Anish Sarkar
71a995da23 docs: update installation instructions across multiple languages to include new Docker command and manual update process 2026-02-26 18:51:13 +05:30
Anish Sarkar
35025bf0c5 chore: update Docker images to new repository and enable Watchtower for automatic updates 2026-02-26 18:39:24 +05:30
Anish Sarkar
4f59e2c1f9 chore: remove obsolete .env.example file to declutter configuration and streamline project setup 2026-02-26 18:13:11 +05:30
Anish Sarkar
bb83ee5b85 refactor: update version display in installation script and streamline database migration script 2026-02-26 17:56:18 +05:30
Anish Sarkar
22bd38f346 fix: ensure DB credentials are set correctly in migration mode by adding fallback to defaults 2026-02-26 17:49:10 +05:30
Anish Sarkar
025643ffa2 feat: enhance installation and migration scripts to automate legacy data migration process
- Updated install.sh to handle fresh installations and migrations from the legacy all-in-one container.
- Added checks for Docker and Docker Compose prerequisites.
- Implemented a wait-for-postgres function to ensure database readiness.
- Enhanced migration script to extract data and recover SECRET_KEY automatically.
- Updated documentation to reflect the new automated migration process.
2026-02-26 17:24:02 +05:30
Anish Sarkar
5030dec96b chore: update banner in installation and database migration scripts for improved visibility 2026-02-26 16:18:13 +05:30
Anish Sarkar
f051c19aca feat: add database migration script and update installation instructions for legacy all-in-one users 2026-02-26 16:15:47 +05:30
Anish Sarkar
91c30db3e4 chore: reorganize comments in .env.example for improved clarity and consistency in development configuration 2026-02-26 16:04:47 +05:30
Anish Sarkar
cbff5bda65 chore: remove unnecessary comment from .env.example to streamline configuration clarity 2026-02-26 15:01:34 +05:30
Anish Sarkar
f4f659e190 chore: add Daytona Sandbox configuration options to .env.example and Docker Compose files for cloud code execution 2026-02-26 14:37:08 +05:30
Anish Sarkar
b5874a587a chore: resolve merge conflict by removing legacy all-in-one Docker files
Keeps the deletion of Dockerfile.allinone, docker-compose.yml (root), and
scripts/docker/entrypoint-allinone.sh from fix/docker. Ports the Daytona
sandbox env vars added by upstream/dev into docker/docker-compose.yml and
docker/docker-compose.dev.yml instead.

Made-with: Cursor
2026-02-26 13:57:56 +05:30
Anish Sarkar
6e2a055669 chore: enhance .env.example with additional configuration options for pgAdmin and frontend build arguments 2026-02-26 11:19:51 +05:30
Anish Sarkar
b06c70a61d chore: update GitHub Actions workflow to trigger on main branch pushes and add concurrency settings 2026-02-26 11:17:34 +05:30
Anish Sarkar
512640354c chore: update Docker Compose files to specify names for volume configurations 2026-02-26 10:23:38 +05:30
Anish Sarkar
f311a34bf3 chore: update README and installation documentation to streamline Docker setup and clarify update instructions 2026-02-26 05:38:15 +05:30
Anish Sarkar
9ae589b6ba chore: update documentation for Electric SQL setup and enhance .env.example with connection instructions 2026-02-26 05:26:38 +05:30
Anish Sarkar
95c41565f1 chore: update .env.example 2026-02-26 05:09:56 +05:30
Anish Sarkar
176dfdaeed chore: enhance .env.example with restructuring configuration options for ports and reverse proxy settings 2026-02-26 04:59:53 +05:30
Anish Sarkar
85eabff246 chore: update Docker configuration to use new repository and set SURFSENSE_VERSION to latest 2026-02-26 04:45:59 +05:30
Anish Sarkar
bbbde07db7 chore: set specific version for testing 2026-02-26 03:58:06 +05:30
Rohan Verma
30617c6e54
Merge pull request #836 from AnishSarkar22/feat/document-test
feat: add document upload E2E tests
2026-02-25 14:22:07 -08:00
Anish Sarkar
4ce883b615 chore: update Docker images to use repo for testing 2026-02-26 03:49:32 +05:30
Anish Sarkar
bf60a5049f feat: add end-to-end test for document searchability after upload
- Introduced a new test class to verify that uploaded documents appear in search results once their status is ready.
- Implemented assertions to ensure the uploaded document's ID is present in the search response.
2026-02-26 03:33:37 +05:30
Anish Sarkar
9ccee054a5 chore: ran linting 2026-02-26 03:05:20 +05:30
Anish Sarkar
7332be956e refactor: reorganize test fixtures and helpers for improved clarity and maintainability 2026-02-26 03:04:56 +05:30
Anish Sarkar
f59a70f7a5 Merge remote-tracking branch 'upstream/dev' into feat/document-test 2026-02-26 02:22:10 +05:30
Rohan Verma
2e99f1e853
Merge pull request #837 from CREDO23/test-document-creation
[Refactor] Core document creation / indexing pipeline with unit and e2e tests
2026-02-25 12:27:41 -08:00
DESKTOP-RTLN3BA\$punk
54dd6f904c feat: implement local file persistence for Daytona sandboxes
- Added functionality to persist sandbox files locally before deletion.
- Introduced methods for retrieving and deleting locally stored sandbox files.
- Updated routes to handle local file downloads and background deletion of sandboxes.
- Enhanced streaming tasks to support sandbox file management.
2026-02-25 12:25:59 -08:00
Anish Sarkar
d6e442b466 fix: Improve document upload tests by adding assertions for document IDs and handling transient transport errors 2026-02-26 01:50:57 +05:30
Anish Sarkar
25df3dff64 chore: ran linting 2026-02-26 01:29:25 +05:30
Anish Sarkar
380c1c3877 fix: Refactor document ID usage in file processing to improve clarity 2026-02-26 01:28:09 +05:30
Anish Sarkar
a57ab02900 feat: Implement file upload limits and page limit enforcement in backend
- Added constants for maximum files per upload, per-file size, and total upload size.
- Enhanced document upload route to validate file counts and sizes, returning appropriate HTTP errors.
- Introduced end-to-end tests for upload limits and page limit enforcement, ensuring correct behavior under various scenarios.
- Updated test helpers to support notification retrieval for page limit exceeded scenarios.
2026-02-26 01:25:34 +05:30