Commit graph

3935 commits

Author SHA1 Message Date
Anish Sarkar
bb83ee5b85 refactor: update version display in installation script and streamline database migration script 2026-02-26 17:56:18 +05:30
Anish Sarkar
22bd38f346 fix: ensure DB credentials are set correctly in migration mode by adding fallback to defaults 2026-02-26 17:49:10 +05:30
Anish Sarkar
025643ffa2 feat: enhance installation and migration scripts to automate legacy data migration process
- Updated install.sh to handle fresh installations and migrations from the legacy all-in-one container.
- Added checks for Docker and Docker Compose prerequisites.
- Implemented a wait-for-postgres function to ensure database readiness.
- Enhanced migration script to extract data and recover SECRET_KEY automatically.
- Updated documentation to reflect the new automated migration process.
2026-02-26 17:24:02 +05:30
Anish Sarkar
5030dec96b chore: update banner in installation and database migration scripts for improved visibility 2026-02-26 16:18:13 +05:30
Anish Sarkar
f051c19aca feat: add database migration script and update installation instructions for legacy all-in-one users 2026-02-26 16:15:47 +05:30
Anish Sarkar
91c30db3e4 chore: reorganize comments in .env.example for improved clarity and consistency in development configuration 2026-02-26 16:04:47 +05:30
Anish Sarkar
cbff5bda65 chore: remove unnecessary comment from .env.example to streamline configuration clarity 2026-02-26 15:01:34 +05:30
Anish Sarkar
f4f659e190 chore: add Daytona Sandbox configuration options to .env.example and Docker Compose files for cloud code execution 2026-02-26 14:37:08 +05:30
Anish Sarkar
b5874a587a chore: resolve merge conflict by removing legacy all-in-one Docker files
Keeps the deletion of Dockerfile.allinone, docker-compose.yml (root), and
scripts/docker/entrypoint-allinone.sh from fix/docker. Ports the Daytona
sandbox env vars added by upstream/dev into docker/docker-compose.yml and
docker/docker-compose.dev.yml instead.

Made-with: Cursor
2026-02-26 13:57:56 +05:30
Anish Sarkar
6e2a055669 chore: enhance .env.example with additional configuration options for pgAdmin and frontend build arguments 2026-02-26 11:19:51 +05:30
Anish Sarkar
b06c70a61d chore: update GitHub Actions workflow to trigger on main branch pushes and add concurrency settings 2026-02-26 11:17:34 +05:30
Anish Sarkar
512640354c chore: update Docker Compose files to specify names for volume configurations 2026-02-26 10:23:38 +05:30
Anish Sarkar
f311a34bf3 chore: update README and installation documentation to streamline Docker setup and clarify update instructions 2026-02-26 05:38:15 +05:30
Anish Sarkar
9ae589b6ba chore: update documentation for Electric SQL setup and enhance .env.example with connection instructions 2026-02-26 05:26:38 +05:30
Anish Sarkar
95c41565f1 chore: update .env.example 2026-02-26 05:09:56 +05:30
Anish Sarkar
176dfdaeed chore: enhance .env.example with restructuring configuration options for ports and reverse proxy settings 2026-02-26 04:59:53 +05:30
Anish Sarkar
85eabff246 chore: update Docker configuration to use new repository and set SURFSENSE_VERSION to latest 2026-02-26 04:45:59 +05:30
Anish Sarkar
bbbde07db7 chore: set specific version for testing 2026-02-26 03:58:06 +05:30
Rohan Verma
30617c6e54
Merge pull request #836 from AnishSarkar22/feat/document-test
feat: add document upload E2E tests
2026-02-25 14:22:07 -08:00
Anish Sarkar
4ce883b615 chore: update Docker images to use repo for testing 2026-02-26 03:49:32 +05:30
Anish Sarkar
bf60a5049f feat: add end-to-end test for document searchability after upload
- Introduced a new test class to verify that uploaded documents appear in search results once their status is ready.
- Implemented assertions to ensure the uploaded document's ID is present in the search response.
2026-02-26 03:33:37 +05:30
Anish Sarkar
9ccee054a5 chore: ran linting 2026-02-26 03:05:20 +05:30
Anish Sarkar
7332be956e refactor: reorganize test fixtures and helpers for improved clarity and maintainability 2026-02-26 03:04:56 +05:30
Anish Sarkar
f59a70f7a5 Merge remote-tracking branch 'upstream/dev' into feat/document-test 2026-02-26 02:22:10 +05:30
Rohan Verma
2e99f1e853
Merge pull request #837 from CREDO23/test-document-creation
[Refactor] Core document creation / indexing pipeline with unit and e2e tests
2026-02-25 12:27:41 -08:00
DESKTOP-RTLN3BA\$punk
54dd6f904c feat: implement local file persistence for Daytona sandboxes
- Added functionality to persist sandbox files locally before deletion.
- Introduced methods for retrieving and deleting locally stored sandbox files.
- Updated routes to handle local file downloads and background deletion of sandboxes.
- Enhanced streaming tasks to support sandbox file management.
2026-02-25 12:25:59 -08:00
Anish Sarkar
d6e442b466 fix: Improve document upload tests by adding assertions for document IDs and handling transient transport errors 2026-02-26 01:50:57 +05:30
Anish Sarkar
25df3dff64 chore: ran linting 2026-02-26 01:29:25 +05:30
Anish Sarkar
380c1c3877 fix: Refactor document ID usage in file processing to improve clarity 2026-02-26 01:28:09 +05:30
Anish Sarkar
a57ab02900 feat: Implement file upload limits and page limit enforcement in backend
- Added constants for maximum files per upload, per-file size, and total upload size.
- Enhanced document upload route to validate file counts and sizes, returning appropriate HTTP errors.
- Introduced end-to-end tests for upload limits and page limit enforcement, ensuring correct behavior under various scenarios.
- Updated test helpers to support notification retrieval for page limit exceeded scenarios.
2026-02-26 01:25:34 +05:30
CREDO23
c50d661d7d fix wrong status key in adapter error reporting 2026-02-25 21:00:55 +02:00
CREDO23
7a0b8838d1 chore: cleanup 2026-02-25 20:58:46 +02:00
CREDO23
ab31bba3ad merge upstream/dev 2026-02-25 20:52:05 +02:00
CREDO23
d0fdd3224a fix metadata keys casing and set content_needs_reindexing in adapter 2026-02-25 20:39:18 +02:00
CREDO23
0de74f4bf7 add docstrings to all indexing pipeline tests 2026-02-25 20:30:31 +02:00
CREDO23
4293910e8e plug file upload into indexing pipeline adapter and add integration tests 2026-02-25 20:20:52 +02:00
CREDO23
cad400be1b add file upload adapter and make index() return refreshed document 2026-02-25 19:56:59 +02:00
CREDO23
86ecb82c6e fix: tighten indexing pipeline exception handling and logging 2026-02-25 17:44:35 +02:00
CREDO23
5be58b78ad simplify indexing pipeline DB error handling 2026-02-25 16:59:09 +02:00
Anish Sarkar
93c0af475b Merge remote-tracking branch 'upstream/dev' into feat/document-test 2026-02-25 20:25:06 +05:30
Anish Sarkar
853750e6e9 chore: ran linting 2026-02-25 20:08:20 +05:30
Anish Sarkar
a7df26d451 refactor: remove redundant status assertion 2026-02-25 20:07:34 +05:30
CREDO23
66d7d3da8a fix bugs in indexing pipeline exception handling 2026-02-25 16:27:12 +02:00
Anish Sarkar
e1ac8bfc76 feat: Add testing environment variables to surfsense_backend/.env.example and update documentation 2026-02-25 19:52:25 +05:30
Anish Sarkar
c564e5f768 feat: Enhance test document purging by implementing direct database access 2026-02-25 19:51:29 +05:30
CREDO23
b6c25628c8 add structured logging to indexing pipeline 2026-02-25 16:04:35 +02:00
CREDO23
610080bfef extract persistence helpers into document_persistence.py 2026-02-25 15:30:25 +02:00
Anish Sarkar
c3273af20b feat: Add fixture to purge all test search space documents before a new session 2026-02-25 18:59:23 +05:30
CREDO23
0aeb888be0 add structured error handling to indexing pipeline 2026-02-25 15:26:04 +02:00
Anish Sarkar
2fef971fa9 chore: Update pytest duration reporting in pyproject.toml and refine testing documentation 2026-02-25 18:36:55 +05:30