Anish Sarkar
56c5809170
chore: ran linting
2026-04-08 18:23:03 +05:30
Anish Sarkar
37c52ce7ea
feat: implement indexing progress management in local folder indexing process and enhance related test coverage
2026-04-08 18:01:55 +05:30
Anish Sarkar
a2b3541046
chore: ran linting
2026-04-04 03:11:56 +05:30
Anish Sarkar
9c0af6569d
feat: implement page limit checks in local folder indexing to manage user page usage
2026-04-03 19:13:25 +05:30
Anish Sarkar
edda5b98cb
chore: ran linting
2026-04-03 17:38:29 +05:30
Anish Sarkar
b759bb36a9
feat: add direct conversion support for CSV, TSV, and HTML files in local folder indexing
2026-04-03 17:36:48 +05:30
Anish Sarkar
746c730b2e
chore: ran linting
2026-04-03 13:14:40 +05:30
Anish Sarkar
2b9d79d44c
feat: add integration tests for batch processing of local folder indexing, covering multiple file scenarios and error handling
2026-04-03 10:04:14 +05:30
Anish Sarkar
1fa8e1cc83
feat: refactor folder indexing to support batch processing of multiple files, enhancing performance and error handling
2026-04-03 10:02:36 +05:30
Anish Sarkar
53df393cf7
refactor: streamline local folder indexing logic by removing unused imports, enhancing content hashing, and improving document creation process
2026-04-02 23:28:23 +05:30
Anish Sarkar
c27d24a117
feat: enhance folder indexing by adding root folder ID support and implement folder creation and cleanup logic
2026-04-02 22:41:45 +05:30
Anish Sarkar
caf2525ab5
fix: update folder ID collection logic to include deleted directories and adjust test cases for document titles
2026-04-02 22:29:07 +05:30
Anish Sarkar
22ee5c99cc
refactor: remove Local Folder connector and related tasks, implement new folder indexing endpoints
2026-04-02 22:21:31 +05:30
Anish Sarkar
775dea7894
feat: add integration and unit tests for local folder indexing and document versioning
2026-04-02 11:12:16 +05:30
Anish Sarkar
272de1bb40
feat: add integration and unit tests for Dropbox indexing pipeline and parallel downloads
2026-03-30 22:19:15 +05:30
Anish Sarkar
04691d572b
chore: ran linting
2026-03-30 01:50:41 +05:30
Anish Sarkar
5a3eece397
Merge remote-tracking branch 'upstream/dev' into feat/onedrive-connector
2026-03-29 11:55:06 +05:30
DESKTOP-RTLN3BA\$punk
2cc2d339e6
feat: made agent file sytem optimized
2026-03-28 16:39:46 -07:00
Anish Sarkar
028c88be72
feat: add integration and unit tests for OneDrive indexing pipeline and parallel downloads
2026-03-28 16:39:47 +05:30
Anish Sarkar
4e0749f907
fix: update file skipping logic for failed documents in Google Drive indexer
...
- Modified the `_should_skip_file` function to skip previously failed documents during processing, improving error handling.
- Updated the corresponding test to reflect the new behavior, ensuring that failed documents are correctly identified and skipped during automatic sync.
2026-03-27 20:01:08 +05:30
Anish Sarkar
c3d5c865fd
fix: update file skipping logic in Google Drive indexer
...
- Modified the `_should_skip_file` function to prevent skipping of documents with a FAILED status, ensuring they are reprocessed even if their content remains unchanged.
- Added a new integration test to verify that FAILED documents are not skipped during the indexing process.
2026-03-25 18:51:40 +05:30
Anish Sarkar
8c41fd91ba
feat: add integration tests for indexing pipeline components
...
- Introduced integration tests for Calendar, Drive, and Gmail indexers to ensure proper document creation and migration.
- Added tests for batch indexing functionality to validate the processing of multiple documents.
- Implemented tests for legacy document migration to verify updates to document types and hashes.
- Enhanced test coverage for the IndexingPipelineService to ensure robust functionality across various document types.
2026-03-25 18:34:02 +05:30
CREDO23
929445afd9
feat: use batch embedding in IndexingPipelineService.index
2026-03-09 16:13:44 +02:00
Anish Sarkar
b2bf00e11a
chore: ran linting
2026-02-28 02:28:03 +05:30
Anish Sarkar
ce82807f16
test: enhance reindexing tests for UploadDocumentAdapter
2026-02-28 02:18:02 +05:30
Anish Sarkar
37f76a8533
test: add should_summarize parameter to file upload adapter tests
2026-02-28 01:44:41 +05:30
Anish Sarkar
23a98d802c
refactor: implement UploadDocumentAdapter for file indexing and reindexing
2026-02-28 01:38:32 +05:30
Anish Sarkar
f09b5b0ea4
refactor: replace hardcoded embedding dimension with dynamic configuration
...
- Updated the embedding dimension in test configurations to use the value from the application config, enhancing maintainability and consistency across tests.
2026-02-27 00:17:39 +05:30
Anish Sarkar
9ccee054a5
chore: ran linting
2026-02-26 03:05:20 +05:30
CREDO23
0de74f4bf7
add docstrings to all indexing pipeline tests
2026-02-25 20:30:31 +02:00
CREDO23
4293910e8e
plug file upload into indexing pipeline adapter and add integration tests
2026-02-25 20:20:52 +02:00
CREDO23
ca870cf660
add fallback document sumary
2026-02-25 13:47:36 +02:00
CREDO23
36d1fba75f
fix: isolate per-document errors in prepare_for_indexing
2026-02-25 13:00:34 +02:00
CREDO23
e6b7ce7345
fix: handle IntegrityError in prepare_for_indexing and add within-batch content dedup test
2026-02-25 12:03:00 +02:00
CREDO23
1b4ed35de3
fix: correct test fixtures and add missing summarizer tests
2026-02-25 11:15:48 +02:00
CREDO23
c5ae62140d
fix: rescue stuck documents with unchanged content on next indexing run
2026-02-25 11:13:25 +02:00
CREDO23
0363cb9c17
fix: updated_at on title change, LLM fallback, stale chunks deleted on re-index
2026-02-25 08:40:13 +02:00
CREDO23
af22fa7c88
refactor: remove redundant and low-value tests, enforce connector_id and created_by_id constraints
2026-02-25 08:29:53 +02:00
CREDO23
5b616eac5a
fix: plug all gaps found in deep review of indexing pipeline
2026-02-25 02:20:44 +02:00
CREDO23
46c7ccd70b
rename test_index.py to test_index_document.py
2026-02-25 01:43:21 +02:00
CREDO23
61e50834e6
feat: implement and test index method
2026-02-25 01:40:30 +02:00
CREDO23
497ed681d5
feat: implement and test index happy path
2026-02-25 00:30:11 +02:00
CREDO23
579a9e2cb5
feat: implement and test prepare_for_indexing
2026-02-25 00:06:34 +02:00
CREDO23
10a6ba6924
test: bootstrap pytest environment for backend
2026-02-24 18:19:56 +02:00
