DESKTOP-RTLN3BA\$punk
0fe650fd8e
Merge commit ' 7ce409c580' into dev
2026-06-16 22:48:14 -07:00
DESKTOP-RTLN3BA\$punk
89cc3b37ee
fix(db): prevent boot-time index DDL from hanging FastAPI startup
...
A single abandoned "idle in transaction" session held locks on the
documents table, which blocked the non-concurrent CREATE INDEX (hnsw)
run inside the FastAPI lifespan. Each API restart queued another
CREATE INDEX behind an advisory lock, leaving the server stuck at
"Waiting for application startup." indefinitely and freezing ingestion
writes.
Changes:
- setup_indexes(): build every index with CREATE INDEX CONCURRENTLY
(non-blocking ShareUpdateExclusiveLock) under a per-session
lock_timeout, and make each statement non-fatal so a contended/slow
build is retried next boot instead of wedging startup. Drop leftover
invalid indexes before rebuilding.
- create_db_and_tables(): apply lock_timeout to extension/create_all
DDL and gate the whole bootstrap behind DB_BOOTSTRAP_ON_STARTUP.
- engine: set idle_in_transaction_session_timeout (asyncpg) so an
abandoned transaction is reaped automatically.
- config + .env.example: DB_BOOTSTRAP_ON_STARTUP, DB_DDL_LOCK_TIMEOUT_MS,
DB_IDLE_IN_TX_TIMEOUT_MS.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-16 16:18:49 -07:00
CREDO23
32a6e54ce6
Merge remote-tracking branch 'upstream/dev' into features/documents-injestion-layered-cached
2026-06-14 11:30:33 +02:00
Anish Sarkar
7926814070
refactor(model-connections): remove unused fields and update verification logic
2026-06-14 02:46:19 +05:30
Anish Sarkar
c7409c8995
chore: ran linting
2026-06-13 21:59:35 +05:30
Anish Sarkar
bd4a04f2e7
feat(database-migrations): add migration to remove legacy model config tables and remove stale model connection code
2026-06-13 12:45:43 +05:30
Anish Sarkar
45d27ba879
feat(model-connections): enhance auto mode with auto pinning
2026-06-13 01:39:26 +05:30
CREDO23
c6e71c851c
feat(chunks): add explicit position column with backfill migration
...
Chunk ids stop reflecting document order once incremental re-indexing keeps
unchanged rows across edits. Backfill preserves the historical id ordering
so behavior is identical on day one.
2026-06-12 18:52:45 +02:00
CREDO23
f541114544
feat(index-cache): add cached embedding set table and repository
2026-06-12 16:48:01 +02:00
CREDO23
9f29a885b1
feat(db): register CachedParse model
2026-06-12 11:23:50 +02:00
Anish Sarkar
908790e40f
Merge remote-tracking branch 'upstream/dev' into feat/unified-model-connections
2026-06-12 03:15:28 +05:30
CREDO23
41f4a58663
Merge remote-tracking branch 'upstream/dev' into improvement-podcast-graph
...
# Conflicts:
# surfsense_backend/app/tasks/celery_tasks/podcast_tasks.py
2026-06-11 23:14:49 +02:00
Anish Sarkar
5d5d574550
refactor(model-connections): move backend model connections to provider capabilities
2026-06-12 02:17:22 +05:30
Anish Sarkar
c6a25cc1fe
refactor(model-connections): streamline global model config persistence
2026-06-11 18:20:53 +05:30
DESKTOP-RTLN3BA\$punk
a7407502d3
feat(refactor): refactor payment system to implement unified credit wallet.
...
- Updated environment variables and - configurations for credit purchases via Stripe, replacing legacy page pack system.
- Introduced auto-reload feature for credit top-ups and modified database models to track credit transactions.
- Updated notification system to handle insufficient credits and auto-reload failures.
- Adjusted API routes and schemas to reflect changes in credit management.
2026-06-10 16:49:03 -07:00
CREDO23
89ceae8bab
refactor(podcasts): re-export podcast model from module
2026-06-10 18:44:12 +02:00
Anish Sarkar
adb857925b
feat(models): add model connection persistence
2026-06-10 21:47:23 +05:30
DESKTOP-RTLN3BA\$punk
ce952d2ad1
chore: linting
2026-06-09 00:42:26 -07:00
CREDO23
8bdfd00a15
Merge upstream/dev
2026-06-05 19:18:12 +02:00
Anish Sarkar
e4d7b01b09
refactor(backend): Update references from document summary LLM to agent LLM across multiple files
2026-06-04 01:50:44 +05:30
Anish Sarkar
290a9539ef
feat(db): Remove document summary LLM schema
2026-06-04 00:48:53 +05:30
CREDO23
e5236d33a9
refactor: move Notification model into notifications module
2026-06-03 18:04:47 +02:00
CREDO23
5e5f51b3a0
feat(db): register DocumentFile and document.files relationship
2026-06-02 16:10:44 +02:00
Anish Sarkar
e3de7c4667
Merge remote-tracking branch 'upstream/dev' into feat/whatsapp-gateway-integration
2026-06-02 00:29:32 +05:30
Anish Sarkar
4b8ca29f9e
feat(gateway): add Discord external chat platform
2026-06-01 20:58:17 +05:30
Anish Sarkar
b0b0f3517b
feat(gateway): add Slack external chat platform
2026-06-01 12:35:52 +05:30
DESKTOP-RTLN3BA\$punk
40ca9e6ed2
refactor: remove search_surfsense_docs tool and related references
...
- Deleted the `search_surfsense_docs` tool and its associated files, streamlining the agent's toolset.
- Updated various components and prompts to remove references to the now-removed tool, ensuring consistency across the codebase.
- Adjusted documentation to direct users to the SurfSense documentation link for product-related queries instead.
2026-05-28 22:35:14 -07:00
DESKTOP-RTLN3BA\$punk
94e834134f
chore: linting
2026-05-28 19:21:29 -07:00
Anish Sarkar
3faaa25af6
refactor(database): update default source values to 'surfsense' for chat threads and messages
2026-05-28 13:11:05 +05:30
Anish Sarkar
a57b741d5e
refactor(gateway): rename persistence models to external chat
2026-05-28 04:37:27 +05:30
Anish Sarkar
81cf63ac96
feat(gateway): add messaging gateway persistence schema
2026-05-27 23:34:46 +05:30
CREDO23
1366c8a711
feat(rbac): add automations permission family
2026-05-27 15:30:34 +02:00
CREDO23
7f4c1c25ab
feat(automation): wire SQLAlchemy relationships on both sides
2026-05-27 13:45:32 +02:00
DESKTOP-RTLN3BA\$punk
19b6e0a025
feat: moved chat persistance to Server Side
2026-05-04 03:06:15 -07:00
DESKTOP-RTLN3BA\$punk
ae9d36d77f
feat: unified credits and its cost calculations
2026-05-02 14:34:23 -07:00
Anish Sarkar
421a4d7d08
refactor(auto_model_pin): simplify thread-level pinning by removing unused fields and indexes
2026-05-01 19:32:42 +05:30
Anish Sarkar
ba2a08b295
Merge remote-tracking branch 'upstream/dev' into feat/split-auto-free-premium
2026-04-30 15:45:11 +05:30
DESKTOP-RTLN3BA\$punk
c110f5b955
feat: improved agent streaming
2026-04-29 07:20:31 -07:00
Anish Sarkar
57db198919
feat(chat): add thread-level auto model pinning fields
2026-04-29 19:14:56 +05:30
DESKTOP-RTLN3BA\$punk
b9a66cb417
feat: various UI fixes, prompt optimizations, and allowing duplicate docs
...
- Updated `content_hash` in the `Document` model to remove global uniqueness, allowing identical content across different paths.
- Enhanced `_create_document` function to handle path uniqueness and prevent session-poisoning from `IntegrityError`.
- Added detailed comments for clarity on the changes and their implications.
- Introduced new citation handling in the editor for improved user experience with citation jumps.
- Updated package dependencies in the frontend for better functionality.
2026-04-28 21:30:53 -07:00
DESKTOP-RTLN3BA\$punk
31a372bb84
feat: updated agent harness
2026-04-28 09:22:19 -07:00
Anish Sarkar
54ce2666f5
feat: implement cross-device deduplication for Obsidian connectors using vault fingerprinting and enhance connector management
2026-04-21 04:21:33 +05:30
Anish Sarkar
2d90ed0fec
feat: deactivate legacy Obsidian connectors and implement partial unique index for improved upsert handling
2026-04-21 03:18:44 +05:30
Rohan Verma
2b2453e015
Merge pull request #1240 from AnishSarkar22/feat/resume-builder
...
Build and Push Docker Images / tag_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
feat: resume builder
2026-04-17 13:41:32 -07:00
DESKTOP-RTLN3BA\$punk
ff4e0f9b62
feat: no login experience and prem tokens
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
Anish Sarkar
586199ae17
feat: add content_type column to reports and seed default prompt for resume generation
2026-04-15 20:40:40 +05:30
Anish Sarkar
8fd7664f8f
Merge remote-tracking branch 'upstream/dev' into feat/token-calculation
2026-04-14 15:49:39 +05:30
DESKTOP-RTLN3BA\$punk
4bee367d4a
feat: added ai file sorting
2026-04-14 01:43:30 -07:00
Anish Sarkar
917f35eb33
feat: add token_usage table and relationships for tracking LLM token consumption
2026-04-14 13:26:53 +05:30
CREDO23
c30cc08771
Merge upstream/dev into feat/kb-export-and-folder-upload
2026-04-11 10:28:40 +02:00
