DESKTOP-RTLN3BA\$punk
89cc3b37ee
fix(db): prevent boot-time index DDL from hanging FastAPI startup
...
A single abandoned "idle in transaction" session held locks on the
documents table, which blocked the non-concurrent CREATE INDEX (hnsw)
run inside the FastAPI lifespan. Each API restart queued another
CREATE INDEX behind an advisory lock, leaving the server stuck at
"Waiting for application startup." indefinitely and freezing ingestion
writes.
Changes:
- setup_indexes(): build every index with CREATE INDEX CONCURRENTLY
(non-blocking ShareUpdateExclusiveLock) under a per-session
lock_timeout, and make each statement non-fatal so a contended/slow
build is retried next boot instead of wedging startup. Drop leftover
invalid indexes before rebuilding.
- create_db_and_tables(): apply lock_timeout to extension/create_all
DDL and gate the whole bootstrap behind DB_BOOTSTRAP_ON_STARTUP.
- engine: set idle_in_transaction_session_timeout (asyncpg) so an
abandoned transaction is reaped automatically.
- config + .env.example: DB_BOOTSTRAP_ON_STARTUP, DB_DDL_LOCK_TIMEOUT_MS,
DB_IDLE_IN_TX_TIMEOUT_MS.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-16 16:18:49 -07:00
CREDO23
41f4a58663
Merge remote-tracking branch 'upstream/dev' into improvement-podcast-graph
...
# Conflicts:
# surfsense_backend/app/tasks/celery_tasks/podcast_tasks.py
2026-06-11 23:14:49 +02:00
DESKTOP-RTLN3BA\$punk
a7407502d3
feat(refactor): refactor payment system to implement unified credit wallet.
...
- Updated environment variables and - configurations for credit purchases via Stripe, replacing legacy page pack system.
- Introduced auto-reload feature for credit top-ups and modified database models to track credit transactions.
- Updated notification system to handle insufficient credits and auto-reload failures.
- Adjusted API routes and schemas to reflect changes in credit management.
2026-06-10 16:49:03 -07:00
CREDO23
89ceae8bab
refactor(podcasts): re-export podcast model from module
2026-06-10 18:44:12 +02:00
DESKTOP-RTLN3BA\$punk
ce952d2ad1
chore: linting
2026-06-09 00:42:26 -07:00
CREDO23
8bdfd00a15
Merge upstream/dev
2026-06-05 19:18:12 +02:00
Anish Sarkar
e4d7b01b09
refactor(backend): Update references from document summary LLM to agent LLM across multiple files
2026-06-04 01:50:44 +05:30
Anish Sarkar
290a9539ef
feat(db): Remove document summary LLM schema
2026-06-04 00:48:53 +05:30
CREDO23
e5236d33a9
refactor: move Notification model into notifications module
2026-06-03 18:04:47 +02:00
CREDO23
5e5f51b3a0
feat(db): register DocumentFile and document.files relationship
2026-06-02 16:10:44 +02:00
Anish Sarkar
e3de7c4667
Merge remote-tracking branch 'upstream/dev' into feat/whatsapp-gateway-integration
2026-06-02 00:29:32 +05:30
Anish Sarkar
4b8ca29f9e
feat(gateway): add Discord external chat platform
2026-06-01 20:58:17 +05:30
Anish Sarkar
b0b0f3517b
feat(gateway): add Slack external chat platform
2026-06-01 12:35:52 +05:30
DESKTOP-RTLN3BA\$punk
40ca9e6ed2
refactor: remove search_surfsense_docs tool and related references
...
- Deleted the `search_surfsense_docs` tool and its associated files, streamlining the agent's toolset.
- Updated various components and prompts to remove references to the now-removed tool, ensuring consistency across the codebase.
- Adjusted documentation to direct users to the SurfSense documentation link for product-related queries instead.
2026-05-28 22:35:14 -07:00
DESKTOP-RTLN3BA\$punk
94e834134f
chore: linting
2026-05-28 19:21:29 -07:00
Anish Sarkar
3faaa25af6
refactor(database): update default source values to 'surfsense' for chat threads and messages
2026-05-28 13:11:05 +05:30
Anish Sarkar
a57b741d5e
refactor(gateway): rename persistence models to external chat
2026-05-28 04:37:27 +05:30
Anish Sarkar
81cf63ac96
feat(gateway): add messaging gateway persistence schema
2026-05-27 23:34:46 +05:30
CREDO23
1366c8a711
feat(rbac): add automations permission family
2026-05-27 15:30:34 +02:00
CREDO23
7f4c1c25ab
feat(automation): wire SQLAlchemy relationships on both sides
2026-05-27 13:45:32 +02:00
DESKTOP-RTLN3BA\$punk
19b6e0a025
feat: moved chat persistance to Server Side
2026-05-04 03:06:15 -07:00
DESKTOP-RTLN3BA\$punk
ae9d36d77f
feat: unified credits and its cost calculations
2026-05-02 14:34:23 -07:00
Anish Sarkar
421a4d7d08
refactor(auto_model_pin): simplify thread-level pinning by removing unused fields and indexes
2026-05-01 19:32:42 +05:30
Anish Sarkar
ba2a08b295
Merge remote-tracking branch 'upstream/dev' into feat/split-auto-free-premium
2026-04-30 15:45:11 +05:30
DESKTOP-RTLN3BA\$punk
c110f5b955
feat: improved agent streaming
2026-04-29 07:20:31 -07:00
Anish Sarkar
57db198919
feat(chat): add thread-level auto model pinning fields
2026-04-29 19:14:56 +05:30
DESKTOP-RTLN3BA\$punk
b9a66cb417
feat: various UI fixes, prompt optimizations, and allowing duplicate docs
...
- Updated `content_hash` in the `Document` model to remove global uniqueness, allowing identical content across different paths.
- Enhanced `_create_document` function to handle path uniqueness and prevent session-poisoning from `IntegrityError`.
- Added detailed comments for clarity on the changes and their implications.
- Introduced new citation handling in the editor for improved user experience with citation jumps.
- Updated package dependencies in the frontend for better functionality.
2026-04-28 21:30:53 -07:00
DESKTOP-RTLN3BA\$punk
31a372bb84
feat: updated agent harness
2026-04-28 09:22:19 -07:00
Anish Sarkar
54ce2666f5
feat: implement cross-device deduplication for Obsidian connectors using vault fingerprinting and enhance connector management
2026-04-21 04:21:33 +05:30
Anish Sarkar
2d90ed0fec
feat: deactivate legacy Obsidian connectors and implement partial unique index for improved upsert handling
2026-04-21 03:18:44 +05:30
Rohan Verma
2b2453e015
Merge pull request #1240 from AnishSarkar22/feat/resume-builder
...
Build and Push Docker Images / tag_release (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Has been cancelled
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Has been cancelled
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Has been cancelled
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Has been cancelled
feat: resume builder
2026-04-17 13:41:32 -07:00
DESKTOP-RTLN3BA\$punk
ff4e0f9b62
feat: no login experience and prem tokens
Build and Push Docker Images / tag_release (push) Waiting to run
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_backend, ./surfsense_backend/Dockerfile, backend, surfsense-backend, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-24.04-arm, linux/arm64, arm64) (push) Blocked by required conditions
Build and Push Docker Images / build (./surfsense_web, ./surfsense_web/Dockerfile, web, surfsense-web, ubuntu-latest, linux/amd64, amd64) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (backend, surfsense-backend) (push) Blocked by required conditions
Build and Push Docker Images / create_manifest (web, surfsense-web) (push) Blocked by required conditions
2026-04-15 17:02:00 -07:00
Anish Sarkar
586199ae17
feat: add content_type column to reports and seed default prompt for resume generation
2026-04-15 20:40:40 +05:30
Anish Sarkar
8fd7664f8f
Merge remote-tracking branch 'upstream/dev' into feat/token-calculation
2026-04-14 15:49:39 +05:30
DESKTOP-RTLN3BA\$punk
4bee367d4a
feat: added ai file sorting
2026-04-14 01:43:30 -07:00
Anish Sarkar
917f35eb33
feat: add token_usage table and relationships for tracking LLM token consumption
2026-04-14 13:26:53 +05:30
CREDO23
c30cc08771
Merge upstream/dev into feat/kb-export-and-folder-upload
2026-04-11 10:28:40 +02:00
CREDO23
a95bf58c8f
Make Vision LLM opt-in for uploads and connectors
2026-04-10 16:45:51 +02:00
Anish Sarkar
b8091114b5
feat: drop legacy memory tables and update memory management tools to streamline user and shared memory handling
2026-04-09 18:05:30 +05:30
Anish Sarkar
ab3cb0e1c5
Merge remote-tracking branch 'upstream/dev' into refactor/persistent-memory
2026-04-09 15:33:23 +05:30
Anish Sarkar
ba7e288879
feat: add memory_md columns to user and searchspaces tables
2026-04-08 23:21:24 +05:30
Anish Sarkar
cd71893985
fix: update relationship backref to enable passive deletes for document versions
2026-04-08 14:48:40 +05:30
Anish Sarkar
8455451ce1
chore: ran linting
2026-04-08 05:20:03 +05:30
CREDO23
879945eeae
Add VisionProvider enum, VisionLLMConfig table, and vision RBAC permissions
2026-04-07 18:49:04 +02:00
CREDO23
d7315e7f27
Merge upstream/dev into feat/vision-autocomplete
2026-04-04 09:15:13 +02:00
CREDO23
482238e5d4
add vision LLM role for screenshot analysis
2026-04-03 17:40:27 +02:00
Anish Sarkar
25358fddcf
feat: implement local folder synchronization and versioning with new metadata handling and document_versions table
2026-04-02 23:46:21 +05:30
Anish Sarkar
22ee5c99cc
refactor: remove Local Folder connector and related tasks, implement new folder indexing endpoints
2026-04-02 22:21:31 +05:30
Anish Sarkar
3b92e99d28
feat: add local folder connector and document versioning functionality
2026-04-02 10:35:32 +05:30
DESKTOP-RTLN3BA\$punk
a9fd45844d
feat: integrate Stripe for page purchases and reconciliation tasks
2026-03-31 18:39:45 -07:00
