mirror of
https://github.com/MODSetter/SurfSense.git
synced 2026-07-22 23:31:12 +02:00
7f1476799c
Major RAM savings (1.5-3GB reduction at startup): - Implement lazy loading for embedding model, chunker, and reranker - Models now load on first use instead of at startup - Reduce embedding batch_size from 128 to 32 (saves 100-200MB spikes) Celery memory optimizations: - Reduce result_expires from 24h to 1h (saves Redis RAM) - Reduce worker_max_tasks_per_child from 1000 to 100 - Add worker_max_memory_per_child=256MB limit to prevent leaks Before: ~2-4GB RAM at startup After: ~500MB-1GB at startup, models load on demand |
||
|---|---|---|
| .. | ||
| alembic | ||
| app | ||
| scripts | ||
| .dockerignore | ||
| .env.example | ||
| .gitignore | ||
| .python-version | ||
| alembic.ini | ||
| celery_worker.py | ||
| Dockerfile | ||
| main.py | ||
| OLLAMA_MEMORY_OPTIMIZATION.md | ||
| pyproject.toml | ||
| uv.lock | ||