SurfSense/surfsense_backend/app/tasks/chat
DESKTOP-RTLN3BA\$punk f4b2ab0899 feat: enhance caching mechanisms to prevent memory leaks
- Improved in-memory rate limiting by evicting timestamps outside the current window and cleaning up empty keys.
- Updated LLM router service to cache context profiles and avoid redundant computations.
- Introduced cache eviction logic for MCP tools and sandbox instances to manage memory usage effectively.
- Added garbage collection triggers in chat streaming functions to reclaim resources promptly.
2026-02-27 17:56:00 -08:00
..
stream_new_chat.py feat: enhance caching mechanisms to prevent memory leaks 2026-02-27 17:56:00 -08:00