apunkt/SurfSense
1
0
Fork 0
mirror of https://github.com/MODSetter/SurfSense.git synced 2026-04-27 01:36:30 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: implement token usage tracking for LLM calls with new accumulator and callback

Browse source
This commit is contained in:
Anish Sarkar 2026-04-14 13:40:32 +05:30
parent 917f35eb33
commit 3cfe53fb7f
6 changed files with 223 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

1
surfsense_backend/app/services/llm_router_service.py
View file

@ -970,6 +970,7 @@ class ChatLiteLLMRouter(BaseChatModel):
messages=formatted_messages,
stop=stop,
stream=True,
stream_options={"include_usage": True},
**call_kwargs,
)
except ContextWindowExceededError as e: