apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-07-20 16:41:04 +02:00
Code Issues Projects Releases Packages Wiki Activity

fixbug

Browse source
This commit is contained in:
cotran 2024-12-11 14:22:34 -08:00
parent 991e336179
commit c5a79bdbf7
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
model_server/src/core/function_calling.py
View file

@ -469,7 +469,7 @@ class ArchFunctionHandler(ArchBaseHandler):
) )
return prefill_response return prefill_response
def _check_length_and_pop_messages(messages, max_tokens=4096): def _check_length_and_pop_messages(self, messages, max_tokens=4096):
""" """
Trims the `messages` list to ensure the total token count does not exceed `max_tokens`. Trims the `messages` list to ensure the total token count does not exceed `max_tokens`.