apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-06-17 15:25:17 +02:00
Code Issues Projects Releases Packages Wiki Activity

add e2e test

Browse source
This commit is contained in:
cotran 2024-11-05 08:42:57 -08:00
parent 0d9cbdebda
commit e74a3e1e38
5 changed files with 61 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

1
model_server/app/function_calling/model_utils.py
View file

@ -133,6 +133,7 @@ async def chat_completion(
if hasattr(token.choices[0].delta, "content"):
full_response += token.choices[0].delta.content
else:
logger.info("Stream is disabled, not engaging pre-filling")
full_response = resp.choices[0].message.content
tool_calls = const.arch_function_hanlder.extract_tool_calls(full_response)