apunkt/MetaGPT
1
0
Fork 0
mirror of https://github.com/FoundationAgents/MetaGPT.git synced 2026-05-01 03:46:23 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge branch 'truncate_msg' into 'mgx_ops'

Browse source 
长文本退化策略：几种简单截断

See merge request pub/MetaGPT!268
This commit is contained in:
王金淋 2024-08-02 17:54:40 +00:00
commit f6be0014b7
7 changed files with 257 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
metagpt/utils/token_counter.py
View file

@ -215,6 +215,7 @@ TOKEN_MAX = {
"deepseek/deepseek-chat": 128000, # end, for openrouter
"deepseek-chat": 128000,
"deepseek-coder": 128000,
"deepseek-ai/DeepSeek-Coder-V2-Instruct": 32000, # siliconflow
}
@ -319,4 +320,4 @@ def get_max_completion_tokens(messages: list[dict], model: str, default: int) ->
"""
if model not in TOKEN_MAX:
return default
return TOKEN_MAX[model] - count_message_tokens(messages) - 1
return TOKEN_MAX[model] - count_message_tokens(messages, model) - 1