apunkt/plano
1
0
Fork 0
mirror of https://github.com/katanemo/plano.git synced 2026-07-14 16:22:12 +02:00
Code Issues Projects Releases Packages Wiki Activity

update ctx size to 4k

Browse source
This commit is contained in:
Adil Hafeez 2024-09-29 17:13:05 -07:00
parent ea86f73605
commit 4d7c07a63c
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
demos/function_calling/Arch-Function-Calling-1.5B-Q4_K_M.model_file
View file

@ -1,6 +1,7 @@
FROM Arch-Function-Calling-1.5B-Q4_K_M.gguf FROM Arch-Function-Calling-1.5B-Q4_K_M.gguf
# Set parameters for response generation # Set parameters for response generation
PARAMETER num_ctx 4096
PARAMETER num_predict 1024 PARAMETER num_predict 1024
PARAMETER temperature 0.001 PARAMETER temperature 0.001
PARAMETER top_p 1.0 PARAMETER top_p 1.0