From 33a1a68218018ef51e0e51617d8ffe965b611149 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Jos=C3=A9=20Ulises=20Ni=C3=B1o=20Rivera?= Date: Wed, 11 Sep 2024 11:37:53 -0700 Subject: [PATCH] Add small clarification to function calling demo (#48) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Signed-off-by: José Ulises Niño Rivera --- demos/function-calling/README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/demos/function-calling/README.md b/demos/function-calling/README.md index 4438ca3c..518240f3 100644 --- a/demos/function-calling/README.md +++ b/demos/function-calling/README.md @@ -12,6 +12,10 @@ This demo shows how you can use intelligent prompt gateway to do function callin docker compose up ``` 1. Download Bolt-FC model. This demo assumes we have downloaded [Bolt-Function-Calling-1B:Q4_K_M](https://huggingface.co/katanemolabs/Bolt-Function-Calling-1B.gguf/blob/main/Bolt-Function-Calling-1B-Q4_K_M.gguf) to local folder. +1. If running ollama natively run + ```sh + ollama serve + ``` 2. Create model file in ollama repository ```sh ollama create Bolt-Function-Calling-1B:Q4_K_M -f Bolt-FC-1B-Q4_K_M.model_file