Fix setup

README.md

@@ -46,11 +46,25 @@ run-pipeline.sh            → Run finetune → merge/convert → run in sequenc
 
 | Choice | Backend | Requirements |
 |---|---|---|
-| 1 | CUDA (NVIDIA) | NVIDIA drivers, CUDA toolkit |
-| 2 | ROCm (AMD) | AMD drivers, HIP toolkit |
-| 3 | Vulkan | Vulkan drivers |
+| 1 | CUDA (NVIDIA) | Systemwide CUDA installation (NVIDIA drivers + CUDA toolkit) |
+| 2 | ROCm (AMD) | Systemwide ROCm installation (AMD drivers + ROCm toolkit) |
+| 3 | Vulkan | Vulkan drivers + `libvulkan-dev`, `glslc`, `spirv-headers` |
 | 4 | CPU only | None |
 
+**Vulkan dependencies (Ubuntu/Debian):**
+
+```bash
+sudo apt-get install libvulkan-dev glslc spirv-headers
+```
+
+Verify Vulkan is correctly installed:
+
+```bash
+vulkaninfo
+```
+
+Should run without errors.
+
 ## Scripts
 
 ### 1. scripts/generate-data.sh
@@ -140,9 +154,9 @@ See the official build guide:
 https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md
 
 Common issues:
-- **CUDA**: Ensure NVIDIA drivers and CUDA toolkit are installed
-- **ROCm**: Ensure AMD drivers and HIP toolkit are installed
-- **Vulkan**: Ensure Vulkan drivers and SDK are installed
+- **CUDA**: Requires a systemwide CUDA installation (NVIDIA drivers + CUDA toolkit)
+- **ROCm**: Requires a systemwide ROCm installation (AMD drivers + ROCm toolkit)
+- **Vulkan**: Requires Vulkan drivers + `libvulkan-dev`, `glslc`, `spirv-headers`
 - **cmake**: Install via `sudo apt install cmake` (Debian/Ubuntu)
 
 ### Out of memory during training

setup.sh

@@ -83,6 +83,13 @@ esac
 
 eval "CMAKE_ARGS=\"$CMAKE_ARGS\" pip install llama-cpp-python"
 
+# Create convertgguf_venv for llama.cpp Python tools
+echo ""
+echo "Creating convertgguf_venv..."
+python -m venv llama.cpp/convertgguf_venv
+source llama.cpp/convertgguf_venv/bin/activate
+pip install -r llama.cpp/requirements.txt
+
 echo ""
 echo "Setup complete! Configure the scripts and run:"
 echo "  bash run-pipeline.sh"