diff --git a/README.md b/README.md index 8c5109c..137c1ba 100644 --- a/README.md +++ b/README.md @@ -46,11 +46,25 @@ run-pipeline.sh → Run finetune → merge/convert → run in sequenc | Choice | Backend | Requirements | |---|---|---| -| 1 | CUDA (NVIDIA) | NVIDIA drivers, CUDA toolkit | -| 2 | ROCm (AMD) | AMD drivers, HIP toolkit | -| 3 | Vulkan | Vulkan drivers | +| 1 | CUDA (NVIDIA) | Systemwide CUDA installation (NVIDIA drivers + CUDA toolkit) | +| 2 | ROCm (AMD) | Systemwide ROCm installation (AMD drivers + ROCm toolkit) | +| 3 | Vulkan | Vulkan drivers + `libvulkan-dev`, `glslc`, `spirv-headers` | | 4 | CPU only | None | +**Vulkan dependencies (Ubuntu/Debian):** + +```bash +sudo apt-get install libvulkan-dev glslc spirv-headers +``` + +Verify Vulkan is correctly installed: + +```bash +vulkaninfo +``` + +Should run without errors. + ## Scripts ### 1. scripts/generate-data.sh @@ -140,9 +154,9 @@ See the official build guide: https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md Common issues: -- **CUDA**: Ensure NVIDIA drivers and CUDA toolkit are installed -- **ROCm**: Ensure AMD drivers and HIP toolkit are installed -- **Vulkan**: Ensure Vulkan drivers and SDK are installed +- **CUDA**: Requires a systemwide CUDA installation (NVIDIA drivers + CUDA toolkit) +- **ROCm**: Requires a systemwide ROCm installation (AMD drivers + ROCm toolkit) +- **Vulkan**: Requires Vulkan drivers + `libvulkan-dev`, `glslc`, `spirv-headers` - **cmake**: Install via `sudo apt install cmake` (Debian/Ubuntu) ### Out of memory during training diff --git a/setup.sh b/setup.sh index 499657f..b4222db 100755 --- a/setup.sh +++ b/setup.sh @@ -83,6 +83,13 @@ esac eval "CMAKE_ARGS=\"$CMAKE_ARGS\" pip install llama-cpp-python" +# Create convertgguf_venv for llama.cpp Python tools +echo "" +echo "Creating convertgguf_venv..." +python -m venv llama.cpp/convertgguf_venv +source llama.cpp/convertgguf_venv/bin/activate +pip install -r llama.cpp/requirements.txt + echo "" echo "Setup complete! Configure the scripts and run:" echo " bash run-pipeline.sh"