apunkt/doc-to-lora
1
0
Fork 0
mirror of https://github.com/SakanaAI/doc-to-lora.git synced 2026-07-23 17:01:04 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

flashinfer install

Browse source
This commit is contained in:
51616 2025-06-19 23:07:38 +09:00
parent a345a4f0d0
commit d6069810fa
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
install.sh
View file

@ -20,6 +20,7 @@ uv pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --torch-backen
uv sync
uv pip install https://github.com/Dao-AILab/flash-attention/releases/download/v2.7.4.post1/flash_attn-2.7.4.post1+cu12torch2.6cxx11abiFALSE-cp310-cp310-linux_x86_64.whl
uv pip install flashinfer-python==0.2.2 -i https://flashinfer.ai/whl/cu124/torch2.6
# uv pip install flash-attn==2.6.3 --no-build-isolation
# needed for gated models