Commit da56a0d
committed
Fix CI: Install CUDA toolkit for flashinfer JIT compilation
vLLM 0.13.0 uses flashinfer as its default attention backend, which
requires nvcc for JIT compilation of CUDA kernels at runtime. The CI
runner has GPU runtime libraries but not the CUDA development toolkit,
causing the error:
RuntimeError: Could not find nvcc and default cuda_home='/usr/local/cuda' doesn't exist
This adds cuda-toolkit-12-8 installation and sets CUDA_HOME environment
variable before installing torchforge.
Note: Temporarily added branch trigger to test this fix - remove after merging.1 parent 1ad7e7c commit da56a0d
1 file changed
+7
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
| 5 | + | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
36 | 42 | | |
37 | 43 | | |
38 | 44 | | |
| |||
0 commit comments