Skip to content

Instantly share code, notes, and snippets.

@ashmalvayani

ashmalvayani/gist:6af865617a278fe1cfd35da94784ab03

Last active March 25, 2024 00:17
Show Gist options
  • Save ashmalvayani/6af865617a278fe1cfd35da94784ab03 to your computer and use it in GitHub Desktop.
Save ashmalvayani/6af865617a278fe1cfd35da94784ab03 to your computer and use it in GitHub Desktop.
Download ZIP
ImportError: libcudart.so.12: cannot open shared object file: No such file or directory
Raw
gistfile1.txt
PROBLEM:
import flash_attn_2_cuda as flash_attn_cuda
ImportError: libcudart.so.12: cannot open shared object file: No such file or directory
Currently flash_attn version: flash_attn-2.5.6
-------
Solution:
Downgrade the flash_attn version
export CUDA_HOME=/usr/local/cuda-11.7
pip install flash_attn==2.2.3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment