GitHub

[Usage]: ModuleNotFoundError: No module named 'vllm.vllm_flash_attn.layers' [email protected]

Trying to install vllm, got installed and then got this error. torch : 2.7.0+cu128 cuda : 12.8 python: 3.12.9 Linux-6.8.0-1013-nvidia-64k-aarch64-with-glibc2.35 Error ...