GitHub

[Bug] RTX 5090: RMSNorm failed with error code no kernel image is available for execution on the device

[2025-06-16 16:07:27] server_args=ServerArgs(model_path='RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic', tokenizer_path='RedHatAI/Mistral-Small-24B-Instruct ...
GitHub

Project report error on v21 with 5.0.3

Server: Apache/2.4.63 (Debian) mod_fcgid/2.3.9 OpenSSL/1.1.1w OS: Linux srv06.ms-hosting.local 6.1.0-27-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.115-1 (2024-11-01) x86_64 User-Agent: Mozilla/5.0 ...