Alissonerdx
/

exllamav2-0.2.7-cu12.8.0.torch2.7.0-cp312-cp312-linux_x86_64

Model card Files Files and versions Community

Exllamav2 package compiled with:

CUDA: 12.8.0

TORCH: 2.7.0

TORCH_CUDA_ARCH_LIST="6.0 6.1 7.0 7.5 8.0 8.6 8.9 9.0+PTX Blackwell"

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support