oobabooga
/

phi-4-exl3

Model card Files Files and versions Community

EXL3 quants of microsoft/phi-4

Bits per Weight	Model Size	Link
2.0 bpw	4.83 GB	oobabooga/phi-4-exl3:2.0bpw
2.25 bpw	5.26 GB	oobabooga/phi-4-exl3:2.25bpw
2.5 bpw	5.68 GB	oobabooga/phi-4-exl3:2.5bpw
3.0 bpw	6.53 GB	oobabooga/phi-4-exl3:3.0bpw
3.5 bpw	7.39 GB	oobabooga/phi-4-exl3:3.5bpw
4.0 bpw	8.24 GB	oobabooga/phi-4-exl3:4.0bpw
5.0 bpw	9.94 GB	oobabooga/phi-4-exl3:5.0bpw
6.0 bpw	11.65 GB	oobabooga/phi-4-exl3:6.0bpw
8.0 bpw	15.05 GB	oobabooga/phi-4-exl3:8.0bpw

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support