File size: 1,179 Bytes
007e930 70dbe38 836dff5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: mit
---
EXL3 quants of [microsoft/phi-4](https://huggingface.co/microsoft/phi-4)
| Bits per Weight | Model Size | Link |
|-----------------|------------|------|
| 2.0 bpw | 4.83 GB | [oobabooga/phi-4-exl3:2.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/2.0bpw) |
| 2.25 bpw | 5.26 GB | [oobabooga/phi-4-exl3:2.25bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/2.25bpw) |
| 2.5 bpw | 5.68 GB | [oobabooga/phi-4-exl3:2.5bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/2.5bpw) |
| 3.0 bpw | 6.53 GB | [oobabooga/phi-4-exl3:3.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/3.0bpw) |
| 3.5 bpw | 7.39 GB | [oobabooga/phi-4-exl3:3.5bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/3.5bpw) |
| 4.0 bpw | 8.24 GB | [oobabooga/phi-4-exl3:4.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/4.0bpw) |
| 5.0 bpw | 9.94 GB | [oobabooga/phi-4-exl3:5.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/5.0bpw) |
| 6.0 bpw | 11.65 GB | [oobabooga/phi-4-exl3:6.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/6.0bpw) |
| 8.0 bpw | 15.05 GB | [oobabooga/phi-4-exl3:8.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/8.0bpw) |
|