|
--- |
|
license: mit |
|
--- |
|
EXL3 quants of [microsoft/phi-4](https://huggingface.co/microsoft/phi-4) |
|
|
|
| Bits per Weight | Model Size | Link | |
|
|-----------------|------------|------| |
|
| 2.0 bpw | 4.83 GB | [oobabooga/phi-4-exl3:2.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/2.0bpw) | |
|
| 2.25 bpw | 5.26 GB | [oobabooga/phi-4-exl3:2.25bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/2.25bpw) | |
|
| 2.5 bpw | 5.68 GB | [oobabooga/phi-4-exl3:2.5bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/2.5bpw) | |
|
| 3.0 bpw | 6.53 GB | [oobabooga/phi-4-exl3:3.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/3.0bpw) | |
|
| 3.5 bpw | 7.39 GB | [oobabooga/phi-4-exl3:3.5bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/3.5bpw) | |
|
| 4.0 bpw | 8.24 GB | [oobabooga/phi-4-exl3:4.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/4.0bpw) | |
|
| 5.0 bpw | 9.94 GB | [oobabooga/phi-4-exl3:5.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/5.0bpw) | |
|
| 6.0 bpw | 11.65 GB | [oobabooga/phi-4-exl3:6.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/6.0bpw) | |
|
| 8.0 bpw | 15.05 GB | [oobabooga/phi-4-exl3:8.0bpw](https://huggingface.co/oobabooga/phi-4-exl3/tree/8.0bpw) | |
|
|
