Edit Models filters

Model Tree

nvidia/Llama-3.1-Minitron-4B-Width-Base

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

17

Full-text search

Active filters: nvidia/Llama-3.1-Minitron-4B-Width-Base

NikolayKozloff/Llama-3.1-Minitron-4B-Width-Base-Q8_0-GGUF

5B • Updated Aug 16, 2024 • 6 • 8

bartowski/Llama-3.1-Minitron-4B-Width-Base-GGUF

Text Generation • 5B • Updated Aug 27, 2024 • 608

legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF

Text Generation • 5B • Updated Aug 17, 2024 • 577 • 13

mradermacher/Llama-3.1-Minitron-4B-Width-Base-GGUF

5B • Updated Feb 14 • 421

QuantFactory/magnum-v2-4b-GGUF

Text Generation • 5B • Updated Aug 25, 2024 • 362 • 1

Theta-Lev/Llama-3.1-Minitron-4B-Width-Base-Q8_0-GGUF

5B • Updated Aug 28, 2024 • 7

altomek/Llama-3.1-Minitron-4B-Width-Base-8bpw-EXL2

Updated Aug 30, 2024 • 1

altomek/Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_4-GGUF

5B • Updated Aug 30, 2024 • 5

ijohn07/Llama-3.1-Minitron-4B-Width-Base-Q5_K_M-GGUF

5B • Updated Sep 4, 2024 • 6

Solshine/Llama-3.1-Minitron-4B-Width-Base-Q4_K_M-GGUF

5B • Updated Sep 12, 2024 • 8 • 1

finnwengWCH/Llama-3.1-Minitron-4B-Width-Base-Q4_K_M-GGUF

5B • Updated Sep 14, 2024 • 1

Gint0ki/Llama-3.1-Minitron-4B-Width-Base-Q8_0-GGUF

5B • Updated Sep 15, 2024 • 7

QuantFactory/MagpieLM-4B-SFT-v0.1-GGUF

5B • Updated Sep 20, 2024 • 112 • 2

psx7/llama4B

Text Generation • 5B • Updated Oct 2, 2024 • 1.63k

PrunaAI/nvidia-Llama-3.1-Minitron-4B-Width-Base-GGUF-smashed

5B • Updated Feb 27 • 2

Mungert/Llama-3.1-Nemotron-Nano-4B-v1.1-GGUF

Text Generation • 5B • Updated Jun 15 • 630 • 1

greenwich157/Llama-3.1-Minitron-4B-Width-Base-Q4_0-GGUF

Text Generation • 5B • Updated Jun 12 • 7