nvidia/Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
7.4k
•
22
Model Optimizer
A collection of generative models quantized and optimized with TensorRT Model Optimizer.
-
-
nvidia/Llama-3.1-405B-Instruct-FP8
Text Generation • Updated • 9.58k • 10 -
nvidia/Llama-3.1-70B-Instruct-FP8
Text Generation • Updated • 6.18k • 11 -
nvidia/Llama-3.1-8B-Medusa-FP8
Updated • 25 • 6 -
nvidia/Llama-3.3-70B-Instruct-FP4
Updated • 4.07k • 16 -
nvidia/Llama-3.1-405B-Instruct-FP4
Updated • 1.51k • 5 -
nvidia/DeepSeek-R1-FP4
Text Generation • Updated • 56.4k • 238