Edit Models filters

Model Tree

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

2

Full-text search

Active filters: RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 11 • 1

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 11