Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

19

Full-text search

Active filters: llm-compressor

brandonbeiler/Skywork-R1V3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated 4 days ago • 116 • 1

RedHatAI/Qwen2.5-0.5B-quantized.w8a16

Text Generation • 0.4B • Updated Nov 26, 2024 • 11

RedHatAI/Qwen2.5-1.5B-quantized.w8a16

Text Generation • 0.8B • Updated Nov 26, 2024 • 19

RedHatAI/Qwen2.5-3B-quantized.w8a16

Text Generation • 1B • Updated Nov 26, 2024 • 8

RedHatAI/Qwen2.5-7B-quantized.w8a16

Text Generation • 3B • Updated Nov 26, 2024 • 11 • 1

RedHatAI/Qwen2.5-32B-quantized.w8a16

Text Generation • 9B • Updated Nov 26, 2024 • 8

RedHatAI/Qwen2.5-72B-quantized.w8a16

Text Generation • 20B • Updated Nov 26, 2024 • 9

brokenlander/AlphaBuffett-FP8-Dynamic

Text Generation • 24B • Updated Feb 16

divish/M-Prometheus-3B-FP8-Dynamic

Text Generation • 3B • Updated Apr 16 • 3

textgeflecht/Devstral-Small-2505-FP8-llmcompressor

Text Generation • 24B • Updated May 25 • 22

ConfidentialMind/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated 15 days ago • 38 • 1

textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 12 • 43

brandonbeiler/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated 29 days ago • 580

brandonbeiler/InternVL3-78B-FP8-Dynamic

Image-Text-to-Text • 78B • Updated 29 days ago • 2.11k

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated 29 days ago • 26

JustJaro/SmolLM-135M-FP8-Static

Image-Text-to-Text • 0.2B • Updated 15 days ago • 4

JustJaro/SmolLM-135M-FP8-Dynamic-Test

Image-Text-to-Text • 0.1B • Updated 15 days ago • 4

JustJaro/GOT-OCR-2.0-hf-FP8-Static

Image-Text-to-Text • 0.6B • Updated 15 days ago • 10

ramblingpolymath/Qwen3-32B-W8A8

Text Generation • 33B • Updated 8 days ago • 202