2/3 bits OPEA/Llama-3.3-70B-Instruct-int2-sym-inc 9B • Updated Apr 30 • 23 OPEA/Llama-3.3-70B-Instruct-int3-sym-inc 10B • Updated Apr 30 • 15 OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 9B • Updated Jul 18 • 7 • 5 OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 8B • Updated Apr 30 • 6 • 1
Llama-AutoRound OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11B • Updated Apr 24 • 4 OPEA/Llama-3.3-70B-Instruct-int4-sym-inc 11B • Updated Apr 30 • 21.8k OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc 11B • Updated Apr 30 • 7 • 1 OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc 11B • Updated Apr 24 • 5 • 1
QWEN-AutoRound OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 2B • Updated Apr 30 • 6 • 1 OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 6B • Updated Apr 30 • 6 • 1 OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 0.7B • Updated Apr 30 • 3 OPEA/Qwen2.5-72B-Instruct-int4-sym-inc 12B • Updated Apr 30 • 7 • 1
DeepSeek OPEA/DeepSeek-V3-int4-sym-gptq-inc Updated Jul 11 • 1.13k • 17 OPEA/DeepSeek-V3-int4-sym-awq-inc Updated Apr 30 • 4 • 4 OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc 671B • Updated Feb 12 • 97 • 3 OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc 671B • Updated Mar 11 • 83 • 14
VLMs-AutoRound OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc 3B • Updated Jun 5 • 169 • 1 OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc 3B • Updated Jun 5 • 10 • 2 OPEA/SmolVLM-Instruct-int4-sym-inc 0.9B • Updated Jul 18 • 9 • 3 OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc 2B • Updated Jul 18 • 1.17k • 4
2/3 bits OPEA/Llama-3.3-70B-Instruct-int2-sym-inc 9B • Updated Apr 30 • 23 OPEA/Llama-3.3-70B-Instruct-int3-sym-inc 10B • Updated Apr 30 • 15 OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 9B • Updated Jul 18 • 7 • 5 OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 8B • Updated Apr 30 • 6 • 1
DeepSeek OPEA/DeepSeek-V3-int4-sym-gptq-inc Updated Jul 11 • 1.13k • 17 OPEA/DeepSeek-V3-int4-sym-awq-inc Updated Apr 30 • 4 • 4 OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc 671B • Updated Feb 12 • 97 • 3 OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc 671B • Updated Mar 11 • 83 • 14
Llama-AutoRound OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11B • Updated Apr 24 • 4 OPEA/Llama-3.3-70B-Instruct-int4-sym-inc 11B • Updated Apr 30 • 21.8k OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc 11B • Updated Apr 30 • 7 • 1 OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc 11B • Updated Apr 24 • 5 • 1
VLMs-AutoRound OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc 3B • Updated Jun 5 • 169 • 1 OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc 3B • Updated Jun 5 • 10 • 2 OPEA/SmolVLM-Instruct-int4-sym-inc 0.9B • Updated Jul 18 • 9 • 3 OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc 2B • Updated Jul 18 • 1.17k • 4
QWEN-AutoRound OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 2B • Updated Apr 30 • 6 • 1 OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 6B • Updated Apr 30 • 6 • 1 OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 0.7B • Updated Apr 30 • 3 OPEA/Qwen2.5-72B-Instruct-int4-sym-inc 12B • Updated Apr 30 • 7 • 1
