jusjinuk/gemma-3-27b-it-2bit-GuidedQuant-LNQ
Updated
•
8
Instruction-tuned models (GuidedQuant)
-
-
jusjinuk/gemma-3-27b-it-3bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/gemma-3-27b-it-4bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Qwen3-32B-2bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Qwen3-32B-3bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Qwen3-32B-4bit-GuidedQuant-LNQ
Updated • 8 -
jusjinuk/Llama-3.3-70B-Instruct-2bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Llama-3.3-70B-Instruct-3bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Llama-3.3-70B-Instruct-4bit-GuidedQuant-LNQ
Updated • 8 -
jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-LNQ
Updated • 8 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-LNQ
Updated • 9 -
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-LNQ
Updated • 8 -
GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance
Paper • 2505.07004 • Published • 7 -
jusjinuk/gemma-3-27b-it-2bit-SqueezeLLM
Updated • 7 -
jusjinuk/gemma-3-27b-it-3bit-SqueezeLLM
Updated • 9 -
jusjinuk/gemma-3-27b-it-4bit-SqueezeLLM
Updated • 26 -
jusjinuk/Qwen3-32B-2bit-SqueezeLLM
Updated • 6 -
jusjinuk/Qwen3-32B-3bit-SqueezeLLM
Updated • 7 -
jusjinuk/Qwen3-32B-4bit-SqueezeLLM
Updated • 7 -
jusjinuk/Llama-3.3-70B-Instruct-2bit-SqueezeLLM
Updated • 5 -
jusjinuk/Llama-3.3-70B-Instruct-3bit-SqueezeLLM
Updated • 7 -
jusjinuk/Llama-3.3-70B-Instruct-4bit-SqueezeLLM
Updated • 7 -
jusjinuk/Llama-3.1-8B-Instruct-2bit-SqueezeLLM
Updated • 12 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-SqueezeLLM
Updated • 7 -
jusjinuk/Llama-3.1-8B-Instruct-4bit-SqueezeLLM
Updated • 11 -
jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-QTIP
2B • Updated • 9 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-QTIP
2B • Updated • 9 -
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-QTIP
3B • Updated • 9 -
jusjinuk/Llama-3.2-1B-Instruct-2bit-GuidedQuant-QTIP
0.4B • Updated • 9 -
jusjinuk/Llama-3.2-1B-Instruct-3bit-GuidedQuant-QTIP
0.4B • Updated • 9 -
jusjinuk/Llama-3.2-1B-Instruct-4bit-GuidedQuant-QTIP
0.5B • Updated • 9 -
jusjinuk/Llama-3.2-3B-Instruct-2bit-GuidedQuant-QTIP
0.7B • Updated • 9 -
jusjinuk/Llama-3.2-3B-Instruct-3bit-GuidedQuant-QTIP
0.9B • Updated • 9 -
jusjinuk/Llama-3.2-3B-Instruct-4bit-GuidedQuant-QTIP
1B • Updated • 10 -
jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP-skip_0_v
11B • Updated • 8 -
jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP-skip_0_v
Updated -
jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP-skip_0_v
19B • Updated • 9 -
jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP
11B • Updated • 10 -
jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP
15B • Updated • 9 -
jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP
19B • Updated • 10