Haihao Shen

Haihao's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Intel/Qwen3-Coder-30B-A3B-Instruct-gguf-q2ks-mixed-AutoRound 18 days ago

Can't wait to see the benchmark

🤝 1

16

#1 opened 19 days ago by

PussyHut

New activity in Intel/Qwen3-Coder-30B-A3B-Instruct-gguf-q4km-AutoRound 19 days ago

Scored 68.57 on MMLU Pro single shot using llama.cpp

🚀 1

3

#2 opened 19 days ago by

xbruce22

Scored 64.29 4bit on MMLU Pro single shot using ollama

4

#1 opened 19 days ago by

xbruce22

New activity in Intel/Qwen3-Coder-30B-A3B-Instruct-gguf-q2ks-mixed-AutoRound 19 days ago

Scored 65.00 on MMLU Pro single shot 🔥

😎 🔥 2

3

#2 opened 19 days ago by

xbruce22

New activity in Intel/Qwen3-30B-A3B-Instruct-2507-gguf-q2ks-mixed-AutoRound 24 days ago

this looks really good on llama.cpp

🚀 1

6

#1 opened 24 days ago by

gopi87

New activity in Qwen/Qwen3-30B-A3B-Instruct-2507 24 days ago

AWQ version

❤️ 5

6

#3 opened 25 days ago by

devops724

commented a paper 9 months ago

A dynamic parallel method for performance optimization on hybrid CPUs

Paper • 2411.19542 • Published Nov 29, 2024 • 5 •

2

New activity in Intel/neural-chat-7b-v3 9 months ago

Adding `safetensors` variant of this model

#9 opened 9 months ago by

SFconvertbot

New activity in Intel/neural-chat-7b-v3-3 10 months ago

Adding `safetensors` variant of this model

1

#14 opened 10 months ago by

SFconvertbot

commented 2 papers over 1 year ago

Efficient Post-training Quantization with FP8 Formats

Paper • 2309.14592 • Published Sep 26, 2023 • 11 •

2

Effective Quantization for Diffusion Models on CPUs

Paper • 2311.16133 • Published Nov 2, 2023 • 4 •

1

New activity in Intel/neural-chat-7b-v3-1 almost 2 years ago

Prompt Template?

👍 4

13

#1 opened almost 2 years ago by

fakezeta

commented a paper almost 2 years ago

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs

Paper • 2309.05516 • Published Sep 11, 2023 • 10 •

2