Muhammad Farrukh Mehmood

sfarrukhm's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted 2 articles 5 months ago

view article

Article

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

By and 1 other •

Aug 17, 2022

• 104

view article

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

By and 4 others •

May 24, 2023

• 162

upvoted 2 papers 7 months ago

Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate

Paper • 2501.17703 • Published Jan 29 • 59

Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models

Paper • 2501.12370 • Published Jan 21 • 11

upvoted 3 articles 7 months ago

view article

Article

Open-R1: a fully open reproduction of DeepSeek-R1

By and 2 others •

Jan 28

• 878

view article

Article

Fine-tune ModernBERT for RAG with Synthetic Data

By and 2 others •

Jan 20

• 41

view article

Article

Preference Tuning LLMs with Direct Preference Optimization Methods

By and 4 others •

Jan 18, 2024

• 70

upvoted a collection 7 months ago

Preference Datasets for DPO

Collection

This collection contains a list of curated preference datasets for DPO fine-tuning for intent alignment of LLMs • 7 items • Updated Dec 11, 2024 • 43

upvoted a paper 7 months ago

Evolving Deeper LLM Thinking

Paper • 2501.09891 • Published Jan 17 • 116

upvoted 2 articles 7 months ago

view article

Article

The Large Language Model Course

By •

Jan 16

• 199

view article

Article

Train 400x faster Static Embedding Models with Sentence Transformers

By •

Jan 15

• 205