Blog, Articles, and discussions

Arabic Leaderboards: Introducing Arabic Instruction Following, Updating AraGen, and More

Community Articles

Fixing Open LLM Leaderboard with Math-Verify

By February 14, 2025 • 28

The Open Arabic LLM Leaderboard 2

By February 10, 2025 guest • 31

CO₂ Emissions and Models Performance: Insights from the Open LLM Leaderboard

By January 9, 2025 • 21

Evaluating Audio Reasoning with Big Bench Audio

By December 20, 2024 guest • 21

Rethinking LLM Evaluation with 3C3H: AraGen Benchmark and Leaderboard

Letting Large Models Debate: The First Multilingual LLM Debate Competition

By November 20, 2024 guest • 30

Introduction to the Open Leaderboard for Japanese LLMs

By November 20, 2024 guest • 35

Judge Arena: Benchmarking LLMs as Evaluators

By November 19, 2024 guest • 56

Introducing the Open FinLLM Leaderboard

🇨🇿 BenCzechMark - Can your LLM Understand Czech?

By October 1, 2024 • 20

How NuminaMath Won the 1st AIMO Progress Prize

By July 11, 2024 • 119

Our Transformers Code Agent beats the GAIA benchmark!

By July 1, 2024 • 79

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

By June 18, 2024 guest • 46

Launching the Artificial Analysis Text to Image Leaderboard & Arena

By June 6, 2024 guest • 13

Blog, Articles, and discussions

Arabic Leaderboards: Introducing Arabic Instruction Following, Updating AraGen, and More

🦸🏻#14: What Is MCP, and Why Is Everyone – Suddenly!– Talking About It?

Comparing sub 50GB Llama 4 Scout quants (KLD/Top P)

How to Use FastAPI MCP Server: A Complete Guide

Reasoning Datasets Competition

Model2Vec: Distill a Small Fast Model from any Sentence Transformer

Are AI Agents Sustainable? It depends

What is Open-source AI Robotics?

What is test-time compute and how to scale it?

DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge

Prefill and Decode for Concurrent Requests - Optimizing LLM Performance

The Large Language Model Course

Fine-Tuning Your First Large Language Model (LLM) with PyTorch and Hugging Face

Optimise AI Models and Make Them Faster, Smaller, Cheaper, Greener

Code a simple RAG from scratch

Manus AI: The Best Autonomous AI Agent Redefining Automation and Productivity

Consent by Design: Approaches to User Data in Open AI Ecosystems

Open-Source Handwritten Signature Detection Model

ChatGPT-4o's Image Generation Capabilities and Its Wild Examples

What is The Agent2Agent Protocol (A2A) and Why You Must Learn It Now

Try These Free, Unlimited AI API Keys for Cursor / Cline