Spaces:
Runtime error
Runtime error
metadata
title: Swahili Llm Leaderboard
emoji: 🔥
colorFrom: gray
colorTo: green
sdk: streamlit
sdk_version: 1.34.0
app_file: app.py
pinned: false
license: apache-2.0
🏆 Swahili LLM-Leaderboard
A joint community effort to create a Swahili central leaderboard for LLMs. These models are currently evaluated on the Open LLM Leaderboard. Contributions and corrections are welcome!
We refer to a model being "open" if it can be locally deployed and used commercially.
Interactive Dashboard
https://swahili-llm-leaderboard.streamlit.app/
Leaderboard
| Model Name | Publisher | Open? | Basemodel | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|---|---|---|---|
| Mollel/Swahili Gemma | Mollel | Yes | Gemma | 61.32 | 58.96 | 76.4 | 61.02 | 52.1 | 75.61 | 43.82 |
| Mollel/Swahili-Alpaca-Llama-3-8b_16bit | Mollel | Yes | Llama-3 | 60.97 | 57.25 | 78.03 | 63.97 | 50.13 | 76.87 | 39.58 |
| mwitiderrick/SwahiliInstruct-v0.1 | Derrick | Yes | Mistral | 58.92 | 57.59 | 80.92 | 57 | 58.08 | 74.66 | 25.25 |
| mwitiderrick/SwahiliInstruct-v0.2 | Derrick | Yes | Mistral | 54.25 | 55.2 | 78.22 | 50.3 | 57.08 | 73.24 | 11.45 |