Spaces:
Runtime error
Runtime error
| title: Swahili Llm Leaderboard | |
| emoji: 🔥 | |
| colorFrom: gray | |
| colorTo: green | |
| sdk: streamlit | |
| sdk_version: 1.34.0 | |
| app_file: app.py | |
| pinned: false | |
| license: apache-2.0 | |
| # 🏆 Swahili LLM-Leaderboard | |
| A joint community effort to create a Swahili central leaderboard for LLMs. These models are currently evaluated on the Open LLM Leaderboard. Contributions and corrections are welcome! <br> | |
| We refer to a model being "open" if it can be locally deployed and used commercially. | |
| ## Interactive Dashboard | |
| https://swahili-llm-leaderboard.streamlit.app/ <be> | |
| ## Leaderboard | |
| | Model Name | Publisher| Open? | Basemodel |Average| ARC | HellaSwag | MMLU | TruthfulQA|Winogrande|GSM8K | | |
| | ---------- | -------- | ----- | --------- |------ | ---- | -------------- | ------------ | --------- | -------- | -------------- | | |
| | [Mollel/Swahili Gemma](https://huggingface.co/Mollel/Swahili_Gemma)| Mollel| Yes|Gemma|61.32|58.96|76.4 |61.02| 52.1|75.61|43.82| | |
| | [Mollel/Swahili-Alpaca-Llama-3-8b_16bit](https://huggingface.co/Mollel/Swahili-Alpaca-Llama-3-8b_16bit)| Mollel| Yes|Llama-3|60.97|57.25|78.03|63.97| 50.13|76.87|39.58| | |
| | [mwitiderrick/SwahiliInstruct-v0.1](https://huggingface.co/mwitiderrick/SwahiliInstruct-v0.1)| Derrick| Yes|Mistral|58.92|57.59|80.92 |57| 58.08|74.66|25.25| | |
| | [mwitiderrick/SwahiliInstruct-v0.2](https://huggingface.co/mwitiderrick/SwahiliInstruct-v0.2)| Derrick| Yes|Mistral|54.25|55.2|78.22|50.3|57.08|73.24|11.45| |