CarbonVillain

This is a model created without learning to oppose indiscriminate carbon emissions.

This model is an experimental version created using mergekit.

Ranked 1st 2023.12.30

thanks to KyujinHan, Yağız Çalık and VAGO solutions

Prompt Template(s)

### User:
{user}

### Assistant:
{asistant}

Detailed results can be found here

Safetensors

Model size

10.7B params

Tensor type

FP16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Merges

Quantizations

normalized accuracy on AI2 Reasoning Challenge (25-Shot)
test set Open LLM Leaderboard

71.250
normalized accuracy on HellaSwag (10-Shot)
validation set Open LLM Leaderboard

88.480
accuracy on MMLU (5-Shot)
test set Open LLM Leaderboard

66.270
mc2 on TruthfulQA (0-shot)
validation set Open LLM Leaderboard

71.950
accuracy on Winogrande (5-shot)
validation set Open LLM Leaderboard

83.580
accuracy on GSM8k (5-shot)
test set Open LLM Leaderboard

65.580