xuan-luo
/

FlexiDepth-Llama-3-8B-Instruct

Text Generation

Model card Files Files and versions Community

xuan-luo commited on Apr 6

Commit

f5034ff

·

verified ·

1 Parent(s): ebeebc6

Update evals/3-winogrande.out

Files changed (1) hide show

evals/3-winogrande.out +4 -4

evals/3-winogrande.out CHANGED Viewed

@@ -1,4 +1,4 @@
-hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 8
-|  Tasks   |Version|Filter|n-shot|Metric|   |Value|   |Stderr|
-|----------|------:|------|-----:|------|---|----:|---|-----:|
-|winogrande|      1|none  |     5|acc   |↑  |0.749|±  |0.0122|

+hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 16
+|  Tasks   |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
+|----------|------:|------|-----:|------|---|-----:|---|-----:|
+|winogrande|      1|none  |     5|acc   |↑  |0.7556|±  |0.0121|