Update evals/2-hellaswag.out
Browse files- evals/2-hellaswag.out +3 -4
evals/2-hellaswag.out
CHANGED
@@ -1,6 +1,5 @@
|
|
1 |
-
|
2 |
-
hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 4
|
3 |
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
4 |
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|
5 |
-
|hellaswag| 1|none | 5|acc |↑ |0.
|
6 |
-
| | |none | 5|acc_norm|↑ |0.
|
|
|
1 |
+
hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 16
|
|
|
2 |
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
3 |
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|
4 |
+
|hellaswag| 1|none | 5|acc |↑ |0.5624|± |0.0050|
|
5 |
+
| | |none | 5|acc_norm|↑ |0.7430|± |0.0044|
|