Text Generation
Transformers
Safetensors
English
ddllama
conversational
custom_code
xuan-luo commited on
Commit
ebeebc6
·
verified ·
1 Parent(s): 6c7b28c

Update evals/2-hellaswag.out

Browse files
Files changed (1) hide show
  1. evals/2-hellaswag.out +3 -4
evals/2-hellaswag.out CHANGED
@@ -1,6 +1,5 @@
1
- 2025-03-30:04:11:42 INFO [loggers.evaluation_tracker:272] Output path not provided, skipping saving results aggregated
2
- hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 4
3
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
4
  |---------|------:|------|-----:|--------|---|-----:|---|-----:|
5
- |hellaswag| 1|none | 5|acc |↑ |0.5640|± |0.0049|
6
- | | |none | 5|acc_norm|↑ |0.7385|± |0.0044|
 
1
+ hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 16
 
2
  | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
3
  |---------|------:|------|-----:|--------|---|-----:|---|-----:|
4
+ |hellaswag| 1|none | 5|acc |↑ |0.5624|± |0.0050|
5
+ | | |none | 5|acc_norm|↑ |0.7430|± |0.0044|