Hugging Face's logo

xuan-luo
/
FlexiDepth-Llama-3-8B-Instruct

Text Generation
Transformers
Safetensors
English
ddllama
conversational
custom_code
Model card Files Community
1
xuan-luo commited on
Commit
bfeb150
·
verified ·
1 Parent(s): a8b792a

Update evals/6-coqa.out

Browse files
Files changed (1) hide show
  1. evals/6-coqa.out +3 -4
evals/6-coqa.out CHANGED
@@ -1,6 +1,5 @@
1
- 2025-03-30:04:25:15 INFO [loggers.evaluation_tracker:272] Output path not provided, skipping saving results aggregated
2
- hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 4
3
  |Tasks|Version|Filter|n-shot|Metric| |Value | |Stderr|
4
  |-----|------:|------|-----:|------|---|-----:|---|-----:|
5
- |coqa | 3|none | 0|em |↑ |0.6608|± |0.0182|
6
- | | |none | 0|f1 |↑ |0.8082|± |0.0128|
 
1
+ hf (pretrained=../,trust_remote_code=True), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 16
 
2
  |Tasks|Version|Filter|n-shot|Metric| |Value | |Stderr|
3
  |-----|------:|------|-----:|------|---|-----:|---|-----:|
4
+ |coqa | 3|none | 0|em |↑ |0.6575|± |0.0183|
5
+ | | |none | 0|f1 |↑ |0.8028|± |0.0130|