quazim commited on
Commit
a189991
·
verified ·
1 Parent(s): 48751ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
148
 
149
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
150
  |---------------|---|---|---|----|----------|------------|
151
- | arc_challenge | 49.20 | 51.00 | 50.60 | 50.90 | 50.90 | 49.20 | - |
152
- | mmlu | 73.70 | 74.30 | 74.60 | 74.80 | 74.80 | 73.70 | - |
153
- | piqa | 77.20 | 77.90 | 78.20 | 78.60 | 78.60 | 77.20 | - |
154
- | winogrande | 69.30 | 70.90 | 72.10 | 72.30 | 72.30 | 69.30 | - |
155
 
156
 
157
 
 
148
 
149
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
150
  |---------------|---|---|---|----|----------|------------|
151
+ | arc_challenge | 49.20 | 51.00 | 50.60 | 50.90 | 50.90 | 35.30 | - |
152
+ | mmlu | 73.70 | 74.30 | 74.60 | 74.80 | 74.80 | 51.50 | - |
153
+ | piqa | 77.20 | 77.90 | 78.20 | 78.60 | 78.60 | 69.70 | - |
154
+ | winogrande | 69.30 | 70.90 | 72.10 | 72.30 | 72.30 | 61.30 | - |
155
 
156
 
157