Update README.md
Browse files
README.md
CHANGED
@@ -148,10 +148,10 @@ Benchmarking is one of the most important procedures during model acceleration.
|
|
148 |
|
149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
150 |
|---------------|---|---|---|----|----------|------------|
|
151 |
-
| arc_challenge | 49.20 | 51.00 | 50.60 | 50.90 | 50.90 |
|
152 |
-
| mmlu | 73.70 | 74.30 | 74.60 | 74.80 | 74.80 |
|
153 |
-
| piqa | 77.20 | 77.90 | 78.20 | 78.60 | 78.60 |
|
154 |
-
| winogrande | 69.30 | 70.90 | 72.10 | 72.30 | 72.30 |
|
155 |
|
156 |
|
157 |
|
|
|
148 |
|
149 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
150 |
|---------------|---|---|---|----|----------|------------|
|
151 |
+
| arc_challenge | 49.20 | 51.00 | 50.60 | 50.90 | 50.90 | 35.30 | - |
|
152 |
+
| mmlu | 73.70 | 74.30 | 74.60 | 74.80 | 74.80 | 51.50 | - |
|
153 |
+
| piqa | 77.20 | 77.90 | 78.20 | 78.60 | 78.60 | 69.70 | - |
|
154 |
+
| winogrande | 69.30 | 70.90 | 72.10 | 72.30 | 72.30 | 61.30 | - |
|
155 |
|
156 |
|
157 |
|