| It is also 7.9x faster on a CPU, as well as being better performing than other compressed variants of the | |
| architecture, and some of the non-compressed variants: it obtains performance improvements of between 0.3% and 31%, | |
| absolute, with respect to BERT-large, on multiple public natural language understanding (NLU) benchmarks. |