We introduce two techniques to improve the efficiency of
Transformers.