Then, we conduct knowledge transfer from this teacher to MobileBERT.