This is especially the case with bf16 which has a lower precision than fp16.