Reduce operations are lossy, for example when gradients are averaged across multiple GPUs.