But because PyTorch has various non-deterministic default settings, the RNG states aren't guaranteed to be the same.