Sharded DDP
Another name for the foundational ZeRO concept as used by various other implementations of ZeRO.