This is enabled by setting fsdp_offload_params: true when running accelerate config.