Please check each model's docs to see how they handle these input IDs for sequence to sequence training.