A helper class transformers.test_utils.TestCasePlus is best used for such purposes.