You can disable this behavior by setting use_fast=False in from_pretrained.