no overlap, the resulting PPL is 19.44, which is about the same as the 19.93 reported in the GPT-2 paper.