Leveraging this feature allows GPT-2 to generate syntactically coherent text as it can be observed in the run_generation.py example script.