chunked/nltk_chunking/model_doc_vit_mae/chunk_1.txt

The paper shows that, by pre-training a Vision Transformer (ViT) to reconstruct pixel values for masked patches, one can get results after
fine-tuning that outperform supervised pre-training.