chunked/nltk_chunking/model_doc_data2vec/chunk_6.txt

Instead of predicting modality-specific targets such as words, visual tokens or units of human speech which
are local in nature, data2vec predicts contextualized latent representations that contain information from
the entire input.