File size: 232 Bytes
5fa1a76
 
 
1
2
3
Instead of predicting modality-specific targets such as words, visual tokens or units of human speech which
are local in nature, data2vec predicts contextualized latent representations that contain information from
the entire input.