chunked/nltk_chunking/model_doc_visual_bert/chunk_3.txt

VisualBERT consists of a stack of Transformer layers that implicitly align elements of an input text and regions in an
associated input image with self-attention.