before_revision: Pre-training techniques have been verified successfully in a variety of NLP tasks in recent years. Despite the wide spread of pre-training models for NLP applications, they almost focused on text-level manipulation, while neglecting the layout and style information that is vital for document image understanding. In this paper, we propose textbf LayoutLM to jointly model the interaction between text and layout information across scanned document images, which is beneficial for a great number of real-world document image understanding tasks such as information extraction from scanned documents. We also leverage the image features to incorporate the style information of words in LayoutLM. To the best of our knowledge, this is the first time that text and layout are jointly learned in a single framework for document-level pre-training , leading to significant performance improvement in downstream tasks for document image understanding.
after_revision: Pre-training techniques have been verified successfully in a variety of NLP tasks in recent years. Despite the widespread of pre-training models for NLP applications, they almost focused on text-level manipulation, while neglecting the layout and style information that is vital for document image understanding. In this paper, we propose the LayoutLM to jointly model the interaction between text and layout information across scanned document images, which is beneficial for a great number of real-world document image understanding tasks such as information extraction from scanned documents. Furthermore, we also leverage the image features to incorporate the visual information of words into LayoutLM. To the best of our knowledge, this is the first time that text and layout are jointly learned in a single framework for document-level pre-training . It achieves new state-of-the-art results in several downstream tasks, including receipt understanding (from 94.02 to 95.24) and document image classification (from 93.07 to 94.42). The code and pre-trained LayoutLM models will be available soon at URL
edit_actions: R
edit_actions: wide spread
edit_actions: widespread
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: D
edit_actions: textbf
edit_actions: others
edit_actions: others others others
edit_actions: R
edit_actions: LayoutLM
edit_actions: the LayoutLM
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: R
edit_actions: We
edit_actions: Furthermore, we
edit_actions: coherence
edit_actions: coherence coherence coherence
edit_actions: R
edit_actions: style
edit_actions: visual
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: in
edit_actions: into
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: , leading to significant performance improvement in downstream tasks for document image understanding.
edit_actions: . It achieves new state-of-the-art results in several downstream tasks, including receipt understanding (from 94.02 to 95.24) and document image classification (from 93.07 to 94.42). The code and pre-trained LayoutLM models will be available soon at URL
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed