before_revision: Transfer learning, particularly approaches that combine multi-task learning with pre-trained contextualized embeddings and fine-tuning, have advanced the field of Natural Language Processing tremendously in recent years. In this paper we present MaChAmp, a toolkit for easy use of fine-tuning BERT-like models in multi-task settings. The benefits of MaChAmp are its flexible configuration options, and the support of a variety of NLP tasks in a uniform toolkit, from text classification to sequence labeling and dependency parsing .
after_revision: Transfer learning, particularly approaches that combine multi-task learning with pre-trained contextualized embeddings and fine-tuning, have advanced the field of Natural Language Processing tremendously in recent years. In this paper we present MaChAmp, a toolkit for easy fine-tuning of contextualized embeddings in multi-task settings. The benefits of MaChAmp are its flexible configuration options, and the support of a variety of natural language processing tasks in a uniform toolkit, from text classification and sequence labeling to dependency parsing, masked language modeling, and text generation .
edit_actions: D
edit_actions: use of
edit_actions: coherence
edit_actions: coherence clarity coherence
edit_actions: R
edit_actions: BERT-like models
edit_actions: of contextualized embeddings
edit_actions: meaning-changed
edit_actions: meaning-changed style meaning-changed
edit_actions: R
edit_actions: NLP
edit_actions: natural language processing
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: to sequence labeling and dependency parsing
edit_actions: and sequence labeling to dependency parsing, masked language modeling, and text generation
edit_actions: meaning-changed
edit_actions: meaning-changed style meaning-changed