before_revision: Conventional sparse retrieval methods such as TF-IDF and BM25 are simple and efficient, but solely rely on lexical overlap and fail to conduct semantic matching. Recent dense retrieval methods learn latent representations to tackle the lexical mismatch problem, while being more computationally expensive and sometimes insufficient for exact matching as they embed the entire text sequence into a single vector with limited capacity. In this paper, we present Generation-Augmented Retrieval (GAR), a query expansion method that augments a query with relevant contexts through text generation. We demonstrate on open-domain question answering (QA) that the generated contexts significantly enrich the semantics of the queries and thus GAR with sparse representations (BM25) achieves comparable or better performance than the current state-of-the-art dense method DPR cite{karpukhin2020dense}. We show that generating various contexts of a query is beneficial as fusing their results consistently yields a better retrieval accuracy. Moreover, GAR achieves the state-of-the-art performance of extractive QA on the Natural Questions and TriviaQA datasets  when equipped with an extractive reader  .
after_revision: Conventional sparse retrieval methods such as TF-IDF and BM25 are simple and efficient, but solely rely on lexical overlap without semantic matching. Recent dense retrieval methods learn latent representations to tackle the lexical mismatch problem, while being more computationally expensive and insufficient for exact matching as they embed the text sequence into a single vector with limited capacity. In this paper, we present Generation-Augmented Retrieval (GAR), a query expansion method that augments a query with relevant contexts through text generation. We demonstrate on open-domain question answering that the generated contexts significantly enrich the semantics of the queries and thus GAR with sparse representations (BM25) achieves comparable or better performance than the state-of-the-art dense methods such as DPR cite{karpukhin2020dense}. We show that generating various contexts of a query is beneficial as fusing their results consistently yields better retrieval accuracy. Moreover, as sparse and dense representations are often complementary, GAR can be easily combined with DPR to achieve even better performance. Furthermore, GAR achieves the state-of-the-art performance on the Natural Questions and TriviaQA datasets under the extractive setting when equipped with an extractive reader , and consistently outperforms other retrieval methods when the same generative reader is used .
edit_actions: R
edit_actions: and fail to conduct
edit_actions: without
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: D
edit_actions: sometimes
edit_actions: coherence
edit_actions: coherence coherence coherence
edit_actions: D
edit_actions: entire
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: D
edit_actions: (QA)
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: D
edit_actions: current
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: method
edit_actions: methods such as
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: D
edit_actions: a
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: GAR
edit_actions: as sparse and dense representations are often complementary, GAR can be easily combined with DPR to achieve even better performance. Furthermore, GAR
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: D
edit_actions: of extractive QA
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: A
edit_actions: under the extractive setting
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: A
edit_actions: , and consistently outperforms other retrieval methods when the same generative reader is used
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed