File size: 196 Bytes
5fa1a76
 
 
1
2
3
We introduce RAG models where the parametric memory is a
pre-trained seq2seq model and the non-parametric memory is a dense vector index of Wikipedia, accessed with a
pre-trained neural retriever.