chunked/nltk_chunking/model_doc_longt5/chunk_15.txt

For Local Attention, the sparse sliding-window local attention operation allows a given token to attend only r
tokens to the left and right of it (with r=127 by default).