chunked/nltk_chunking/model_doc_led/chunk_3.txt

Longformer's attention mechanism is a drop-in replacement for the standard self-attention and combines a local
windowed attention with a task motivated global attention.