| For each chunk, the query embedding vectors attend to its key vectors | |
| (which are tied to themselves) and to the key embedding vectors of config.lsh_num_chunks_before previous | |
| neighboring chunks and config.lsh_num_chunks_after following neighboring chunks. |