Perceiver aims to solve this issue by, instead of performing self-attention on the inputs, perform it on a set | |
of latent variables, and only use the inputs for cross-attention. |
Perceiver aims to solve this issue by, instead of performing self-attention on the inputs, perform it on a set | |
of latent variables, and only use the inputs for cross-attention. |