kuixu/Linear-Multihead-Attention

Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)

Language: Python - Size: 176 KB - Last synced at: 20 days ago - Pushed at: almost 5 years ago - Stars: 76 - Forks: 14