GitHub / kyegomez / SparseAttention
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FSparseAttention
PURL: pkg:github/kyegomez/SparseAttention
Stars: 81
Forks: 2
Open issues: 1
License: mit
Language: Python
Size: 2.16 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 2 months ago
Pushed at: 4 months ago
Last synced at: 2 months ago
Topics: artificial-intelligence, attention-is-all-you-need, attention-mechanism, attention-mechanisms, machine-learning, sparse-attn, sparse-matrix
Funding Links https://github.com/sponsors/kyegomez