GitHub / lucidrains / memorizing-transformers-pytorch
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
Stars: 633
Forks: 47
Open issues: 10
License: mit
Language: Python
Size: 34.2 MB
Dependencies parsed at: Pending
Created at: about 3 years ago
Updated at: 28 days ago
Pushed at: almost 2 years ago
Last synced at: 14 days ago
Commit Stats
Commits: 113
Authors: 2
Mean commits per author: 56.5
Development Distribution Score: 0.018
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/lucidrains/memorizing-transformers-pytorch
Topics: approximate-nearest-neighbors, artificial-intelligence, attention-mechanism, deep-learning, memory, retrieval, transformers