GitHub / lucidrains / learning-to-expire-pytorch
An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucidrains%2Flearning-to-expire-pytorch
Stars: 33
Forks: 5
Open issues: 1
License: mit
Language: Python
Size: 65.4 KB
Dependencies parsed at: Pending
Created at: over 4 years ago
Updated at: 10 months ago
Pushed at: over 4 years ago
Last synced at: about 1 month ago
Commit Stats
Commits: 17
Authors: 1
Mean commits per author: 17.0
Development Distribution Score: 0.0
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/lucidrains/learning-to-expire-pytorch
Topics: artificial-intelligence, attention-mechanism, deep-learning, forgetting, memory, transformers