GitHub / lucidrains / rotary-embedding-torch
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucidrains%2Frotary-embedding-torch
Stars: 664
Forks: 56
Open issues: 17
License: mit
Language: Python
Size: 102 KB
Dependencies parsed at: Pending
Created at: almost 4 years ago
Updated at: 10 days ago
Pushed at: 5 months ago
Last synced at: 10 days ago
Commit Stats
Commits: 66
Authors: 4
Mean commits per author: 16.5
Development Distribution Score: 0.061
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/lucidrains/rotary-embedding-torch
Topics: artificial-intelligence, deep-learning, positional-encoding