GitHub / lucidrains / electra-pytorch
A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucidrains%2Felectra-pytorch
Stars: 225
Forks: 46
Open issues: 10
License: mit
Language: Python
Size: 92.8 KB
Dependencies parsed at: Pending
Created at: over 4 years ago
Updated at: 24 days ago
Pushed at: almost 2 years ago
Last synced at: 15 days ago
Commit Stats
Commits: 59
Authors: 2
Mean commits per author: 29.5
Development Distribution Score: 0.136
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/lucidrains/electra-pytorch
Topics: artificial-intelligence, deep-learning, pre-training, transformer