GitHub / kyegomez / SwitchTransformers
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FSwitchTransformers
PURL: pkg:github/kyegomez/SwitchTransformers
Stars: 114
Forks: 13
Open issues: 1
License: mit
Language: Python
Size: 2.42 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 6 days ago
Pushed at: 14 days ago
Last synced at: 1 day ago
Commit Stats
Commits: 10
Authors: 3
Mean commits per author: 3.33
Development Distribution Score: 0.3
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/kyegomez/SwitchTransformers
Topics: ai, gpt4, llama, mixture-model, mixture-of-experts, mixture-of-models, ml, moe, multi-modal
Funding Links https://github.com/sponsors/kyegomez