Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / kyegomez / CM3Leon
An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FCM3Leon
Stars: 318
Forks: 15
Open Issues: 4
License: mit
Language: Python
Repo Size: 754 KB
Dependencies:
11
Created: 11 months ago
Updated: about 2 months ago
Last pushed: 6 months ago
Last synced: about 2 months ago
Commit Stats
Commits: 72
Authors: 3
Mean commits per author: 24.0
Development Distribution Score: 0.139
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/kyegomez/CM3Leon
Topics: attention, attention-is-all-you-need, dalle, imagegeneration, multimodal, multimodal-learning, multimodality
Funding links: https://github.com/sponsors/kyegomez
Files
Dependencies
- SentencePiece *
- accelerate *
- bitsandbytes *
- datasets *
- deepspeed *
- einops *
- lion-pytorch *
- memory-profiler *
- numpy *
- transformers *
- triton *