GitHub / huggingface / large_language_model_training_playbook
An open collection of implementation tips, tricks and resources for training large language models
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huggingface%2Flarge_language_model_training_playbook
PURL: pkg:github/huggingface/large_language_model_training_playbook
Stars: 475
Forks: 23
Open issues: 0
License: apache-2.0
Language: Python
Size: 162 KB
Dependencies parsed at: Pending
Created at: over 2 years ago
Updated at: 18 days ago
Pushed at: over 2 years ago
Last synced at: 1 day ago
Topics: cuda, large-language-models, llm, nccl, nlp, performance, python, pytorch, scalability, troubleshooting