Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / AdrianBZG / LLM-distributed-finetune
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AdrianBZG%2FLLM-distributed-finetune
Stars: 43
Forks: 3
Open Issues: 1
License: mit
Language: Python
Repo Size: 20.9 MB
Dependencies: pending
Created: 11 months ago
Updated: 3 months ago
Last pushed: 11 months ago
Last synced: 3 months ago
Topics: aws, deep-learning, distributed-training, falcon, fine-tuning, huggingface, large-language-models, natural-language-processing, transformers