Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / AdrianBZG / LLM-distributed-finetune

Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AdrianBZG%2FLLM-distributed-finetune

Stars: 43
Forks: 3
Open Issues: 1

License: mit
Language: Python
Repo Size: 20.9 MB
Dependencies: pending

Created: 11 months ago
Updated: 3 months ago
Last pushed: 11 months ago
Last synced: 3 months ago

Topics: aws, deep-learning, distributed-training, falcon, fine-tuning, huggingface, large-language-models, natural-language-processing, transformers

Files
    Loading...
    Readme
    Loading...