GitHub / tranquoctrinh / huggingface-transformers-examples

Fine-tuning (or training from scratch) the library models for language modeling on a text dataset for GPT, GPT-2, ALBERT, BERT, DitilBERT, RoBERTa, XLNet... GPT and GPT-2 are trained or fine-tuned using a causal language modeling (CLM) loss while ALBERT, BERT, DistilBERT and RoBERTa are trained or fine-tuned using a masked language modeling (MLM) loss.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tranquoctrinh%2Fhuggingface-transformers-examples

Topics: causal-language-modeling, huggingface, language-model, text-classification, text-generation, transformers

• Files
• Readme
• Dependencies