GitHub / TatevKaren / BabyGPT-Build_GPT_From_Scratch

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TatevKaren%2FBabyGPT-Build_GPT_From_Scratch

Topics: attention-is-all-you-need, dropout-layers, gpt, gpt-3, large-language-models, layer-normalization, llm-training, llms, multi-head-self-attention, neural-networks, python, pytorch, residual-connections, transformers

Files

No dependencies found