mytechnotalent/ToyGPT

ToyGPT, inspired by Andrej Karpathy’s GPT from scratch, creates a toy generative pre-trained transformer at its most basic level using a simple bigram language model with attention to help educate on the basics of creating an LLM from scratch.

Language: Jupyter Notebook - Size: 1010 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0