How GPT works Jay Alammar's GPT blog posts Andrej Karpathy's nanoGPT implementation Alammar: Illustrated GPT-2 Alammar: How GPT-3 works Karpathy: nanoGPT Additional Links GPT architecture Original GPT paper Original GPT blog post by OpenAI ChatGPT blog post by OpenAI GPT-2 blog post by OpenAI Video Tutorial on nanoGPT by Karpathy CS224n Self-Attention and Transformers CS224n Transformers and Pretraining