learn me a gpt

How GPT models work, one token at a time

This site explains how GPT-style language models work, from the text in a chat window down to the calculation that produces the next token. When a page inspects a real model, that model is GPT-2 small.

Start with How a GPT works

The full list includes titles that are not written yet. The header field finds a written page or tool by name.