← All systems

How a model learns, step by step

LiveLenses and explainers E8AIInteractive

Six in-browser views of how a language model is trained and aligned. Nothing is sent to a server.

What it is

Six views of how a language model is trained and aligned, all running in your browser. Nothing is sent to a server.

You can scrub a real training run and watch induction heads switch on between steps 512 and 1,000, grow one live in a small model, compare a base model with a chat model token by token, rate answers to train a reward model on your own picks, and step through gradient descent and backpropagation.

Things to try

  • Scrub the training run to the moment induction heads appear
  • Be the rater and watch the reward model learn your taste
  • Step through backpropagation in a nine-weight network
Explore How a model learns, step by step