How a model learns, step by step
Six in-browser views of how a language model is trained and aligned. Nothing is sent to a server.
What it is
Six views of how a language model is trained and aligned, all running in your browser. Nothing is sent to a server.
You can scrub a real training run and watch induction heads switch on between steps 512 and 1,000, grow one live in a small model, compare a base model with a chat model token by token, rate answers to train a reward model on your own picks, and step through gradient descent and backpropagation.
Things to try
- Scrub the training run to the moment induction heads appear
- Be the rater and watch the reward model learn your taste
- Step through backpropagation in a nine-weight network