Renaissance LabsLearn

Course

All lessons

18 written lessons on how large language models are built and trained, about 2 hours of reading in total. Read them in order or jump to what you need. Each one links to the films that cover the same ground.

Start with lesson 1Course map and films

Part 1

The basics

What a model is, how it reads text, and how it learns.

Part 2

Feeding the model

Data, scale and the memory a model needs.

Part 3

The machine room

Chips, parallelism and what goes wrong at scale.

Part 4

After pre-training

Turning a text predictor into something useful, and running it.

Part 5

End to end

Two long guides that follow one real model, Agora 9B, from raw text to a working assistant.