Renaissance LabsLearn

Minds · Where the two meet

What is intelligence?

Compression, direction and two kinds of mind

4 minBeginner8 chapters

The film asks what a mind does that a rock does not. Its answer is that a mind finds patterns, compresses the world, keeps what matters and updates from error. It then looks at direction and honesty, compares a human brain with a language model, and ends with a mind that models itself.

What to take away

  • Predicting and compressing are two views of the same act, because the better you predict, the less you have to remember.
  • Compression is never neutral: what a mind keeps depends on what it wants.
  • The real test of intelligence is a problem it has never seen, where memory has no entry.
  • A language model trained to predict text is trained to compress it, and what it carries is that compression.
  • Both humans and models can fail at updating, one by resisting change and the other by giving way to pressure.

Go deeper

Read the transcript35 lines, click any line to jump

Chapter times for this film are approximate.

Keep watching