1. Perception – Prediction
In the book · Ch. 1 · The Grammar of Reality · Ch. 7 · Dialogue with an Echo
Fig. 1The brain glows inside the head. Beside it, a network through which a signal flows from input to output.
Human
Perception
The brain – some 86 billion neurons1 – doesn’t take in the world like a camera: according to an influential theory, it constantly predicts what it will see, and what travels up the cortex is mainly whatever fails to match the prediction; a 1999 model of the visual cortex already worked this way2. Neuroscientist Anil Seth puts it like this: we are all hallucinating all the time, and when our hallucinations agree, we call that reality3.
Machine
Prediction
A language model learns, above all, to predict the next word of a text – and it writes its answers word by word, too. And yet researchers looked inside and saw that when it writes a poem, it chooses the rhyme before it reaches the end of the line4.
Truth
Both sides keep guessing what comes next – the brain what it will see, the model what it will write.