Prediction as a basis for skilled reading: insights from modern language models
Reading is not an inborn human capability, and yet, English-speaking adults read with impressive speed.This study considered how s&d rex tool predictions of upcoming words impact on this skilled behaviour.We used a powerful language model (GPT-2) to derive predictions of upcoming words in text passages.These predictions were highly accurate and sho