When Language Models Start to Reason

You might have noticed that language models are acting quite a bit smarter now, including responses that look a lot like expert reasoning.

This video starts with a concrete example of this, where a bird species is identified by assembling available evidence and justifying the conclusion from multiple angles.

The video then goes on to identify five key developments that help to explain why language models perform so much better now at reasoning-type tasks.