The Loss Function That Cannot Be Hallucinated

On Ilya Sutskever's conversation with Dwarkesh, the end of the scaling era, why LLMs can't generalise, and what "it" and "that" could be

The Oracle Speaks

After a year of silence following the most dramatic boardroom coup in tech history, Ilya Sutskever has resurfaced. And he brought a prophecy: the age of scaling is over.

I first read Casey Newton’s summary of this interview in Platformer and immediately watched Sutskever’s conversation with Dwarkesh Patel on Youtube. For those outside the AI world, this requires …