Friday, April 18, 2025

How LLMs Work, by Andrej Karpathy

Andrej Karpathy, Eureka Labs founder and computer scientist (Tesla, OpenAI), explains how language models work, and are built. You'll need about 3.5 hours to view the whole video, but it covers transformer networks, training (human and algorithmic; labeling) and reinforcement learning. 

No comments:

Manufacturing Might be Growing Where We Do Not Expect

Manufacturing employment in the United States has surpassed its pre-Covid pandemic levels, the first time since the 1970s that the sector ha...