Friday, April 18, 2025

How LLMs Work, by Andrej Karpathy

Andrej Karpathy, Eureka Labs founder and computer scientist (Tesla, OpenAI), explains how language models work, and are built. You'll need about 3.5 hours to view the whole video, but it covers transformer networks, training (human and algorithmic; labeling) and reinforcement learning. 

No comments:

AI Capex to Exceed $1.2 Trillion in 2027 and 2028?

Is the growing cost of Nvidia-based compute a business moat or a liability? And in either case, which contestants benefit or suffer?  A new ...