Friday, April 18, 2025

How LLMs Work, by Andrej Karpathy

Andrej Karpathy, Eureka Labs founder and computer scientist (Tesla, OpenAI), explains how language models work, and are built. You'll need about 3.5 hours to view the whole video, but it covers transformer networks, training (human and algorithmic; labeling) and reinforcement learning. 

No comments:

Nvidia Hugging Face Acquisition Would Move it "Up the Stack"

If the $12.9 billion acquisition of open source model Hugging Face by Nvidia is completed, it suggests Nvidia is changing its focus to supp...