Explore how scale unlocks emergent capabilities. Learn what LLMs can and cannot do, how they are trained, and why size matters — until it doesn't.
Key Concepts
01Pre-training
02Scaling Laws
03Emergent Abilities
04Tokenization
05Context Windows
Study Note
This module covers scale, emergence, and capabilities. Work through the concepts in order — each one builds on the last. Return to this page as a reference after completing any related papers or implementations.