Scaling Laws
Empirical mathematical relationships demonstrating that an AI model's performance improves predictably as compute, dataset size, and parameters increase.
Think of It Like This
Like knowing exactly how much faster a race car will go for every single horsepower you add to its engine.
Discovered by OpenAI in 2020, these power laws allow researchers to confidently predict the performance of a massive $100M training run using only small-scale experiments. They prove that simply making models bigger and training them longer consistently yields better intelligence, driving the modern arms race for larger clusters.