Probability and Statistics
Probability, expectation, Bayes' rule, distributions and sampling, the vocabulary every model evaluation uses.
Why probability
A model rarely knows the answer; it holds a degree of belief. A classifier says "92% spam". A language model assigns a probability to every possible next word. Evaluating models means reasoning about noisy measurements. Probability is the language for all of this.
1 of 8