Chapter 3

The Logic of Hypothesis Testing

Every model comparison, A/B test, and feature evaluation is hypothesis testing. This chapter establishes the formal procedure — hypotheses, test statistics, p-values, error types — and the discipline required to do it honestly: pre-registering your analysis, avoiding p-hacking, and correcting for multiple comparisons.

• 2. Overview of Hypothesis Testing→
• 3. Type 1 and Type 2 Errors→
• 4. P-Values, Carefully→
• 5. P-Hacking and Why α Comes First→
• 6. The Multiple Comparisons Problem→