Why can't we just perform multiple ANOVAs?
Post Hoc Tests For ANOVA In the case where the explanatory variable represents more than two groups, a significant ANOVA does not tell us which groups are different from the others. To determine which groups are different from the others, we would need to perform a post hoc test. A post hoc test conducts post hoc paired comparisons. Post hoc means after the fact. And these post hoc paired comparisons must be conducted in a particular way in order to prevent excessive type 1 error. Type 1 error, as you'll recall, occurs when you make an incorrect decision about the null hypothesis. That is, you reject the null hypothesis when the null hypothesis is true. Why can't we just perform multiple ANOVAs? As you know, we accept significance and reject the null hypothesis at P less than or equal to 0.05. A 5% chance that we're wrong and have committed a type 1 error. There's actually a 5% chance of making a type 1 error for each analysis of variance ...