Correcting the main ANOVA P values for multiple comparisons? 

Correcting the main ANOVA P values for multiple comparisons? 


Not considering followup multiple comparisons tests (post tests), how many P values does ANOVA compute in its main calculations?
•Oneway ANOVA reports only one main P value.
•Twoway ANOVA reports three P value, one for each of the two factors and one for their interaction.
•Threeway ANOVA reports seven P values, one for each of the three factors, one for each of three twoway interaction and one for the threeway interaction.
Should one take multiple comparisons into account when interpreting the main P values from two and threeway ANOVA? Statistical tradition has been to not do any correction, and GraphPad Prism follows this tradition (so only corrects for multiple comparisons for the followup tests that compare one treatment or cell with another.
Lakens argues (1) that a correction should be applied, to prevent too many false positives.
To correct for multiple comparisons of the main ANOVA P values in Prism, you should copy all the P values from the ANOVA results table and paste into one column of a Column table. If you did a threeway ANOVA, you would copypaste seven P values into one new column. Then run the Analyze a stack of P values analysis to correct for multiple comparisons. You can correct for multiple comparisons using Bonferroni, Holm or by controlling the false discovery rate (FDR).
1. D. Lakens, Error Control in Exploratory ANOVA's: The How and the Why. Posted in his blog, The 20% statistician.