Interpretation of interaction in factorial analysis of variance design.

The validity of statistical conclusions in medical research depends on proper analysis and interpretation of collected data. One potential area of invalidity is the inappropriate post hoc analysis of statistically significant interactions in the analysis of variance of factorial designs. This paper examines the statistical explanations included in 83 studies published in three leading medical journals where the findings indicated significant interaction effects. Only 24 per cent of the reported statistically significant interactions had an accompanying correct interpretation. The most common form of misinterpretation involved a comparison of individual cell means within a row or column of one factor used in the design. This interpretation did not conform to the factorial ANOVA model with interaction. This misinterpretation occurs when the correct omnibus test of a hypothesis is followed by an incorrect post hoc analysis and/or an inaccurate assessment of the original statistical result.