Member Training: ANOVA Post-hoc Tests: Practical Considerations

Stage 2Post-hoc tests, pairwise or other linear contrasts, are typical in an analysis of variance (ANOVA) setting to understand which group means differ. They incorporate p-value adjustments to avoid concluding that group means differ when they actually do not. There are several adjustments that can be considered for conducting multiple post-hoc tests, including single-step and stepwise adjustments.

In this training, we compare some common single-step multiple comparison adjustment procedures. We discuss common uses to these approaches, issues that can arise when considering the results, and how to report and interpret results. We also briefly discuss post-hoc comparisons for the non-parametric equivalent to ANOVA (Kruskal-Wallis) and other types of analyses.


Note: This training is an exclusive benefit to members of the Statistically Speaking Membership Program and part of the Stat’s Amore Trainings Series. Each Stat’s Amore Training is approximately 90 minutes long.

Not a Member? Join!

About the Instructor

Julia Sharp is faculty in the Department of Statistics at Colorado State University where she is also the Director of the Graybill Statistics & Data Science Laboratory.  She is also the owner of Sharp Analytics LLC, where she is the lead statistical collaborator.  She earned her M.S. and Ph.D. in Statistics from Montana State University.

Julia has experience collaborating with researchers in many domains, using her expertise in applied statistics to inform and advance scientific research.  Her statistical toolbox is broad and includes study design, analysis of a wide-range of data types (e.g., repeated observations over time, categorical data), and knowledge of popular statistical computing software.

Not a Member Yet?

It’s never too early to set yourself up for successful analysis with support and training from expert statisticians. Just head over and sign up for Statistically Speaking. You'll get access to this training webinar, 100+ other stats trainings, a pathway to work through the trainings that you need — plus the expert guidance you need to build statistical skill with live Q&A sessions and an ask-a-mentor forum.

Reader Interactions


Leave a Reply

Your email address will not be published.

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.