• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • Our Programs
    • Membership
    • Online Workshops
    • Free Webinars
    • Consulting Services
  • About
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Collaborate with Us
  • Statistical Resources
  • Contact
  • Blog
  • Login

5 Ways to Increase Power in a Study

by Karen Grace-Martin 4 Comments

To increase power:

  1. Increase alpha
  2. Conduct a one-tailed test
  3. Increase the effect size
  4. Decrease random error
  5. Increase sample size

Sound so simple, right?  The reality is that although these 5 ways all work theoretically, you might have trouble with some in practice.

1. Alpha is pretty well set at .05 for most scientific studies (there are rare exceptions).  So you’re not going to get away with this one.

2. One-tailed tests have nothing wrong with them theoretically.  However, there are only a few tests in which they’re even possible–namely t- and z-tests.  So they’re not used much and have therefore appear dubious.  Most reviewers won’t believe you that you really were hypothesizing that direction (even if it’s obvious).  They will assume you’re trying to artificially get that p-value lower (it has been done).

So, once again, unless you’re in an enlightened field, or one in which one sided tests are commonly done, you can forget this one too.

3.  Unless you’re coming up with a more precise way to measure your constructs, it’s likely that the effect size is a big as it’s going to get.  Keep going.

4. Aha, something we can work with.  There are two great ways to reduce random error.  One is to make it not random.  Explain it with a control variable, turning into explained variation.

The other related way is to use some sort of repeated measures design.  Because  we have multiple measurements on a subject, we can now separate the error variance from the subject variance.

5. Finally, the crux of the matter.  If #4 doesn’t work, and it won’t always, your only option is to increase sample size.  (But you knew that one, right?)

Effect Size Statistics
Statistical software doesn't always give us the effect sizes we need. Learn some of the common effect size statistics and the ways to calculate them yourself.

Tagged With: alpha, effect size, one-tailed test, power, random error, sample size

Related Posts

  • How Does the Distribution of a Population Impact the Confidence Interval?
  • How Confident Are You About Confidence Intervals?
  • How to Interpret the Width of a Confidence Interval
  • Member Training: Power Analysis and Sample Size Determination Using Simulation

Reader Interactions

Comments

  1. Jeff says

    January 17, 2021 at 10:50 am

    It is my understanding that you can sometimes increase power by switching to more advanced statistical testing. For example, is it true that when you use a general linear mixed model (versus rm-anova) you can increase power…I assume by increase sample size using long data formatting (versus wide format).

    Can you point to some webinar or article or training which would address this? I’m also interested in a step-by-step explanation about how to determine sample size using GLMM (possibly with samplesizeshop).

    Thanks

    Reply
    • Karen Grace-Martin says

      October 15, 2021 at 4:07 pm

      Hi Jeff,

      In that example, yes, you’ll gain power using a mixed model over rm-anova if there is any missing data. RM-anova will drop anyone with any missing data, and mixed won’t.

      Mixed is also more flexible, so allows a more precise model, and this can help power as well as model fit. For example rm-anova assumes all time-varying predictors are categorical.

      The best way I know of to estimate sample size for a GLMM is with simulations.

      Reply
  2. Belayneh says

    May 17, 2019 at 9:41 am

    How high effect size increase power of the study? it is obvious that as effect size like OR increase, sample size decreases. so these confused me, please clarify it.

    Reply
  3. website info says

    August 29, 2017 at 7:28 pm

    Thanks for this great article, I have shared itt on Twitter.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • Member Training: Introduction to SPSS Software Tutorial

Upcoming Free Webinars

Poisson and Negative Binomial Regression Models for Count Data

Upcoming Workshops

  • Analyzing Count Data: Poisson, Negative Binomial, and Other Essential Models (Jul 2022)
  • Introduction to Generalized Linear Mixed Models (Jul 2022)

Copyright © 2008–2022 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT