• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • About
    • Our Programs
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Guest Instructors
  • Membership
    • Statistically Speaking Membership Program
    • Login
  • Workshops
    • Online Workshops
    • Login
  • Consulting
    • Statistical Consulting Services
    • Login
  • Free Webinars
  • Contact
  • Login

How Does the Distribution of a Population Impact the Confidence Interval?

by Jeff Meyer Leave a Comment

Spoiler alert, real data are seldom normally distributed.

How does the distribution influence the estimate of the population mean and the resulting confidence interval?

To figure this out, we randomly draw 100 observations 100 times from three distinct populations and plot the mean and corresponding 95% confidence interval of each sample.

The three populations consist of 10,000 observations with the following features.

1. Normal distribution

with a mean of 4 and a standard deviation of 4:

2. Uniform distribution

with a mean of 4 and a standard deviation of 4.60:

3. Right skewed

with a mean 4 and standard deviation of 3.5:

Here are the graphs of the means and confidence intervals for each of 100 samples for the three populations.

1. Normal distribution

2. Uniform distribution

3. Right Skewed

For all three distinct populations, there are approximately 5 samples whose confidence interval does not contain the population’s true mean.

The table below provides the mean of the 100 sample means, the mean width of the 100 confidence intervals, and the minimum and maximum widths. Note, my focus is on the width of the confidence intervals, not the actual values of the lower and upper confidence bounds.

You’ll notice the mean of the sample means is very close to the population mean for all three distributions.

In addition, the key feature for determining the width of the confidence interval is the standard deviation of the population. The greater the population standard deviation, the wider the confidence intervals.

What about sample size?

If we reduced our sample size to 40 observations, we have the following results. The mean of means is practically the same as the population mean. No difference there.

The noticeable difference between the 40 subjects versus 100 subjects all three confidence intervals widened substantially.

By using simulation, we have observed that:

1. The shape of the population distribution doesn’t affect how well the mean sample mean matches the population mean.
2. For all shapes, ~95% of the confidence intervals contained the true population mean.
3. The sample size had a bigger impact on the width of the confidence interval than did the shape of the population distribution.

The consistency of the sampling distribution is dependent on the sample size not on the distribution of the population. As the sample size decreases the absolute value of the skewness and kurtosis of the sampling distribution increases. This sample size relationship is expressed in the central limit theorem.

Jeff Meyer is a statistical consultant with The Analysis Factor, a stats mentor for Statistically Speaking membership, and a workshop instructor. Read more about Jeff here.

Effect Size Statistics
Statistical software doesn't always give us the effect sizes we need. Learn some of the common effect size statistics and the ways to calculate them yourself.

Tagged With: confidence interval, Estimated marginal Means, normal distribution, population, right skewed, sample, sample size, shape of distribution, standard deviation, Uniform distribution

Related Posts

  • How Confident Are You About Confidence Intervals?
  • How to Interpret the Width of a Confidence Interval
  • Member Training: Statistical Rules of Thumb: Essential Practices or Urban Myths?
  • 5 Ways to Increase Power in a Study

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • January Member Training: A Gentle Introduction To Random Slopes In Multilevel Models

Upcoming Workshops

  • Logistic Regression for Binary, Ordinal, and Multinomial Outcomes (May 2021)
  • Introduction to Generalized Linear Mixed Models (May 2021)

Read Our Book



Data Analysis with SPSS
(4th Edition)

by Stephen Sweet and
Karen Grace-Martin

Statistical Resources by Topic

  • Fundamental Statistics
  • Effect Size Statistics, Power, and Sample Size Calculations
  • Analysis of Variance and Covariance
  • Linear Regression
  • Complex Surveys & Sampling
  • Count Regression Models
  • Logistic Regression
  • Missing Data
  • Mixed and Multilevel Models
  • Principal Component Analysis and Factor Analysis
  • Structural Equation Modeling
  • Survival Analysis and Event History Analysis
  • Data Analysis Practice and Skills
  • R
  • SPSS
  • Stata

Copyright © 2008–2021 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.