• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • About
    • Our Programs
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Guest Instructors
  • Membership
    • Statistically Speaking Membership Program
    • Login
  • Workshops
    • Online Workshops
    • Login
  • Consulting
    • Statistical Consulting Services
    • Login
  • Free Webinars
  • Contact
  • Login

The Assumptions of Linear Models: Explicit and Implicit

by Karen Grace-Martin 4 Comments

If you’ve compared two textbooks on linear models, chances are, you’ve seen two different lists of assumptions.

I’ve spent a lot of time trying to get to the bottom of this, and I think it comes down to a few things.

1. There are four assumptions that are explicitly stated along with the model, and some authors stop there.

2. Some authors are writing for introductory classes, and rightfully so, don’t want to confuse students with too many abstract, and sometimes untestable, assumptions.  So they write them in more concrete terms that aren’t incorrect, but aren’t the core assumptions, either.

3. Some authors are writing for very specific fields or research situations, like experiments or survey data analysis.  They state the assumptions in terms specific to that analysis, not the more general forms.  For example, the assumptions of ANOVA are the same as those for regression, although they’re often written in a more specific form.

4. Likewise, sometimes the logical implication of an assumption is more interesting or important to a specific field or is just generally easier to test.  So rather than writing the assumption itself, the implicatation is written.  Logically, they’re really the same thing.  But they can look totally different, and it can make you look at someone’s list and say “hey, they left something out!”

So what are they, really?

The Explicit Assumptions

These assumptions are explicitly stated by the model:

  1. The errors are independent of each other
  2. The errors are normally distributed
  3. The errors have a mean of 0 at all values of X
  4. The errors have constant variance

The Implicit Assumptions

These assumptions aren’t, but the specification of the model implies them.  This is the way I’ve summarized them–they can be written with different terminology, of course.

  1. All X are fixed and are measured without error
  2. The model is linear in the parameters
  3. The predictors and response are specified correctly
  4. There is a single source of unmeasured random variance

If there is an assumption you’ve heard not on this list, chances are it is a logical extension of one of these core assumptions.

1.

 

Four Critical Steps in Building Linear Regression Models
While you’re worrying about which predictors to enter, you might be missing issues that have a big impact your analysis. This training will help you achieve more accurate results and a less-frustrating model building experience.

Tagged With: GLM, linear model, regression assumptions

Related Posts

  • Assumptions of Linear Models are about Residuals, not the Response Variable
  • Continuous and Categorical Variables: The Trouble with Median Splits
  • Why ANOVA is Really a Linear Regression, Despite the Difference in Notation
  • Using Pairwise Comparisons to Help you Interpret Interactions in Linear Regression

Reader Interactions

Comments

  1. Fabio Valeri says

    November 17, 2017 at 1:50 pm

    For linear regression the assumption of normality distribution of the residuals/errors is not mandatory. It is only useful if you want to use standard errors to compute p-values and confidence intervals. An alternative to compute CI and p-values would be bootstrppng.

    Reply
  2. IM CHIU says

    December 18, 2015 at 3:54 pm

    The use of “residuals” in the Explicit Assumption can be misleading. The linear model make major assumptions on the “error” term. The “residuals” are the estimates of the “errors”.

    Reply
    • Karen Grace-Martin says

      August 13, 2020 at 11:57 am

      Thanks IM, I updated that.

      Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • February Member Training: Choosing the Best Statistical Analysis

Upcoming Workshops

  • Logistic Regression for Binary, Ordinal, and Multinomial Outcomes (May 2021)
  • Introduction to Generalized Linear Mixed Models (May 2021)

Read Our Book



Data Analysis with SPSS
(4th Edition)

by Stephen Sweet and
Karen Grace-Martin

Statistical Resources by Topic

  • Fundamental Statistics
  • Effect Size Statistics, Power, and Sample Size Calculations
  • Analysis of Variance and Covariance
  • Linear Regression
  • Complex Surveys & Sampling
  • Count Regression Models
  • Logistic Regression
  • Missing Data
  • Mixed and Multilevel Models
  • Principal Component Analysis and Factor Analysis
  • Structural Equation Modeling
  • Survival Analysis and Event History Analysis
  • Data Analysis Practice and Skills
  • R
  • SPSS
  • Stata

Copyright © 2008–2021 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.

SAVE & ACCEPT