• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • About
    • Our Programs
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Guest Instructors
  • Membership
    • Statistically Speaking Membership Program
    • Login
  • Workshops
    • Online Workshops
    • Login
  • Consulting
    • Statistical Consulting Services
    • Login
  • Free Webinars
  • Contact
  • Login

Assumptions

The Difference Between Model Assumptions, Inference Assumptions, and Data Issues

by Karen Grace-Martin Leave a Comment

Have you ever compared the list of assumptions for linear regression across two sources? Whether they’re textbooks, lecture notes, or web pages, chances are the assumptions don’t quite line up.

Why? Sometimes the authors use different terminology. So it just looks different.

And sometimes they’re including not only model assumptions, but inference assumptions and data issues. All are important, but understanding the role of each can help you understand what applies in your situation.

[Read more…] about The Difference Between Model Assumptions, Inference Assumptions, and Data Issues

Tagged With: Assumptions, data issues, inference

Related Posts

  • Eight Data Analysis Skills Every Analyst Needs
  • Preparing Data for Analysis is (more than) Half the Battle
  • Outliers: To Drop or Not to Drop
  • What It Really Means to Take an Interaction Out of a Model

Member Training: Using Transformations to Improve Your Linear Regression Model

by guest Leave a Comment

Transformations don’t always help, but when they do, they can improve your linear regression model in several ways simultaneously.

They can help you better meet the linear regression assumptions of normality and homoscedascity (i.e., equal variances). They also can help avoid some of the artifacts caused by boundary limits in your dependent variable — and sometimes even remove a difficult-to-interpret interaction.

[Read more…] about Member Training: Using Transformations to Improve Your Linear Regression Model

Tagged With: Assumptions, interaction, linear regression, log transformation, transformation

Related Posts

  • November Member Training: Preparing to Use (and Interpret) a Linear Regression Model
  • Member Training: Segmented Regression
  • Member Training: Transformations & Nonlinear Effects in Linear Models
  • Interpreting Lower Order Coefficients When the Model Contains an Interaction

ANCOVA Assumptions: When Slopes are Unequal

by Karen Grace-Martin 18 Comments

There are two oft-cited assumptions for Analysis of Covariance (ANCOVA), which is used to assess the effect of a categorical independent variable on a numerical dependent variable while controlling for a numerical covariate:

1. The independent variable and the covariate are independent of each other.

2. There is no interaction between independent variable and the covariate.

In a previous post, I showed a detailed example for an observational study where the first assumption is irrelevant, but I have gotten a number of questions about the second.

So what does it mean, and what should you do, if you find an interaction between the categorical IV and the continuous covariate? [Read more…] about ANCOVA Assumptions: When Slopes are Unequal

Tagged With: ancova, Assumptions, slopes

Related Posts

  • When Assumptions of ANCOVA are Irrelevant
  • Assumptions of Linear Models are about Residuals, not the Response Variable
  • Using Adjusted Means to Interpret Moderators in Analysis of Covariance
  • Why ANOVA and Linear Regression are the Same Analysis

When Assumptions of ANCOVA are Irrelevant

by Karen Grace-Martin 42 Comments

Every once in a while, I work with a client who is stuck between a particular statistical rock and hard place.

It happens when they’re trying to run an analysis of covariance (ANCOVA) model because they have a categorical independent variable and a continuous covariate.

The problem arises when a coauthor, committee member, or reviewer insists that ANCOVA is inappropriate in this situation because one of the following ANCOVA assumptions are not met:

1. The independent variable and the covariate are independent of each other.

2. There is no interaction between independent variable and the covariate.

If you look them up in any design of experiments textbook, which is usually where you’ll find information about ANOVA and ANCOVA, you will indeed find these assumptions.  So the critic has nice references.

However, this is a case where it’s important to stop and think about whether the assumptions apply to your situation, and how dealing with the assumption will affect the analysis and the conclusions you can draw. [Read more...] about When Assumptions of ANCOVA are Irrelevant

Tagged With: analysis of covariance, ancova, Assumptions, experiments, General Linear Model

Related Posts

  • The General Linear Model, Analysis of Covariance, and How ANOVA and Linear Regression Really are the Same Model Wearing Different Clothes
  • 3 Reasons Psychology Researchers should Learn Regression
  • SPSS GLM: Choosing Fixed Factors and Covariates
  • ANCOVA Assumptions: When Slopes are Unequal

Assumptions of Linear Models are about Residuals, not the Response Variable

by Karen Grace-Martin 6 Comments

I recently received a great question in a comment about whether the assumptions of normality, constant variance, and independence in linear models are about the residuals or the response variable.

The asker had a situation where Y, the response, was not normally distributed, but the residuals were.

Quick Answer:  It’s just the residuals.

In fact, if you look at any (good) statistics textbook on linear models, you’ll see below the model, stating the assumptions: [Read more…] about Assumptions of Linear Models are about Residuals, not the Response Variable

Tagged With: Assumptions, linear model

Related Posts

  • ANCOVA Assumptions: When Slopes are Unequal
  • The Assumptions of Linear Models: Explicit and Implicit
  • Why ANOVA is Really a Linear Regression, Despite the Difference in Notation
  • Using Pairwise Comparisons to Help you Interpret Interactions in Linear Regression

6 Types of Dependent Variables that will Never Meet the Linear Model Normality Assumption

by Karen Grace-Martin 11 Comments

The assumptions of normality and constant variance in a linear model (both OLS regression and ANOVA) are quite robust to departures.  That means that even if the assumptions aren’t met perfectly, the resulting p-values will still be reasonable estimates.

But you need to check the assumptions anyway, because some departures are so far that the p-value become inaccurate.  And in many cases there are remedial measures you can take to turn non-normal residuals into normal ones.

But sometimes you can’t.

Sometimes it’s because the dependent variable just isn’t appropriate for a linear model.  The [Read more…] about 6 Types of Dependent Variables that will Never Meet the Linear Model Normality Assumption

Tagged With: Assumptions, categorical outcome, categorical variable, Censored, Constant Variance, dependent variable, Discrete Counts, normality, ordinal variable, Proportion, Truncated, Zero Inflated

Related Posts

  • When Dependent Variables Are Not Fit for Linear Models, Now What?
  • When to Check Model Assumptions
  • Statistical Models for Truncated and Censored Data
  • Member Training: Types of Regression Models and When to Use Them

  • Go to page 1
  • Go to page 2
  • Go to Next Page »

Primary Sidebar

Free Webinars

Effect Size Statistics on Tuesday, Feb 2nd

This Month’s Statistically Speaking Live Training

  • January Member Training: A Gentle Introduction To Random Slopes In Multilevel Models

Upcoming Workshops

  • Logistic Regression for Binary, Ordinal, and Multinomial Outcomes (May 2021)
  • Introduction to Generalized Linear Mixed Models (May 2021)

Read Our Book



Data Analysis with SPSS
(4th Edition)

by Stephen Sweet and
Karen Grace-Martin

Statistical Resources by Topic

  • Fundamental Statistics
  • Effect Size Statistics, Power, and Sample Size Calculations
  • Analysis of Variance and Covariance
  • Linear Regression
  • Complex Surveys & Sampling
  • Count Regression Models
  • Logistic Regression
  • Missing Data
  • Mixed and Multilevel Models
  • Principal Component Analysis and Factor Analysis
  • Structural Equation Modeling
  • Survival Analysis and Event History Analysis
  • Data Analysis Practice and Skills
  • R
  • SPSS
  • Stata

Copyright © 2008–2021 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.