• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • About
    • Our Programs
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Guest Instructors
  • Membership
    • Statistically Speaking Membership Program
    • Login
  • Workshops
    • Online Workshops
    • Login
  • Consulting
    • Statistical Consulting Services
    • Login
  • Free Webinars
  • Contact
  • Login

interaction

What’s in a Name? Moderation and Interaction, Independent and Predictor Variables

by Karen Grace-Martin 8 Comments

One of the most confusing things about statistical analysis is the different vocabulary used for the same, or nearly-but-not-quite-the-same, concepts.

Sometimes this happens just because the same analysis was developed separately within different fields and named twice.

So people in different fields use different terms for the same statistical concept.  Try to collaborate with a colleague in a different field and you may find yourself awed by the crazy statistics they’re insisting on.

Other times, there is a level of detail that is implied by one term that isn’t true of the wider, more generic term.  This level of detail is often about how the role of variables or effects affects the interpretation of output. [Read more…] about What’s in a Name? Moderation and Interaction, Independent and Predictor Variables

Tagged With: independent, interaction, Moderation, Path Analysis, predictor variable

Related Posts

  • Confusing Statistical Terms #1: The Many Names of Independent Variables
  • Using Predicted Means to Understand Our Models
  • Actually, you can interpret some main effects in the presence of an interaction
  • Spotlight Analysis for Interpreting Interactions

Five Common Relationships Among Three Variables in a Statistical Model

by Karen Grace-Martin 5 Comments

In a statistical model–any statistical model–there is generally one way that a predictor X and a response Y can relate:

This relationship can take on different forms, of course, like a line or a curve, but there’s really only one relationship here to measure.

Usually the point is to model the predictive ability, the effect, of X on Y.

In other words, there is a clear response variable*, although not necessarily a causal relationship. We could have switched the direction of the arrow to indicate that Y predicts X or used a two-headed arrow to show a correlation, with no direction, but that’s a whole other story.

For our purposes, Y is the response variable and X the predictor.

But a third variable–another predictor–can relate to X and Y in a number of different ways.  How this predictor relates to X and Y changes how we interpret the relationship between X and Y. [Read more…] about Five Common Relationships Among Three Variables in a Statistical Model

Tagged With: interaction, linear regression, mediation, Moderation, Path Analysis

Related Posts

  • Member Training: Mediated Moderation and Moderated Mediation
  • A Visual Description of Multicollinearity
  • Understanding Interactions Between Categorical and Continuous Variables in Linear Regression
  • The Impact of Removing the Constant from a Regression Model: The Categorical Case

The Difference Between Interaction and Association

by Karen Grace-Martin 16 Comments

It’s really easy to mix up the concepts of association (a.k.a. correlation) and interaction.  Or to assume if two variables interact, they must be associated.  But it’s not actually true.

In statistics, they have different implications for the relationships among your variables, especially when the variables you’re talking about are predictors in a regression or ANOVA model.

Association

Association between two variables means the values of one variable relate in some way to the values of the other.  Association is usually measured by correlation for two continuous variables and by cross tabulation and a Chi-square test for two categorical variables.

Unfortunately, there is no nice, descriptive measure for association between one [Read more…] about The Difference Between Interaction and Association

Tagged With: Correlation, interaction

Related Posts

  • Using Pairwise Comparisons to Help you Interpret Interactions in Linear Regression
  • Interpreting Interactions Between Two Effect-Coded Categorical Predictors
  • What is a Confounding Variable?
  • Understanding Interactions Between Categorical and Continuous Variables in Linear Regression

Interpreting Interactions Between Two Effect-Coded Categorical Predictors

by Karen Grace-Martin 13 Comments

I recently received this great question:

Question:

Hi Karen,  ive purchased a lot of your material and read a lot of your pdf documents w.r.t. regression and interaction terms.  Its, now, my general understanding that interaction for two or more categorical variables is best done with effects coding, and interactions  cont v. categorical variables is usually handled via dummy coding.  Further, i may mess this up a little but hopefully you’ll get my point and more importantly my question, i understand that

1)  given a fitted line Y = b0 + b1 x1 + b2 x2 + b3 x1*x2, the interpretation for b3 is the diff of the effect of x1 on Y, when x2 changes one unit, if x1 and x2 are cont.  ( also interpretation can be reversed in terms of x1 and x2). [Read more…] about Interpreting Interactions Between Two Effect-Coded Categorical Predictors

Tagged With: effect coding, interaction, linear regression

Related Posts

  • Understanding Interactions Between Categorical and Continuous Variables in Linear Regression
  • Using Pairwise Comparisons to Help you Interpret Interactions in Linear Regression
  • Understanding Interaction Between Dummy Coded Categorical Variables in Linear Regression
  • The Difference Between Interaction and Association

How Simple Should a Model Be? The Case of Insignificant Controls, Interactions, and Covariance Structures

by Karen Grace-Martin 12 Comments

“Everything should be made as simple as possible, but no simpler” – Albert Einstein*

For some reason, I’ve heard this quotation 3 times in the past 3 days.  Maybe I hear it everyday, but only noticed because I’ve been working with a few clients on model selection, and deciding how much to simplify a model.

And when the quotation fits, use it. (That’s the saying, right?)

*For the record, a quick web search indicated this may be a paraphrase, but it still applies.

The quotation is the general goal of model selection.  You really do want the model to be as simple as possible, but still able to answer the research question of interest.

This applies to many areas of model selection.  Here are a few examples: [Read more…] about How Simple Should a Model Be? The Case of Insignificant Controls, Interactions, and Covariance Structures

Tagged With: control variables, Covariance Structure, interaction, Model Selection

Related Posts

  • Model Building Strategies: Step Up and Top Down
  • Five Common Relationships Among Three Variables in a Statistical Model
  • Member Training: Using Excel to Graph Predicted Values from Regression Models
  • Member Training: Hierarchical Regressions

How to Combine Complicated Models with Tricky Effects

by Karen Grace-Martin 4 Comments

Need to dummy code in a Cox regression model?

Interpret interactions in a logistic regression?

Add a quadratic term to a multilevel model?

quadratic interaction plotThis is where statistical analysis starts to feel really hard. You’re combining two difficult issues into one.

You’re dealing with both a complicated modeling technique at Stage 3 (survival analysis, logistic regression, multilevel modeling) and tricky effects in the model (dummy coding, interactions, and quadratic terms).

The only way to figure it all out in a situation like that is to break it down into parts.  [Read more…] about How to Combine Complicated Models with Tricky Effects

Tagged With: Cox Regression, dummy coding, interaction, logistic regression, multilevel model, quadratic terms, Survival Analysis

Related Posts

  • Member Training: Types of Regression Models and When to Use Them
  • When NOT to Center a Predictor Variable in Regression
  • Interpreting Regression Coefficients in Models other than Ordinary Linear Regression
  • Concepts in Linear Regression you need to know before learning Multilevel Models

  • « Go to Previous Page
  • Go to page 1
  • Go to page 2
  • Go to page 3
  • Go to page 4
  • Go to Next Page »

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • February Member Training: Choosing the Best Statistical Analysis

Upcoming Workshops

  • Logistic Regression for Binary, Ordinal, and Multinomial Outcomes (May 2021)
  • Introduction to Generalized Linear Mixed Models (May 2021)

Read Our Book



Data Analysis with SPSS
(4th Edition)

by Stephen Sweet and
Karen Grace-Martin

Statistical Resources by Topic

  • Fundamental Statistics
  • Effect Size Statistics, Power, and Sample Size Calculations
  • Analysis of Variance and Covariance
  • Linear Regression
  • Complex Surveys & Sampling
  • Count Regression Models
  • Logistic Regression
  • Missing Data
  • Mixed and Multilevel Models
  • Principal Component Analysis and Factor Analysis
  • Structural Equation Modeling
  • Survival Analysis and Event History Analysis
  • Data Analysis Practice and Skills
  • R
  • SPSS
  • Stata

Copyright © 2008–2021 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.

SAVE & ACCEPT