• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • About
    • Our Programs
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Guest Instructors
  • Membership
    • Statistically Speaking Membership Program
    • Login
  • Workshops
    • Online Workshops
    • Login
  • Consulting
    • Statistical Consulting Services
    • Login
  • Free Webinars
  • Contact
  • Login

First Steps in Structural Equation Modeling: Confirmatory Factor Analysis

by Jeff Meyer 4 Comments

Confirmatory factor analysis (CFA) is the fundamental first step in running most types of SEM models. You want to do this first to verify the measurement quality of any and all latent constructs you’re using in your structural equation model.

The term “regression” is an umbrella for numerous statistical methods. These methods explore the relationship between an outcome variable and predictor variables. Examples of statistical analyses found under the regression umbrella are linear, logistic, Cox, and multilevel regression. 

Structural equation modeling (SEM) is an umbrella, too. It contains numerous techniques for analyzing data. Examples of statistical analyses found under the SEM umbrella are confirmatory factor analysis (CFA), multi-group CFA, regression with latent variable outcomes and/or latent predictors, as well as latent growth models for longitudinal analysis.

The Measurement Model

As I said, CFA is the fundamental first step in running most types of SEM models, and you want to do this first to verify the measurement quality of any and all latent constructs you’re using in your structural equation model.

A latent construct (also known as a factor or scale) is a variable that cannot directly be measured. It is measured by a set of observable variables (indicators) that are weighted based on their variance/covariance structure.

It is a misconception that you can simply measure a latent construct by averaging its indicators. Conceptually, that implies every indicator influences the strength of the latent construct equally.

Another misconception is that a latent construct that has been verified by previous research need not be tested again. We need to remind ourselves that samples from the same population are seldom identical. You can’t assume that all samples taken from the population are equivalent.  

As a result, your first step is to verify the viability of any latent constructs (known as the measurement model) before using them as independent and/or dependent variables in a structural equation model.

How do we verify the viability of the latent construct? There are a series of steps to take.

Steps in a Confirmatory Factor Analysis

The first step is to calculate the factor loadings of the indicators (observed variables) that make up the latent construct. The standardized factor loading squared is the estimate of the amount of the variance of the indicator that is accounted for by the latent construct. 

Many fields of study are comfortable with loadings of 0.4 or higher. Beware that reviewers might require loadings of 0.5 or higher. 

The variance that is not explained by the latent construct is known as the unique variance (a.k.a. error variance or indicator unreliability). If justifiable, the error variances of indicators within the construct can be correlated. (This is also called correlated uniquenesses, error covariances, and correlated residuals.)

Creating this CFA measurement model lets you check convergent validity of your construct. Convergent validity is indicated by high indicator loadings, which shows the strength of how well the indicators are theoretically similar.

Most SEM models contain more than one factor. If that’s your situation, run a CFA for all of the model’s latent constructs within one measurement model. This allows you to check discriminant validity. Discriminant validity exists when no two constructs are highly correlated. If two constructs are highly correlated (greater than 0.85), explore combining the constructs.

One of the final steps for reviewing the measurement model is to run goodness of fit statistics. Goodness of fit statistics test for absolute, parsimonious, and incremental goodness of fit.

Absolute fit statistics (model chi-square, SRMR) examine the data’s observed variance/covariance matrix versus the model implied variance/covariance matrix. Parsimonious fit statistics (RMSEA, AGFI) penalize for overly complex structures. Incremental fit statistics (CFI, NFI) examine the target versus the baseline models.

Confirmatory factor analysis for all constructs is an important first step before developing a structural equation model.

Jeff Meyer is a statistical consultant with The Analysis Factor, a stats mentor for Statistically Speaking membership, and a workshop instructor. Read more about Jeff here.

3 Overlooked Strengths of Structural Equation Modeling
Confirmatory factor analysis (CFA) and path models make up two core building blocks of SEM. Learn how these help you understand how SEM is used.

Tagged With: CFA, Confirmatory Factor Analysis, latent construct, Latent Growth Curve Model, latent variable, SEM, Structural Equation Modeling

Related Posts

  • One of the Many Advantages to Running Confirmatory Factor Analysis with a Structural Equation Model
  • Member Training: Reporting Structural Equation Modeling Results
  • The Four Models You Meet in Structural Equation Modeling
  • Three Myths and Truths About Model Fit in Confirmatory Factor Analysis

Reader Interactions

Comments

  1. Mutume Vivalya says

    February 25, 2020 at 7:35 am

    Can I get Martin’s book of data analysis?

    Reply
  2. Dr. William Johnson says

    February 7, 2020 at 2:03 pm

    2/7/2020 1 p.m. CST
    I own two of Drs. Sweet and Karen GraceMartin’s books.
    I will testify that their books are excellent references.
    Does the Data Analysis ..Applied Statistics (4th Edition)
    cover Structural Equation Modeling: Confirmatory
    Factor Analysis? In the ads, I’ve not see a topical index
    of the content. Thank you!
    Dr. William Johnson, TX.

    Reply
    • Karen Grace-Martin says

      February 10, 2020 at 3:08 pm

      Hi William,

      Thanks for the kind words.

      The book doesn’t cover Structural Equation Modeling or Confirmatory Factor Analysis. Those are both pretty high-level topics and the book is aimed at introductory students.

      I’m a little surprised the publisher doesn’t give the list of topics. I’ll have to get you the full list, but it does include linear regression and logistic regression, in addition to fundamentals of statistics and spss.

      Reply
  3. Cago Lamerda says

    February 7, 2020 at 10:41 am

    That’s so cool,

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Primary Sidebar

Free Webinars

Binary, Ordinal, and Multinomial Logistic Regression for Categorical Outcomes (Signup)

This Month’s Statistically Speaking Live Training

  • April Member Training: Statistical Contrasts

Upcoming Workshops

  • Logistic Regression for Binary, Ordinal, and Multinomial Outcomes (May 2021)
  • Introduction to Generalized Linear Mixed Models (May 2021)

Read Our Book



Data Analysis with SPSS
(4th Edition)

by Stephen Sweet and
Karen Grace-Martin

Statistical Resources by Topic

  • Fundamental Statistics
  • Effect Size Statistics, Power, and Sample Size Calculations
  • Analysis of Variance and Covariance
  • Linear Regression
  • Complex Surveys & Sampling
  • Count Regression Models
  • Logistic Regression
  • Missing Data
  • Mixed and Multilevel Models
  • Principal Component Analysis and Factor Analysis
  • Structural Equation Modeling
  • Survival Analysis and Event History Analysis
  • Data Analysis Practice and Skills
  • R
  • SPSS
  • Stata

Copyright © 2008–2021 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.

SAVE & ACCEPT