• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • Our Programs
    • Membership
    • Online Workshops
    • Free Webinars
    • Consulting Services
  • About
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Collaborate with Us
  • Statistical Resources
  • Contact
  • Blog
  • Login

Three Myths and Truths About Model Fit in Confirmatory Factor Analysis

by guest contributer 1 Comment

by Christos Giannoulis, PhD

We mentioned before that we use Confirmatory Factor Analysis to evaluate whether the relationships among the variables are adequately represented by the hypothesized factor structure. The factor structure (relationships between factors and variables) can be based on theoretical justification or previous findings.

Once we estimate the relationship indicators of those factors, the next task is to determine the extent to which these structure specifications are consistent with the data. The main question we are trying to answer is:

Is the model a good-fitting model?

In order to answer this question we need to first define what we mean by fitting a model.

Fit refers to the ability of a model to represent the data. Specifically, in CFA, a model fit refers to how closely observed data match the relationships specified in a hypothesized model.

The next step is to define what is a good-fitting model. This point is where things start to get interesting…

Researchers who are novice at confirmatory factor analysis techniques usually think that a good fitting model means a good model. In reality, this relationship is not straightforward.

A good-fitting model does not necessarily mean that this model is a good model.

For example, fit statistics cannot tell you whether you have specified the correct directions in a structural model or the correct number of factors (3, 4, etc.) in a measurement model. Fit statistics also say little about person–level fit, or the degree to which the model generates accurate predictions for individual cases.

So, what is a good-fitting model?

A good-fitting model is one that is reasonably consistent with the data.

That leads us to the next question that I usually get from novice researchers and analysts: Does a good-fitting model mean it is the best model? The answer most of the time is “no”.

A good-fitting model is not necessarily the best fitting model. A good-fitting model can still be improved. My advice is always to examine carefully the parameter estimates to determine if you have a reasonable model as well as a reasonable combination of evaluation criteria (i.e. fit-statistics).

There are more than a dozen different fit statistics researchers use to assess their Confirmatory Factor Analyses and Structural Equation Models. In this webinar, I explained the differences of those fit-statistics as well as the uses and abuses… in practice. In the Principal Component and Factor Analysis Workshop I delve into more on the types and uses of fit statistics.

My first advice to novice researchers and analysts who ask which fit statistic they should use, is to use a combination.

Instead of arguing which measure is the best, my second advice to novice researchers is to start by using evaluation criteria that are common to most software packages. This way you allow transparency and reproducibility of your results.

Lastly, I would like to leave you with the most intriguing myth in Confirmatory factor analysis if not in SEM overall. This myth is derived from this question

If we confirm that our model is consistent with the data, can we claim that our model is proven?

Well, the most that we can conclude in CFA is that the model is consistent with the data, but we cannot generally claim that our model is proven. Under this prism… CFA is a disconfirmatory procedure that can helps us reject false models (e.g. those with poor fit the data,) but it does not confirm the veracity of our model. Bollen (1998) puts it like this:

“If a model is consistent with reality, then the data should be consistent with the model. But if the data are consistent with the model, this does not imply that the model corresponds to reality.”

References:

Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

3 Overlooked Strengths of Structural Equation Modeling
Confirmatory factor analysis (CFA) and path models make up two core building blocks of SEM. Learn how these help you understand how SEM is used.

Tagged With: CFA, Confirmatory Factor Analysis, factor structure, fit statistics, Model Fit, SEM, Structural Equation Modeling

Related Posts

  • One of the Many Advantages to Running Confirmatory Factor Analysis with a Structural Equation Model
  • First Steps in Structural Equation Modeling: Confirmatory Factor Analysis
  • The Four Models You Meet in Structural Equation Modeling
  • Measurement Invariance and Multiple Group Analysis

Reader Interactions

Comments

  1. Abebe says

    July 29, 2020 at 9:17 am

    how many times can we make covariation among error variances to make good model fit? is there any rule about the possible number we make between error variances to get good model fit?

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • Member Training: Analyzing Pre-Post Data

Upcoming Free Webinars

Poisson and Negative Binomial Regression Models for Count Data

Upcoming Workshops

  • Analyzing Count Data: Poisson, Negative Binomial, and Other Essential Models (Jul 2022)
  • Introduction to Generalized Linear Mixed Models (Jul 2022)

Copyright © 2008–2022 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT