• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • About
    • Our Programs
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Guest Instructors
  • Membership
    • Statistically Speaking Membership Program
    • Login
  • Workshops
    • Online Workshops
    • Login
  • Consulting
    • Statistical Consulting Services
    • Login
  • Free Webinars
  • Contact
  • Login

Factor Analysis: A Short Introduction, Part 5–Dropping unimportant variables from your analysis

by guest 7 Comments

by Maike Rahn, PhD

When are factor loadings not strong enough?

Once you run a factor analysis and think you have some usable results, it’s time to eliminate variables that are not “strong” enough. They are usually the ones with low factor loadings, although additional criteria should be considered before taking out a variable.

As a rule of thumb, your variable should have a rotated factor loading of at least |0.4| (meaning ≥ +.4 or ≤ –.4) onto one of the factors in order to be considered important.

Some researchers use much more stringent criteria such as a cut-off of |0.7|. In some instances, this may not be realistic: for example, when the highest loading a researcher finds in her analysis is |0.5|.

Other researchers relax the criteria to the point where they include variables with factor loadings of |0.2|. Which cut-offs to use depends on whether you are running a confirmatory or exploratory factor analysis, and on what is usually considered an acceptable cut-off in your field. In addition, a variable should ideally only load cleanly onto one factor.

How many variables and observations?

Another question often asked is how many variables a researcher should use for analysis. Generally, each factor should have at least three variables with high loadings.

It is also important to have a sufficient number of observations to support your factor analysis: per variable you should ideally have about 20 observations in the data set to ensure stable results.  A common minimum is the lesser of 10 observations per variable and 100 observations.   However, some statisticians would go as low as five observations per variable .

About the Author: Maike Rahn is a health scientist with a strong background in data analysis.   Maike has a Ph.D. in Nutrition from Cornell University.
Bookmark and Share

Principal Component Analysis
Summarize common variation in many variables... into just a few. Learn the 5 steps to conduct a Principal Component Analysis and the ways it differs from Factor Analysis.

Tagged With: Factor Analysis, factor loadings

Related Posts

  • Factor Analysis: A Short Introduction, Part 1
  • How Big of a Sample Size do you need for Factor Analysis?
  • One of the Many Advantages to Running Confirmatory Factor Analysis with a Structural Equation Model
  • How to Reduce the Number of Variables to Analyze

Reader Interactions

Comments

  1. Tulay says

    December 29, 2020 at 6:39 am

    Hello I want to know what the maximum number of items in each factor in a scale?

    Reply
  2. Saquib Ahmed says

    July 8, 2019 at 2:08 am

    Dear Author
    Can you please give me any reference that supports retaining items with factor loading 0.2? I have an item with the highest factor loading 0.2, but I don’t want to delete any item. I also have 2 items for 1 factor, though I read that a minimum of 3 items is needed per factor. I have 25 items in my construct.
    Can you please help me in this regard?

    Reply
  3. Eias A says

    January 6, 2019 at 9:23 pm

    Dear Prof. Rahn,

    What if loadings generated 0.2 or even 0.1 or and I don’t want to delete them as I adopted them from literature?

    Reply
  4. Mohamed Zakeen says

    November 1, 2016 at 12:02 pm

    Imagine you had 42 variables for 6,000 observations. Imagine you ran a factor analysis on this dataset. Although you initially created 42 factors, a much smaller number of, say 4, uncorrelated factors might have been ‘retained’ under the criteria that the minimum eigenvalue be greater than 1 and the factor rotation will be orthogonal. As it turns out, the first factor has in eigenvalue of 8.5. Question: What does all that mean?

    Reply
  5. S. Caubet says

    December 18, 2014 at 5:27 pm

    Hi Professor Rahn,
    First of all thank you so much! I wish this resource were available when I was in graduate school.

    My question is about usig factor analysis for scale development to assess a set of skills taught in a workshop. We have 28 items and hypothesize 4 factors and we have 528 valid replies before the workshop and 109 for the post. We are still collecting data as this is an on-going curriculum.

    Would you advise that we run a separate factor analysis for the data we collect after the workshop for comparison? If so, what should we look for? I did look at some results (both exploratory and comfirmatory) for the after workshop data and there were some differences in the groupings of the factor loadings. I am wondering if this could be a real pre/post difference in latent variables or maybe there aren’t enough cases to be conclusive. Would a larger N bring more stable results? I suppose I should just try and see.

    I guess my real question is if this violates any research protocols.

    I should also mention that about 60% of the after workshop group also replied to the pre assessment so they are not truely independent samples.

    Thank you!
    Suzanne

    Reply
  6. suresh kumar says

    January 16, 2014 at 7:46 am

    Dear Prof Rahn,
    I would like to ask, how many variables minimum we need to run factor analysis? I saw some researchers use at least 15. Is it the rule of thumb?
    Or can we run factor analysis for less variables, per say less than 10?
    Thank you.

    Reply
    • Karen says

      January 20, 2014 at 11:06 am

      You can use fewer than 10. The rule of thumb is that you need at least 3 clean-loading variables for each factor. (Clean loading = simple structure).

      So if there is only one factor, you could technically use as few as 3 variables. However, it’s very common that at least one variable won’t load cleanly, so it’s always a good idea to have more variables to work with.

      Whether you have any control over this depends on whether you’re designing a scale or whether you’re working with an existing data set, or something in between.

      Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Please note that, due to the large number of comments submitted, any questions on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Primary Sidebar

Free Webinars

Effect Size Statistics on Tuesday, Feb 2nd

This Month’s Statistically Speaking Live Training

  • January Member Training: A Gentle Introduction To Random Slopes In Multilevel Models

Upcoming Workshops

  • Logistic Regression for Binary, Ordinal, and Multinomial Outcomes (May 2021)
  • Introduction to Generalized Linear Mixed Models (May 2021)

Read Our Book



Data Analysis with SPSS
(4th Edition)

by Stephen Sweet and
Karen Grace-Martin

Statistical Resources by Topic

  • Fundamental Statistics
  • Effect Size Statistics, Power, and Sample Size Calculations
  • Analysis of Variance and Covariance
  • Linear Regression
  • Complex Surveys & Sampling
  • Count Regression Models
  • Logistic Regression
  • Missing Data
  • Mixed and Multilevel Models
  • Principal Component Analysis and Factor Analysis
  • Structural Equation Modeling
  • Survival Analysis and Event History Analysis
  • Data Analysis Practice and Skills
  • R
  • SPSS
  • Stata

Copyright © 2008–2021 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.

Non-necessary

Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.