• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • our programs
    • Membership
    • Online Workshops
    • Free Webinars
    • Consulting Services
  • statistical resources
  • blog
  • about
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Collaborate with Us
  • contact
  • login

OptinMon 15 - Principal Component Analysis

How Big of a Sample Size do you need for Factor Analysis?

by Karen Grace-Martin  2 Comments

Most of the time when we plan a sample size for a data set, it’s based on obtaining reasonable statistical power for a key analysis of that data set. These power calculations figure out how big a sample you need so that a certain width of a confidence interval or p-value will coincide with a scientifically meaningful effect size.

But that’s not the only issue in sample size, and not every statistical analysis uses p-values.

[Read more…] about How Big of a Sample Size do you need for Factor Analysis?

Tagged With: Factor Analysis, p-value, rules of thumb, sample size

Related Posts

  • Member Training: A Gentle Introduction to Bootstrapping
  • Member Training: Matrix Algebra for Data Analysts: A Primer
  • Measurement Invariance and Multiple Group Analysis
  • Why Adding Values on a Scale Can Lead to Measurement Error

How to Reduce the Number of Variables to Analyze

by Christos Giannoulis  1 Comment

by Christos Giannoulis

Many data sets contain well over a thousand variables. Such complexity, the speed of contemporary desktop computers, and the ease of use of statistical analysis packages can encourage ill-directed analysis.

It is easy to generate a vast array of poor ‘results’ by throwing everything into your software and waiting to see what turns up. [Read more…] about How to Reduce the Number of Variables to Analyze

Tagged With: common factor analysis, dependent variable, Factor Analysis, independent variable

Related Posts

  • How Big of a Sample Size do you need for Factor Analysis?
  • Life After Exploratory Factor Analysis: Estimating Internal Consistency
  • Four Common Misconceptions in Exploratory Factor Analysis
  • Can We Use PCA for Reducing Both Predictors and Response Variables?

Rescaling Sets of Variables to Be on the Same Scale

by guest contributer  11 Comments

by Christos Giannoulis, PhD

Attributes are often measured using multiple variables with different upper and lower limits. For example, we may have five measures of political orientation, each with a different range of values.

Each variable is measured in a different way. The measures have a different number of categories and the low and high scores on each measure are different.

[Read more…] about Rescaling Sets of Variables to Be on the Same Scale

Tagged With: data preparation, index variable, rescaling variables

Related Posts

  • Best Practices for Data Preparation
  • Preparing Data for Analysis is (more than) Half the Battle
  • Four Weeds of Data Analysis That are Easy to Get Lost In
  • Member Training: Determining Levels of Measurement: What Lies Beneath the Surface

Life After Exploratory Factor Analysis: Estimating Internal Consistency

by guest contributer  2 Comments

by Christos Giannoulis, PhD

After you are done with the odyssey of exploratory factor analysis (aka a reliable and valid instrument)…you may find yourself at the beginning of a journey rather than the ending.

The process of performing exploratory factor analysis usually seeks to answer whether a given set of items form a coherent factor (or often several factors). If you decide on the number and type of factors, the next step is to evaluate how well those factors are measured.

[Read more…] about Life After Exploratory Factor Analysis: Estimating Internal Consistency

Tagged With: Coefficient alpha, Cronbach's alpha, Exploratory Factor Analysis, Factor Analysis, latent variable, reliability, scale reliability

Related Posts

  • One of the Many Advantages to Running Confirmatory Factor Analysis with a Structural Equation Model
  • The Fundamental Difference Between Principal Component Analysis and Factor Analysis
  • Computing Cronbach’s Alpha in SPSS with Missing Data
  • Correlated Errors in Confirmatory Factor Analysis

Four Common Misconceptions in Exploratory Factor Analysis

by guest contributer  Leave a Comment

by Christos Giannoulis, PhD

Today, I would like to briefly describe four misconceptions that I feel are commonly perceived by novice researchers in Exploratory Factor Analysis:

Misconception 1: The choice between component and common factor extraction procedures is not so important.

In Principal Component Analysis, a set of variables is transformed into a smaller set of linear composites known as components. This method of analysis is essentially a method for data reduction.

[Read more…] about Four Common Misconceptions in Exploratory Factor Analysis

Tagged With: common factor analysis, communality, EFA, eigenvalue, Exploratory Factor Analysis, oblique rotation, orthogonal rotation, PCA, principal axis factor analysis, principal component analysis, rotation, sample size, simple structure

Related Posts

  • In Factor Analysis, How Do We Decide Whether to Have Rotated or Unrotated Factors?
  • Can You Use Principal Component Analysis with a Training Set Test Set Model?
  • In Principal Component Analysis, Can Loadings Be Negative?
  • How To Calculate an Index Score from a Factor Analysis

In Factor Analysis, How Do We Decide Whether to Have Rotated or Unrotated Factors?

by Karen Grace-Martin  1 Comment

I recently gave a free webinar on Principal Component Analysis. We had almost 300 researchers attend and didn’t get through all the questions. This is part of a series of answers to those questions.

If you missed it, you can get the webinar recording here.

Question: How do we decide whether to have rotated or unrotated factors?

Answer:

Great question. Of course, the answer depends on your situation.

When you retain only one factor in a solution, then rotation is irrelevant. In fact, most software won’t even print out rotated coefficients and they’re pretty meaningless in that situation.

But if you retain two or more factors, you need to rotate.

Unrotated factors are pretty difficult to interpret in that situation. [Read more…] about In Factor Analysis, How Do We Decide Whether to Have Rotated or Unrotated Factors?

Tagged With: coefficients, factor, PCA, principal component analysis, rotated, rotation, unrotated

Related Posts

  • Four Common Misconceptions in Exploratory Factor Analysis
  • In Principal Component Analysis, Can Loadings Be Negative?
  • How To Calculate an Index Score from a Factor Analysis
  • Can You Use Principal Component Analysis with a Training Set Test Set Model?

  • Go to page 1
  • Go to page 2
  • Go to page 3
  • Go to page 4
  • Go to Next Page »

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • Member Training: The Link Between ANOVA and Regression

Upcoming Workshops

    No Events

Upcoming Free Webinars

TBA

Quick links

Our Programs Statistical Resources Blog/News About Contact Log in

Contact

Upcoming

Free Webinars Membership Trainings Workshops

Privacy Policy

Search

Copyright © 2008–2023 The Analysis Factor, LLC.
All rights reserved.

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT