• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
The Analysis Factor

The Analysis Factor

Statistical Consulting, Resources, and Statistics Workshops for Researchers

  • Home
  • Our Programs
    • Membership
    • Online Workshops
    • Free Webinars
    • Consulting Services
  • About
    • Our Team
    • Our Core Values
    • Our Privacy Policy
    • Employment
    • Collaborate with Us
  • Statistical Resources
  • Contact
  • Blog
  • Login

distribution

What is Degrees of Freedom?

by Jeff Meyer 1 Comment

No, degrees of freedom is not “having one foot out the door”!

Definitions are rarely very good at explaining the meaning of something. At least not in statistics. Degrees of freedom: “the number of independent values or quantities which can be assigned to a statistical distribution”.

This is no exception.

[Read more…] about What is Degrees of Freedom?

Tagged With: degree of freedom, distribution, Intercept, parameter estimates, predictor variable

Related Posts

  • Member Training: Reporting Structural Equation Modeling Results
  • Member Training: Quantile Regression: Going Beyond the Mean
  • Should You Always Center a Predictor on the Mean?
  • The Distribution of Independent Variables in Regression Models

Member Training: Generalized Linear Models

by guest contributer Leave a Comment

In this webinar, we will provide an overview of generalized linear models. You may already be using them (perhaps without knowing it!).
For example, logistic regression is a type of generalized linear model that many people are already familiar with. Alternatively, maybe you’re not using them yet and you are just beginning to understand when they might be useful to you.
[Read more…] about Member Training: Generalized Linear Models

Tagged With: bayesian, distribution, error distribution, generalized linear models, GLM, linear model, linear regression, link function, logistic regression, maximum likelihood, mixed model, Poisson Regression

Related Posts

  • Member Training: Goodness of Fit Statistics
  • Member Training: Types of Regression Models and When to Use Them
  • Member Training: Matrix Algebra for Data Analysts: A Primer
  • Why Generalized Linear Models Have No Error Term

Member Training: Quantile Regression: Going Beyond the Mean

by guest contributer Leave a Comment

In your typical statistical work, chances are you have already used quantiles such as the median, 25th or 75th percentiles as descriptive statistics.

But did you know quantiles are also valuable in regression, where they can answer a broader set of research questions than standard linear regression?

In standard linear regression, the focus is on estimating the mean of a response variable given a set of predictor variables.

In quantile regression, we can go beyond the mean of the response variable. Instead we can understand how predictor variables predict (1) the entire distribution of the response variable or (2) one or more relevant features (e.g., center, spread, shape) of this distribution.

For example, quantile regression can help us understand not only how age predicts the mean or median income, but also how age predicts the 75th or 25th percentile of the income distribution.

Or we can see how the inter-quartile range — the width between the 75th and 25th percentile — is affected by age. Perhaps the range becomes wider as age increases, signaling that an increase in age is associated with an increase in income variability.

In this webinar, we will help you become familiar with the power and versatility of quantile regression by discussing topics such as:

  • Quantiles – a brief review of their computation, interpretation and uses;
  • Distinction between conditional and unconditional quantiles;
  • Formulation and estimation of conditional quantile regression models;
  • Interpretation of results produced by conditional quantile regression models;
  • Graphical displays for visualizing the results of conditional quantile regression models;
  • Inference and prediction for conditional quantile regression models;
  • Software options for fitting quantile regression models.

Join us on this webinar to understand how quantile regression can be used to expand the scope of research questions you can address with your data.


Note: This training is an exclusive benefit to members of the Statistically Speaking Membership Program and part of the Stat’s Amore Trainings Series. Each Stat’s Amore Training is approximately 90 minutes long.

[Read more…] about Member Training: Quantile Regression: Going Beyond the Mean

Tagged With: distribution, linear regression, percentile, predictor variable, predictors, quantile regression, quantiles, Regression

Related Posts

  • A Visual Description of Multicollinearity
  • Member Training: Mediated Moderation and Moderated Mediation
  • Member Training: Goodness of Fit Statistics
  • Member Training: Preparing to Use (and Interpret) a Linear Regression Model

The Distribution of Independent Variables in Regression Models

by Karen Grace-Martin 9 Comments

While there are a number of distributional assumptions in regression models, one distribution that has no assumptions is that of any predictor (i.e. independent) variables.

It’s because regression models are directional. In a correlation, there is no direction–Y and X are interchangeable. If you switched them, you’d get the same correlation coefficient.

But regression is inherently a model about the outcome variable. What predicts its value and how well? The nature of how predictors relate to it [Read more…] about The Distribution of Independent Variables in Regression Models

Tagged With: distribution, independent variable, Model Assumptions, predictor variable

Related Posts

  • The Distribution of Independent Variables in Regression Models
  • A Visual Description of Multicollinearity
  • A Strategy for Converting a Continuous to a Categorical Predictor
  • The Impact of Removing the Constant from a Regression Model: The Categorical Case

Checking Assumptions in ANOVA and Linear Regression Models: The Distribution of Dependent Variables

by Karen Grace-Martin 24 Comments

Here’s a little reminder for those of you checking assumptions in regression and ANOVA:

The assumptions of normality and homogeneity of variance for linear models are not about Y, the dependent variable.    (If you think I’m either stupid, crazy, or just plain nit-picking, read on.  This distinction really is important). [Read more…] about Checking Assumptions in ANOVA and Linear Regression Models: The Distribution of Dependent Variables

Tagged With: ANOVA, distribution, linear regression, Model Assumptions, normality, Q-Q plot, residuals

Related Posts

  • Member Training: The Multi-Faceted World of Residuals
  • Can Likert Scale Data ever be Continuous?
  • Same Statistical Models, Different (and Confusing) Output Terms
  • Why ANOVA is Really a Linear Regression, Despite the Difference in Notation

The Distribution of Independent Variables in Regression Models

by Karen Grace-Martin 27 Comments

I often hear concern about the non-normal distributions of independent variables in regression models, and I am here to ease your mind.

There are NO assumptions in any linear model about the distribution of the independent variables.  Yes, you only get meaningful parameter estimates from nominal (unordered categories) or numerical (continuous or discrete) independent variables.  But no, the model makes no assumptions about them.  They do not need to be normally distributed or continuous.

It is useful, however, to understand the distribution of predictor variables to find influential outliers or concentrated values.  A highly skewed independent variable may be made more symmetric with a transformation.

Tagged With: checking assumptions, distribution, independent variable, normality, predictor variable, regression models

Related Posts

  • The Distribution of Independent Variables in Regression Models
  • Eight Ways to Detect Multicollinearity
  • Likert Scale Items as Predictor Variables in Regression
  • Why report estimated marginal means?

Primary Sidebar

This Month’s Statistically Speaking Live Training

  • Member Training: Assumptions of Linear Models

Upcoming Free Webinars

The Pathway: Steps for Staying Out of the Weeds in any Data Analysis

Upcoming Workshops

  • Analyzing Count Data: Poisson, Negative Binomial, and Other Essential Models (Jul 2022)
  • Introduction to Generalized Linear Mixed Models (Jul 2022)

Copyright © 2008–2022 The Analysis Factor, LLC. All rights reserved.
877-272-8096   Contact Us

The Analysis Factor uses cookies to ensure that we give you the best experience of our website. If you continue we assume that you consent to receive cookies on all websites from The Analysis Factor.
Continue Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT