linear regression

Same Statistical Models, Different (and Confusing) Output Terms

Learning how to analyze data can be frustrating at times. Why do statistical software companies have to add to our confusion?

I do not have a good answer to that question. What I will do is show examples. In upcoming blog posts, I will explain what each output means and how they are used in a model.

We will focus on ANOVA and linear regression models using SPSS and Stata software. As you will see, the biggest differences are not across software, but across procedures in the same software.

A Visual Description of Multicollinearity

by Karen Grace-Martin 2 Comments

Multicollinearity is one of those terms in statistics that is often defined in one of two ways:

1. Very mathematical terms that make no sense — I mean, what is a linear combination anyway?

2. Completely oversimplified in order to avoid the mathematical terms — it’s a high correlation, right?

So what is it really? In English?

Linear Regression for an Outcome Variable with Boundaries

by Karen Grace-Martin 4 Comments

The following statement might surprise you, but it’s true.

To run a linear model, you don’t need an outcome variable Y that’s normally distributed. Instead, you need a dependent variable that is:

Continuous
Unbounded
Measured on an interval or ratio scale

The normality assumption is about the errors in the model, which have the same distribution as Y|X. It’s absolutely possible to have a skewed distribution of Y and a normal distribution of errors because of the effect of X. [Read more…] about Linear Regression for an Outcome Variable with Boundaries

Member Training: A Predictive Modeling Primer: Regression and Beyond

by guest

Predicting future outcomes, the next steps in a process, or the best choice(s) from an array of possibilities are all essential needs in many fields. The predictive model is used as a decision making tool in advertising and marketing, meteorology, economics, insurance, health care, engineering, and would probably be useful in your work too! [Read more…] about Member Training: A Predictive Modeling Primer: Regression and Beyond

Eight Ways to Detect Multicollinearity

by Karen Grace-Martin 4 Comments

Multicollinearity can affect any regression model with more than one predictor. It occurs when two or more predictor variables overlap so much in what they measure that their effects are indistinguishable.

When the model tries to estimate their unique effects, it goes wonky (yes, that’s a technical term).

So for example, you may be interested in understanding the separate effects of altitude and temperature on the growth of a certain species of mountain tree.

Member Training: Generalized Linear Models

by guest Leave a Comment

In this webinar, we will provide an overview of generalized linear models. You may already be using them (perhaps without knowing it!).

For example, logistic regression is a type of generalized linear model that many people are already familiar with. Alternatively, maybe you’re not using them yet and you are just beginning to understand when they might be useful to you.

[Read more…]