Some terms mean one thing in the English language, but have another (usually more specific) meaning in statistics. [Read more…] about Member Training: Confusing Statistical Terms
Odds is confusing in a different way than some of the other terms in this series.
First, it’s a bit of an abstract concept, which I’ll explain below.
But beyond that, it’s confusing because it is used in everyday English as a synonym for probability, but it’s actually a distinct technical term.
I found this incorrect definition recently in a (non-statistics) book: [Read more…] about Confusing Statistical Term #8: Odds
by Audrey Schnell
Odds Ratios and Relative Risks are often confused despite being unique concepts. Why?
Well, both measure association between a binary outcome variable and a continuous or binary predictor variable. [Read more…] about The Difference Between Relative Risk and Odds Ratios
One of the biggest challenges in learning statistics and data analysis is learning the lingo. It doesn’t help that half of the notation is in Greek (literally).
The terminology in statistics is particularly difficult to learn because often the same word or symbol is used to mean completely different concepts.
I know it feels that way, but it really isn’t a master plot by statisticians to keep researchers feeling ignorant.
It’s just that a lot of the methods in statistics were created by statisticians working in different fields–economics, psychology, and yes, straight statistics. Certain fields often have specific types of data that come up a lot and that require specific statistical methodologies to analyze.
Economics needs time series, psychology needs factor analysis. Et cetera, et cetera.
But separate fields developing statistics in isolation has some ugly effects.
Sometimes different fields develop the same technique, but use different names or notation.
Other times different fields use the same name or notation on different techniques they developed.
And of course, there are those terms with slightly different names, often used in similar contexts, but with different meanings. These are never used interchangeably, but they’re easy to confuse if you don’t use this stuff every day.
And sometimes, there are different terms for subtly different concepts, but people use them interchangeably. (I am guilty of this myself). It’s not a big deal if you understand those subtle differences. But if you don’t, it’s a mess.
And it’s not just fields–it’s software, too.
SPSS uses different names for the exact same thing in different procedures. In GLM, a continuous independent variable is called a Covariate. In Regression, it’s called an Independent Variable.
Likewise, SAS has a Repeated statement in its GLM, Genmod, and Mixed procedures. They all get at the same concept there (repeated measures), but they deal with it in drastically different ways.
So once the fields come together and realize they’re all doing the same thing, people in different fields or using different software procedures, are already used to using their terminology. So we’re stuck with different versions of the same word or method.
So anyway, I am beginning a series of blog posts to help clear this up. Hopefully it will be a good reference you can come back to when you get stuck.
We’ve expanded on this list with a member training, if you’re interested.
If you have good examples, please post them in the comments. I’ll do my best to clear things up.
Probability and odds measure the same thing: the likelihood or propensity of a specific outcome.
People use the terms odds and probability interchangeably in casual usage, but that is unfortunate. It just creates confusion because they are not equivalent.
They measure the same thing on different scales. Imagine how confusing it would be if people used degrees Celsius and degrees Fahrenheit interchangeably. “It’s going to be 35 degrees today” could really make you dress the wrong way.
In measuring the likelihood of any outcome, we need to know [Read more…] about Logistic Regression Analysis: Understanding Odds and Probability