A great tool to have in your statistical tool belt is logistic regression.
It comes in many varieties and many of us are familiar with the variety for binary outcomes.
But multinomial and ordinal varieties of logistic regression are also incredibly useful and worth knowing.
They can be tricky to decide between in practice, however. In some — but not all — situations you could use either.
So let’s look at how they differ, when you might want to use one or the other, and how to decide.
Both multinomial and ordinal models are used for categorical outcomes with more than two categories.
The simplest decision criterion is whether that outcome is nominal (i.e., no ordering to the categories) or ordinal (i.e., the categories have an order).
It should be that simple.
Here’s why it isn’t:
1. While there is only one logistic regression model appropriate for nominal outcomes, there are quite a few for ordinal outcomes.
These models account for the ordering of the outcome categories in different ways. Most software, however, offers you only one model for nominal and one for ordinal outcomes.
2. The most common of these models for ordinal outcomes is the proportional odds model. It has a strong assumption with two names — the proportional odds assumption or parallel lines assumption.
It essentially means that the predictors have the same effect on the odds of moving to a higher-order category everywhere along the scale.
The problem?
This assumption is rarely met in real data, yet is a requirement for the only ordinal model available in most software.
3. If you have a nominal outcome variable, it never makes sense to choose an ordinal model. Your results would be gibberish and you’ll be violating assumptions all over the place.
(That makes one choice simple!)
In contrast, you can run a nominal model for an ordinal variable and not violate any assumptions. But you may not be answering the research question you’re really interested in if it incorporates the ordering.
4. The names. Most software refers to a model for an ordinal variable as an ordinal logistic regression (which makes sense, but isn’t specific enough).
In contrast, they will call a model for a nominal variable a multinomial logistic regression (wait – what?).
It gets better.
Some software procedures require you to specify the distribution for the outcome and the link function, not the type of model you want to run for that outcome. Both ordinal and nominal variables, as it turns out, have multinomial distributions.
What differentiates them is the version of logit link function they use. So if you don’t specify that part correctly, you may not realize you’re actually running a model that assumes an ordinal outcome on a nominal outcome. Not good.
A link function with a name like “mlogit,” “multinomial logit,” or “generalized logit” assumes no ordering.
A link function with a name like “clogit” or “cumulative logit” assumes ordering, so only use this if your outcome really is ordinal.
Confusing, right?
If you have a nominal outcome, make sure you’re not running an ordinal model.
If you have an ordinal outcome and the proportional odds assumption is met, you can run the cumulative logit version of ordinal logistic regression.
If you have an ordinal outcome and your proportional odds assumption isn’t met, you can:
1. Run a different ordinal model
2. Run a nominal model as long as it still answers your research question
Hi,
When do we make dummy variables? Is it done only in multiple logistic regression or we have to make it in binary logistic regression also?
Whenever you have a categorical variable in a regression model, whether it’s a predictor or response variable, you need some sort of coding scheme for the categories. The 1/0 coding of the categories in binary logistic regression is dummy coding, yes.
Question?
so I think my data fits the ordinal logistic regression due to nominal and ordinal data. My predictor variable is a construct (X) with is comprised of 3 subscales (x1+x2+x3= X) and is which to run the analysis based on “hierarchical/stepwise” theoretical regression framework.
Should I run “3” independent regression analyses with each of the 3 subscales ( of my construct) or run just one analysis (“X” with 3 levels) and still use a hierarchical/stepwise , theoretical regression approach with ordinal log regression?
Hi George,
That is actually not a simple question. There isn’t one right way. It depends on too many issues, including the exact research question you are asking. I would suggest this webinar for more info on how to approach a question like this: https://thecraftofstatisticalanalysis.com/cosa-description-page-four-key-questions/
Hi there. This was very helpful. But let’s say that you have a variable with the following outcomes: Almost always, Most of the time, Some of the time, Rarely, Never, Don’t Know, and Refused. These 6 categories can be reduce to 4 however I am not sure if there is an order or not because “Don’t know” and “refused” is confusing to me. Thoughts?
It always depends on the research questions you are trying to answer but apparently “Don’t Know” and “Refused” seem to have very different meanings. In case you might want to group them as “No information gained”, you would definitely be able to consider the groupings as ordinal.
Hi,
Let’s say the outcome is three states: State 0, State 1 and State 2. How about a situation where the sample go through State 0, State 1 and 2 but can also go from State 0 to state 2 or State 2 to State 1? While you consider this as ordered or unordered?
Hi Stephen,
This is an example where you have to decide if there really is an order. It can depend on exactly what it is you’re measuring about these states.