Examples for Writing up Results of Mixed Models

One question I always get in my Repeated Measures Workshop is:

“Okay, now that I understand how to run a linear mixed model for my study, how do I write up the results?”

This is a great question.

There are many pieces of the linear mixed models output that are identical to those of any linear model–regression coefficients, F tests, means.

But there is also a lot that is new, like intraclass correlations and information criteria.  And a lot of output we’re used to seeing, like R squared, isn’t there anymore.

And because the model is more complicated, you may need to include in your paper more information about how you set up the model.  For example, you usually need to say whether you included a random intercept or slope (and at which level) and which covariance structure you chose for the residuals.

The problem I have in answering this is how you write it up is very much dependent on who you’re writing for.

Writing for Journals and Committees

The first thing to consider is your field and how familiar readers from your field will be with mixed models.  I’ve worked with clients whose reviewers had never heard of them.

If you’re in a field like this, one of two things will happen.

1. reviewers will be suspicious that you were making up some hocus-pocus statistics to get significant p-values.  Or

2. reviewers will have no idea what you’re talking about and can’t evaluate what you’ve done.  Furthermore, they’ll insist you report statistics that aren’t available in mixed models, like eta-squared.

If that’s your situation, you’re going to have to write it up with a bit more detail than you otherwise would.  Confused reviewers won’t be inclined to accept your paper.  Educate your readers about the methods.  Explain not just what you did, but why it was necessary.

Be generous with citations of not only papers that used mixed models but also those that explain what they are.

If you’re in a field where mixed models are more familiar and most readers will understand them, you’ll need to give enough detail that someone who understands mixed models could evaluate the approach.  This means you will need to say which random effects you included and which covariance structure you chose.  But you won’t have to explain what a random effect does.

Writing for non-statistical audiences

What if your audience isn’t a research audience, but your company’s marketing managers or your agency’s clinical staff?  They likely never needed statistics classes and have no understanding at all of what you’re doing. They just want to understand whether the intervention worked and they’re counting on you to know what you’re doing statistically.

In that case, you want to eliminate as much statistical jargon as possible.  Do everything you can to explain anything you can in English.  You can always put the statistical details in an appendix in case some future researcher comes across it.

They may understand “I used a linear mixed model because it accounts for the fact that multiple responses from the same person are more similar than responses from other people.”  But they won’t want to know how or why this is true.

Use a model

The ideal situation is to use as a guide a published paper that used the same type of mixed model in the journal you’re submitting to.

I can’t usually supply that to researchers, because I work with so many in different fields.

So I thought I’d try this.  Here is a list of a few papers I’ve worked on personally that used mixed models.

Feel free to look them up, in case it helps.

• Catriona M Steele, Gemma L Bailey, Sonja M Molfenter, Erin M Yeates, Karen Grace-Martin. (2010). Pressure profile similarities between tongue resistance training tasks and liquid swallows.  The Journal of Rehabilitation Research and Development, 47(7):651-60.

• Susan Butler, Karen Grace-Martin. (2010). The Effect of Chemesthesis on Swallowing Apnea Duration.  Otolaryngology-Head and Neck Surgery, 143(2).

One other suggestion I’ve found helpful.  Try googling:

Type that in exactly, with the quotes, but replace the word field with whatever your field is: nursing, sociology, etc.  You will be surprised what you may find.

My request to you

If you have worked on or know of a paper that used mixed models, please give us the reference in the comments.  Links to online versions are great too, if you have one.

Trust me, many people in your field are looking for an example and will be happy to cite it.

Fixed and Random Factors in Mixed Models

One of the hardest parts of mixed models is understanding which factors to make fixed and which to make random. Learn the important criteria to help you decide.

Take Me to The Video!

Tagged as: Mixed Models, Writing Results