Repeated Measures

Three Designs that Look Like Repeated Measures, But Aren’t

Repeated measures is one of those terms in statistics that sounds like it could apply to many situations. In fact, it describes only one specific situation.

A repeated measures design is one where each subject is measured repeatedly over time, space, or condition on the dependent variable.

These repeated measurements on the same subject are not independent of each other. They’re clustered. They are more correlated to each other than they are to responses from other subjects. Even if both subjects are in the same condition. [Read more…] about Three Designs that Look Like Repeated Measures, But Aren’t

Member Training: Elements of Experimental Design

by Karen Grace-Martin

Whether or not you run experiments, there are elements of experimental design that affect how you need to analyze many types of studies.

The most fundamental of these are replication, randomization, and blocking. These key design elements come up in studies under all sorts of names: trials, replicates, multi-level nesting, repeated measures. Any data set that requires mixed or multilevel models has some of these design elements. [Read more…] about Member Training: Elements of Experimental Design

What Is Regression to the Mean?

by Audrey Schnell Leave a Comment

by Audrey Schnell, PhD

Have you ever heard that “2 tall parents will have shorter children”?

This phenomenon, known as regression to the mean, has been used to explain everything from patterns in hereditary stature (as Galton first did in 1886) to why movie sequels or sophomore albums so often flop.

So just what is regression to the mean (RTM)? [Read more…] about What Is Regression to the Mean?

Can I Treat 5 Waves of Repeated Measurements as Categorical or Continuous?

by Karen Grace-Martin Leave a Comment

Question: Can you talk more about categorical and repeated Time? If I have 5 waves at ages 0, 1 year, 3 years, 5 years, and 9 years, would that be categorical or repeated? Does mixed account for different spacing in time?

Mixed models can account for different spacing in time and you’re right, it entirely depends on whether you treat Time as categorical or continuous.

First let me mention that not all designs can treat time as either categorical or continuous. The reason it could go either way in your example is because time is measured discretely, yet there are enough numerical values that you could fit a line to it. [Read more…] about Can I Treat 5 Waves of Repeated Measurements as Categorical or Continuous?

Six Differences Between Repeated Measures ANOVA and Linear Mixed Models

by Karen Grace-Martin 8 Comments

As mixed models are becoming more widespread, there is a lot of confusion about when to use these more flexible but complicated models and when to use the much simpler and easier-to-understand repeated measures ANOVA.

One thing that makes the decision harder is sometimes the results are exactly the same from the two models and sometimes the results are [Read more…] about Six Differences Between Repeated Measures ANOVA and Linear Mixed Models

Linear Mixed Models for Missing Data in Pre-Post Studies

by Karen Grace-Martin 5 Comments

In the past few months, I’ve gotten the same question from a few clients about using linear mixed models for repeated measures data. They want to take advantage of its ability to give unbiased results in the presence of missing data. In each case the study has two groups complete a pre-test and a post-test measure. Both of these have a lot of missing data.

The research question is whether the groups have different improvements in the dependent variable from pre to post test.

As a typical example, say you have a study with 160 participants.

90 of them completed both the pre and the post test.

Another 48 completed only the pretest and 22 completed only the post-test.

Repeated Measures ANOVA will deal with the missing data through listwise deletion. That means keeping only the 90 people with complete data. This causes problems with both power and bias, but bias is the bigger issue.

Another alternative is to use a Linear Mixed Model, which will use the full data set. This is an advantage, but it’s not as big of an advantage in this design as in other studies.

The mixed model will retain the 70 people who have data for only one time point. It will use the 48 people with pretest-only data along with the 90 people with full data to estimate the pretest mean.

Likewise, it will use the 22 people with posttest-only data along with the 90 people with full data to estimate the post-test mean.

If the data are missing at random, this will give you unbiased estimates of each of these means.

But most of the time in Pre-Post studies, the interest is in the change from pre to post across groups.

The difference in means from pre to post will be calculated based on the estimates at each time point. But the degrees of freedom for the difference will be based only on the number of subjects who have data at both time points.

So with only two time points, if the people with one time point are no different from those with full data (creating no bias), you’re not gaining anything by keeping those 72 people in the analysis.

Compare this to a study I also saw in consulting with 5 time points. Nearly all the participants had 4 out of the 5 observations. The missing data was pretty random–some participants missed time 1, others, time 4, etc. Only 6 people out of 150 had full data. Listwise deletion created a nightmare, leaving only 6 people in the data set.

Each person contributed data to 4 means, so each mean had a pretty reasonable sample size. Since the missingness was random, each mean was unbiased. Each subject fully contributed data and df to many of the mean comparisons.

With more than 2 time points and data that are missing at random, each subject can contribute to some change measurements. Keep that in mind the next time you design a study.