March 2016 Member Webinar: Inter-Rater Reliability

by guest

In many fields, the only way to measure a construct of interest is to have someone produce ratings:

  • radiologists’ ratings of disease presence or absence on an X-ray
  • researchers rate the amount of bullying occurring in an observed classroom
  • coders sort qualitative responses into different response categories

It’s well established in research that multiple raters need to rate the same stimuli to ensure ratings are accurate.  There are a number of ways to measure the agreement among raters using measures of reliability. These differ depending on a host of details, including: the number of raters; whether ratings are nominal, ordinal, or numerical; and whether one rating can be considered a “Gold Standard.”

In this webinar, we will discuss these and other issues in measures of inter and intra rater reliability, the many variations of the Kappa statistic, and Intraclass correlations.


Note: This webinar is an exclusive benefit for members of the Statistically Speaking Membership Program.

About the Instructor

Audrey Schnell is a statistical consultant and trainer at The Analysis Factor.

Audrey first realized her love for research and, in particular, data analysis in a career move from clinical psychology to research in dementia. As the field of genetic epidemiology and statistical genetics blossomed, Audrey moved into this emerging field and analyzed data on a wide variety of common diseases believed to have a strong genetic component including hypertension, diabetes and psychiatric disorders. She helped develop software to analyze genetic data and taught classes in the US and Europe.

Audrey has worked for Case Western Reserve University, Cedars-Sinai, University of California at San Francisco and Johns Hopkins. Audrey has a Master’s Degree in Clinical Psychology and a Ph.D. in Epidemiology and Biostatistics.

Not a Member Yet?

It’s never too late to join the hottest stats club around.

Just head over to our enrollment page to sign up for Statistically Speaking.

You’ll get exclusive access to this month’s webinar live, weekly live Q&A sessions, a private stats forum, 60+ recordings of past webinars (including this one), and more.

Leave a Comment

Please note that, due to the large number of comments submitted, any comments on problems related to a personal study/project will not be answered. We suggest joining Statistically Speaking, where you have access to a private forum and more resources 24/7.

Previous post:

Next post: