The Analysis Factor
Statistical Consulting, Resources, and Statistics Workshops for Researchers
For nearly a hundred years the concept of “statistical significance” has been fundamental to statistics and to science. And for nearly that long, it has been controversial and misused as well. [Read more…] about Member Training: Moving to a World Beyond p<0.05
Statistical inference using hypothesis testing is ubiquitous in science. Several misconceptions and misinterpretations of p-values have arisen over the years, which can lead to challenges communicating the correct interpretation of results.
[Read more…] about Member Training: Inference and p-values and Statistical Significance, Oh My!
Any sample-based findings used to generalize a population are subject to sampling error. In other words, sample statistics won’t exactly match the population parameters they estimate.
[Read more…] about Should Confidence Intervals or Tests of Significance be Used?
Many of us love performing statistical analyses but hate writing them up in the Results section of the manuscript. We struggle with big-picture issues (What should I include? In what order?) as well as minutia (Do tables have to be double-spaced?). [Read more…] about Member Training: Writing Up Statistical Results: Basic Concepts and Best Practices
Last week I had the pleasure of teaching a webinar on Interpreting Regression Coefficients. We walked through the output of a somewhat tricky regression model—it included two dummy-coded categorical variables, a covariate, and a few interactions.
As always seems to happen, our audience asked an amazing number of great questions. (Seriously, I’ve had multiple guest instructors compliment me on our audience and their thoughtful questions.)
We had so many that although I spent about 40 minutes answering [Read more…] about Your Questions Answered from the Interpreting Regression Coefficients Webinar
After all, with the typical Type I error rate of 5% used in most tests, we are allowing ourselves to “get lucky” 1 in 20 times for each test. When you figure out the probability of Type I error across all the tests, that probability skyrockets.
[Read more…] about Member Training: Adjustments for Multiple Testing: When and How to Handle Multiplicity