Data Cleaning is a critically important part of any data analysis. Without properly prepared data, the analysis will yield inaccurate results. Correcting errors later in the analysis adds to the time, effort, and cost of the project.
Data Preparation
Eight Data Analysis Skills Every Analyst Needs
It’s easy to think that if you just knew statistics better, data analysis wouldn’t be so hard.
It’s true that more statistical knowledge is always helpful. But I’ve found that statistical knowledge is only part of the story.
Another key part is developing data analysis skills. These skills apply to all analyses. It doesn’t matter which statistical method or software you’re using. So even if you never need any statistical analysis harder than a t-test, developing these skills will make your job easier.
[Read more…] about Eight Data Analysis Skills Every Analyst Needs
Recoding a Variable from a Survey Question to Use in a Statistical Model
Survey questions are often structured without regard for ease of use within a statistical model.
Take for example a survey done by the Centers for Disease Control (CDC) regarding child births in the U.S. One of the variables in the data set is “interval since last pregnancy”. Here is a histogram of the results.
[Read more…] about Recoding a Variable from a Survey Question to Use in a Statistical Model
Member Training: Determining Levels of Measurement: What Lies Beneath the Surface
You probably learned about the four levels of measurement in your very first statistics class: nominal, ordinal, interval, and ratio.
Knowing the level of measurement of a variable is crucial when working out how to analyze the variable. Failing to correctly match the statistical method to a variable’s level of measurement leads either to nonsense or to misleading results.
But the simple framework of the four levels is too simplistic in most real-world data analysis situations.
[Read more…] about Member Training: Determining Levels of Measurement: What Lies Beneath the Surface
Rescaling Sets of Variables to Be on the Same Scale
by Christos Giannoulis, PhD
Attributes are often measured using multiple variables with different upper and lower limits. For example, we may have five measures of political orientation, each with a different range of values.
Each variable is measured in a different way. The measures have a different number of categories and the low and high scores on each measure are different.
[Read more…] about Rescaling Sets of Variables to Be on the Same Scale
Member Training: A Data Analyst’s Guide to Methods and Tools for Reproducible Research
Have you ever experienced befuddlement when you dust off a data analysis that you ran six months ago? 
Ever gritted your teeth when your collaborator invalidates all your hard work by telling you that the data set you were working on had “a few minor changes”?
Or panicked when someone running a big meta-analysis asks you to share your data?
If any of these experiences rings true to you, then you need to adopt the philosophy of reproducible research.