This is a guide for anyone who needs to share data with a statistician. The target audiences I have in mind are:
-Scientific collaborators who need statisticians to analyze data for them
-Students or postdocs in scientific disciplines looking for consulting advice
-Junior statistics students whose job it is to collate/clean data sets
The goals of this guide are to provide some instruction on the best way to share data to avoid the most common pitfalls and sources of delay in the transition from data collection to data analysis. The Leek group works with a large number of collaborators and the number one source of variation in the speed to results is the status of the data when they arrive at the Leek group. Based on my conversations with other statisticians this is true nearly universally.
My strong feeling is that statisticians should be able to handle the data in whatever state they arrive. It is important to see the raw data, understand the steps in the processing pipeline, and be able to incorporate hidden sources of variability in one’s data analysis. On the other hand, for many data types, the processing steps are well documented and standardized. So the work of converting the data from raw form to directly analyzable form can be performed before calling on a statistician. This can dramatically speed the turnaround time, since the statistician doesn’t have to work through all the pre-processing steps first.
What you should deliver to the statistician ‘[…]
Read guide
Contributors
Jeff Leek – Wrote the initial version.
L. Collado-Torres – Fixed typos, added links.
Nick Reich – Added tips on storing data as text.
Source: https://github.com