Error Tight: Exercises for Lab Groups to Prevent Research Mistakes

Abstract

No one is immune from making mistakes. In research, mistakes might include things like analyzing raw data instead of cleaned data, reversing variable labels, transcribing information incorrectly, or inadvertently saving over a file. The consequences of these kinds of mistakes can range from minor annoyances like wasted time and resources to major issues such as retraction of a paper. Mistakes can happen under any circumstances, but their occurrence may be amplified by the incentive structure of science which rewards rapid, prolific publication rather than slow, methodological, and systematic work. The purpose of this project is to provide hands-on exercises for lab groups to identify places in their research workflow where errors may occur and pinpoint ways to address them. The appropriate approach for a given lab will vary depending on the kind of research they do, their tools, the nature of the data they work with, and many other factors. Therefore, this project does not provide a set of one-size-fits-all guidelines, but rather is intended to be an exercise in self-reflection for researchers and provide resources for solutions that are well-suited to them.

Evaluating the effects of a programming error on a virtual environment measure of spatial navigation behavior.

“…We are not alone in making these suggestions and refer the reader to other more in depth resources (Hutson, 2010; J. Strand, 2020; Wilson et al, 2014).…”

“…There are four suggestions we offer to any researcher wishing to reduce the chance of a high impact error. We are not alone in making these suggestions and refer the reader to other more in depth resources (Hutson, 2010;J. Strand, 2020;Wilson et al, 2014).…”

Open and reproducible neuroimaging: from study inception to publication

“…When the project moves from proposal to implementation, these descriptions are translated into concrete protocols and stimuli, a process that can be streamlined by the incorporation of open procedures and comprehensive piloting. The promise is that the more preparation and piloting is conducted prior to data collection, the more likely it is that the project will be successful: that analyses of its data can contribute to answering its motivating ideas and questions (Strand 2021).…”

Lab manuals for efficient and high quality science in a happy and safe work environment

“…While research mistakes in life and social sciences rarely carry similar risks, they can influence the efficiency, reproducibility, and validity of our research work (Kovacs et al, 2021) or even influence policies that build on such results (Herndon et al, 2014). Mistakes due to human error inevitably happen: but their frequency and impact can be lessened with a well-structured system designed for their prevention (Strand, 2021). Ultimately, it is the lab members' responsibility to design and follow a research workflow that leads to quality results.…”

“…Creating a lab manual can be a place for reflection where the members think through how research is done within the lab from the formation of an idea to the publication of the results. Through this exercise, many redundant or error-prone practices can be discovered, and systematic changes can be made to prevent them in the future (Strand, 2021). Moreover, hard-learned lessons through mistakes can be recorded in the manual so that it is less likely that they will happen again in the future.…”