Editorial Volume 121 | Issue 11-12 | Nov-Dec 2013
Environ Health Perspect; DOI:10.1289/ehp.1307676
Reporting of Results from Animal Studies
Hugh A. Tilson1 and Jane C. Schroeder2
1Editor-in-Chief, Environmental Health Perspectives, email@example.com; 2Science Editor, Environmental Health Perspectives, firstname.lastname@example.org
Citation: Tilson HA, Schroeder JC. 2013. Reporting of results from animal studies [Editorial]. Environ Health Perspect 121:A320–A321; http://dx.doi.org/10.1289/ehp.1307676
The authors declare they have no actual or potential competing financial interests.
Published: 27 November 2013
One of the key elements of the scientific process is reproducibility: Experimental results generated in one laboratory must be reproducible by others working independently. Therefore, it is of concern to us as editors of a major scientific journal to learn that only 6 of 53 “landmark” preclinical cancer studies could be reproduced (Begley and Ellis 2012). In addition, Prinz et al. (2011) reported that almost two-thirds of 67 in-house preclinical cancer projects did not replicate data previously published by others. These observations are based on preclinical cancer studies, and it is not known how pervasive this problem may be in other disciplines, including environmental health research.
Vasilevsky et al. (2013) pointed out that the reproducibility of scientific research depends in large measure on whether the “materials and methods” of a paper are described such that other investigators are able to independently replicate effects observed in the original study. Unfortunately, the degree to which sufficient methodological details are provided can be problematic. For example, Kilkenny et al. (2009) published the results of a systematic review of original in vivo research involving laboratory animals. Of the 271 papers they evaluated, only 60% provided information about the number of animals used or described in detail the species, strain, sex, age, or weight of the animals. The authors also noted that about 30% of the papers lacked sufficient details concerning the statistical analyses. Findings such as these indicate that the lack of methodological detail could be a major barrier to subsequent attempts to replicate the work of others.
According to Ransohoff and Gourlay (2010), “any study’s reliability is determined by [the] investigators’ choices about critical details of research design and conduct.” Some choices could lead to bias or the “systematic erroneous association of some characteristic with a group in a way that distorts a comparison with another group” (Ransohoff 2005). Key approaches to reduce bias include the randomization of groups and blinding (Krauth et al. 2013). However, randomization and blinding are not used universally in preclinical research. Van der Worp et al. (2005) reported that fewer than half of the 45 preclinical studies they reviewed included randomization of treatment, blinded administration of treatment, and blinded outcome evaluation. In addition, Kilkenny et al. (2009) found that most papers they surveyed did not use randomization or blinding.
Addressing concerns about the reproducibility of research findings will require cooperation and collaboration from major segments of the scientific community. From our perspective, it seems clear that many authors are not sufficiently trained in experimental design or the importance of controlling for sources of bias in their studies. We believe that courses on the principles of experimental design should be included at the graduate level. Many academic departments and governmental institutions now require students and employees to take courses on ethics. We believe that it is equally important to train students and young investigators about experimental design and how to be transparent in reporting their results in the peer-reviewed literature. In addition, we believe that it is important for study sections and funding agencies to critically evaluate experimental designs described in grant proposals under consideration. Finally, journals can be more proactive by insisting that critical methodological details be included in papers submitted for possible publication. Associate editors and reviewers need to be instructed to consider experimental design as part of the peer-review process.
Kilkenny et al. (2010) suggested that the scientific community would benefit from guidance about the information needed in a research article. As an example, they describe the CONSORT Statement for randomized clinical trials (Moher et al. 2001). Many journals have endorsed the CONSORT guidelines, and there is some evidence that use of these guidelines has improved the quality of papers on clinical trials (Kane et al. 2007).
In June 2009, an expert working group consisting of researchers, statisticians, and journal editors met to develop a checklist that could be used improve the reporting of research using animals (Kilkenny et al. 2010). The product of this effort is the Animal Research: Reporting of In Vivo Experiments (ARRIVE) guidelines (http://www.nc3rs.org.uk/ARRIVE). These guidelines consist of 20 items identifying minimum information required for scientific research reporting results from animal studies. According to Kilkenny et al. (2010), the guidelines were developed “to maximise the output from research using animals by optimising the information that is provided in publications on the design, conduct, and analysis of the experiments.”
With this editorial, EHP joins the growing list of journals that endorse the ARRIVE guidelines for animal research. We encourage authors to review these guidelines when designing their studies and to use them in writing papers for submission to EHP. We encourage our Associate Editors and peer reviewers to keep in mind the principles articulated in the ARRIVE guidelines when evaluating papers involving animal research. We believe that by adhering to the guidelines, the quality of the papers will improve and the potential for reproducibility of findings will increase.
The ARRIVE guidelines focus on in vivo animal research; other types of research not covered by the ARRIVE guidelines also need to be considered. There is a need for clear and complete descriptions of methods across all disciplines.
Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. 2010. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PloS Biol 8:e1000412; doi:10.1371/journal.pbio.1000412.
Kilkenny C, Parsons N, Kadyszewski E, Festing MFW, Cuthill IC, Fry D, et al. 2009. Survey of the quality of experimental design, statistical analysis and reporting of research using animals. PloS One 4:e7824; doi:10.1371/journal.pone.0007824.
Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992; doi:10.1289/ehp.1206389.
Moher D, Schulz KF, Altman DG, for the CONSORT group. 2001. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 357:1191–1194.
Prinz F, Schlange T, Asadullah K. 2011. Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov 10:712; doi:10.1038/nrd3439-c1.
Vasilevsky NA, Brush MH, Paddock H, Ponting L, Tripathy SJ, LaRocca GM, Haendel MA. 2013. On the reproducibility of science: unique identification of research resources in the biomedical literature. PeerJ 1:e148; doi:10.7717/peerj.148.
New Impact Factor
We are pleased to announce our new impact factor of 7.03 and—for the first time—our inclusion in the category of Toxicology. Thank you to our authors and readers, who continue to make EHP a leading journal in Environmental Sciences, in Public, Environmental, and Occupational Health, and now in Toxicology.
EHP News Feature Wins Award
Our March 2013 cover story, “A Tale of Two Forests: Addressing Postnuclear Radiation at Chernobyl and Fukushima,” has won first place in the Outstanding Feature Story category of the Society of Environmental Journalists Awards for Reporting on the Environment. The judges called the story “an exceedingly vital and original piece of environmental feature writing.” Congratulations to authors Winifred A. Bird and Jane Braxton Little on their exciting achievement!
CEHN August 2014 Article of the Month
“Gestational Exposure to Endocrine-Disrupting Chemicals and Reciprocal Social, Repetitive and Stereotypic Behaviors in 4- and 5-Year-Old Children: The HOME Study” (Environ Health Perspect; DOI:10.1289/ehp.1307261) has been selected by the Children’s Environmental Health Network (CEHN) as its August 2014 Article of the Month. These CEHN summaries discuss the potential policy implications of current children’s environmental health research.
Register Today for PPTOX IVEnvironmental Stressors in Disease and Implications for Human Health
October 26–29, 2014
Boston Marriott Long Wharf Hotel
Join the Endocrine Society for the fourth international summit of Prenatal Programming and Toxicity (PPTOX), a premiere conference series dedicated to cutting-edge discussion of environmental hazards during early life and long-term consequences.Key deadlines:
* Abstract submission: Tuesday, September 2
* Housing deadline: Monday, October 6
For more information, visit the Endocrine Society website.
Sign Up to Receive E-mail Alerts
Recent Advance Publications
- Genistein Disrupts Glucocorticoid Receptor Signaling in Human Uterine Endometrial Ishikawa Cells
- Modification of the Association between PM10 and Lung Function Decline by Cadherin 13 Polymorphisms in the SAPALDIA Cohort: A Genome-Wide Interaction Analysis
- Mitochondria, Energetics, Epigenetics, and Cellular Responses to Stress
- Incense Use and Cardiovascular Mortality among Chinese in Singapore: The Singapore Chinese Health Study
- Perfluorochemicals and Human Semen Quality: The LIFE Study
- Molecular Signaling Network Motifs Provide a Mechanistic Basis for Cellular Threshold Responses
- Preconception Maternal and Paternal Exposure to Persistent Organic Pollutants and Birth Size: The LIFE Study
- AdvPubl: Genistein disrupts glucocorticoid receptor signaling http://t.co/cojJ0RhK7Y
- EHPNoonNews: Ohio offers no-interest loans in water toxin fight http://t.co/4pgWAPsjZb @ap
- EHPNoonNews: Audit of fracking fluids highlights data deficiencies http://t.co/5OfEByYsFj @chemistryworld
- EHPNoonNews: Experimental chikungunya vaccine induces robust antibody response http://t.co/anNjJ000su @nih
- EHPNoonNews: U.S. farmers fight poisonous wheat fungus with cleaning, waiting http://t.co/Da4Nq9l1gl @planetark