CorrespondenceOpen Access

In Support of EHP’s Proposal to Adopt the ARRIVE Guidelines

    Published:https://doi.org/10.1289/ehp.1307775Cited by:4

    We strongly support EHP’s proposal encouraging authors who perform animal studies to adhere to the ARRIVE guidelines ( http://www.nc3rs.org.uk/ARRIVE/) (Tilson and Schroeder 2013), a 20-item checklist for the reporting of key elements necessary to describe a study comprehensively and transparently (Kilkenny et al. 2010). In the clinical sphere, systematic review methods have been at the forefront of evidence-based research for the past 20 years and have demonstrated that poor reporting, particularly in domains associated with increased risk of bias, can have a significant impact on the results of a study (Juni et al. 2001). By supporting the ARRIVE guidelines, EHP recognizes the importance of reporting—and ultimately implementing—methodological approaches that can influence study quality. The ARRIVE guidelines have already been adopted by many journals, including several high-impact publications from the Nature, BioMed Central, and PLoS publishing groups. EHP will join these other prestigious journals in leading the way in recognizing the importance of reporting methodological elements in the toxicological sciences and ultimately strengthening the scientific approach.

    Although we endorse the use of an approach such as the ARRIVE guidelines, the ARRIVE guidelines do not currently include all important reporting elements in a clearly defined manner. In addition, because the ARRIVE guidelines were developed in the clinical sphere, some elements that are pertinent to toxicological research are not included. We encourage EHP to simultaneously address those issues, including the following:

    • Authors should adequately report sample sizes per group (Landis et al. 2012) and include explicit details of any losses to follow-up. We urge EHP to encourage authors to perform and report details of an a priori sample size calculation.

    • Authors should describe any animals with “peculiarities”; this criterion is described in the “Gold Standard Publication Checklist” by Hooijmans et al. (2010) but is not necessarily covered by the “adverse events” criteria in the ARRIVE guidelines.

    • Authors should report where and when the study was performed to aid in assessing whether the cohort of animals is unique from other published studies.

    • Whenever possible, authors should include in the study doses that are environmentally relevant (to humans) and a measured concentration in the animal for comparison/integration with human biomarkers.

    Authors should also report all of their funding sources and include a statement regarding potential conflicts of interest, including when none exist. “Conflict of interest” risk-of-bias domain has been proposed—but not yet adopted—by the Cochrane Collaboration and GRADE (Grading of Recommendations Assessment, Development and Evaluation) as an important risk of bias. This is based on empirical data from studies of the health effects of tobacco (Barnes and Bero 1997, 1998), the safety and efficacy of pharmaceuticals (Bero et al. 2007; Lexchin et al. 2003; Lundh et al. 2012), and medical procedures (Popelut et al. 2010; Shah et al. 2005) that have shown that source of funding influences the study outcome.

    A criticism of the ARRIVE guidelines is that they are not topic specific. However, we believe that risk-of-bias domains used in human experimental studies that have an empirical basis—including sequence generation, allocation concealment, blinding, incomplete outcome data, and selective reporting—are directly relevant to toxicological studies. In the clinical sphere, these five criteria address nearly all issues that bear on the quality of human experimental evidence (Balshem et al. 2011). Further, these elements have been shown in the preclinical animal literature to influence study outcomes (Landis et al. 2012; Vesterinen et al. 2010). Therefore, in the absence of evidence to the contrary, the field of toxicology should proceed based on such comparability. At the same time, it would be of enormous benefit to the field of toxicology research for EHP to adopt the ARRIVE guidelines and to simultaneously encourage empirically based research to assess which criteria are most critical to the results of various types of toxicological studies that provide the evidence for decision making in environmental health.

    Finally, for the EHP editors to highlight their commitment to improving the quality of the research published in EHP, they could commission or encourage research that assesses the current standard or quality of their publications and then repeat the exercise in a few years to see if the guidelines have resulted in improvements to both reporting and quality of toxicological studies [for example, see Dirnagl and Lauritzen (2011)].

    The views expressed in this letter are those of the authors and do not reflect the views of the Oak Ridge Institute for Science and Education.

    The authors declare they have no actual or potential competing financial interests.

    References

    • Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek Jet al.. 2011. GRADE guidelines: 3. Rating the quality of evidence.J Clin Epidemiol 64(4):401-40621208779. Crossref, MedlineGoogle Scholar
    • Barnes DE, Bero LA. 1997. Scientific quality of original research articles on environmental tobacco smoke.Tob Control 6(1):19-269176982. Crossref, MedlineGoogle Scholar
    • Barnes DE, Bero LA. 1998. Why review articles on the health effects of passive smoking reach different conclusions.JAMA 279(19):1566-15709605902. Crossref, MedlineGoogle Scholar
    • Bero L, Oostvogel F, Bacchetti P, Lee K.. 2007. Factors associated with findings of published trials of drug–drug comparisons: why some statins appear more efficacious than others.PLoS Med 4(6):e184; doi:10.1371/journal.pmed.004018417550302. Crossref, MedlineGoogle Scholar
    • Dirnagl U, Lauritzen M.. 2011. Improving the quality of biomedical research: guidelines for reporting experiments involving animals. [Editorial]J Cereb Blood Flow Metab 31(4):989-99021206506. Crossref, MedlineGoogle Scholar
    • Hooijmans CR, Leenaars M, Ritskes-Hoitinga M. 2010. A gold standard publication checklist to improve the quality of animal studies, to fully integrate the Three Rs, and to make systematic reviews more feasible.Altern Lab Anim 38(2):167-18220507187. MedlineGoogle Scholar
    • Jüni P, Altman DG, Egger M. 2001. Systematic reviews in health care: assessing the quality of controlled clinical trials.BMJ 323(7303):42-4611440947. Crossref, MedlineGoogle Scholar
    • Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. 2010. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research.Plos Biol 8(6):e1000412; doi:10.1371/journal.pbio.100041220613859. Crossref, MedlineGoogle Scholar
    • Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EWet al.. 2012. A call for transparent reporting to optimize the predictive value of preclinical research.Nature 490(7419):187-19123060188. Crossref, MedlineGoogle Scholar
    • Lexchin J, Bero LA, Djulbegovic B, Clark O. 2003. Pharmaceutical industry sponsorship and research outcome and quality: systematic review.BMJ 326(7400):1167-117012775614. Crossref, MedlineGoogle Scholar
    • Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. 2012. Industry sponsorship and research outcome.Cochrane Database Syst Rev 12:MR000033; doi:10.1002/14651858.MR000033.pub223235689. Crossref, MedlineGoogle Scholar
    • Popelut A, Valet F, Fromentin O, Thomas A, Bouchard P.. 2010. Relationship between sponsorship and failure rate of dental implants: a systematic approach.PLoS One 5(4):e10274; doi:10.1371/journal.pone.001027420422000. Crossref, MedlineGoogle Scholar
    • Shah RV, Albert TJ, Bruegel-Sanchez V, Vaccaro AR, Hilibrand AS, Grauer JN.2005. Industry support and correlation to study outcome for papers published in Spine.Spine (Phila Pa 1976) 30(9):1099-1104; doi:10.1289/ehp.130767615864166. LinkGoogle Scholar
    • Tilson HA, Schroeder JC. 2013. Reporting of results from animal studies. [Editorial]Environ Health Perspect 121:A320-A32124284018. LinkGoogle Scholar
    • Vesterinen HM, Sena ES, ffrench-Constant C, Williams A, Chandran S, Macleod MR. 2010. Improving the translational hit of experimental treatments in multiple sclerosis.Mult Scler 16(9):1044-105520685763. Crossref, MedlineGoogle Scholar