Review Volume 122 | Issue 10 | October 2014
Environ Health Perspect; DOI:10.1289/ehp.1307177
The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Nonhuman Evidence for PFOA Effects on Fetal Growth
Erica Koustas,1 Juleen Lam,1 Patrice Sutton,2 Paula I. Johnson,2 Dylan S. Atchley,2 Saunak Sen,3 Karen A. Robinson,4,5,6 Daniel A. Axelrad,7 and Tracey J. Woodruff2
Background: In contrast to current methods of expert-based narrative review, the Navigation Guide is a systematic and transparent method for synthesizing environmental health research from multiple evidence streams. The Navigation Guide was developed to effectively and efficiently translate the available scientific evidence into timely prevention-oriented action.
Objectives: We applied the Navigation Guide systematic review method to answer the question “Does fetal developmental exposure to perfluorooctanoic acid (PFOA) or its salts affect fetal growth in animals ?” and to rate the strength of the experimental animal evidence.
Methods: We conducted a comprehensive search of the literature, applied prespecified criteria to the search results to identify relevant studies, extracted data from studies, obtained additional information from study authors, conducted meta-analyses, and rated the overall quality and strength of the evidence.
Results: Twenty-one studies met the inclusion criteria. From the meta-analysis of eight mouse gavage data sets, we estimated that exposure of pregnant mice to increasing concentrations of PFOA was associated with a change in mean pup birth weight of –0.023 g (95% CI: –0.029, –0.016) per 1-unit increase in dose (milligrams per kilogram body weight per day). The evidence, consisting of 15 mammalian and 6 nonmammalian studies, was rated as “moderate” and “low” quality, respectively.
Conclusion: Based on this first application of the Navigation Guide methodology, we found sufficient evidence that fetal developmental exposure to PFOA reduces fetal growth in animals.
Citation: Koustas E, Lam J, Sutton P, Johnson PI, Atchley DS, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of nonhuman evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1015–1027; http://dx.doi.org/10.1289/ehp.1307177
Address correspondence to E. Koustas, U.S. Environmental Protection Agency, 1200 Pennsylvania Ave. NW (1809T), Washington, DC 20460 USA. Telephone: (202) 566-1829. E-mail: firstname.lastname@example.org
We thank K. Guyton [U.S. Environmental Protection Agency (EPA)] for her contribution to developing the evidence evaluation methodologies and assistance with identifying relevant toxicological databases; A. Rooney (National Toxicology Program) for his toxicological expertise and for assistance with developing animal risk of bias criteria; and K. Thayer (National Toxicology Program), L. Bero [University of California, San Francisco (UCSF)], and L. Zeise (California Environmental Protection Agency) for assistance with developing risk of bias evaluation criteria, meta-analysis methodologies, and evidence evaluation methodologies. M. Macleod (University of Edinburgh) provided critical assistance in developing the animal-specific systematic review methodology. We thank H. Vesterinen (UCSF) for her thoughtful comments on this manuscript. C. Lau (U.S. EPA) served as a perfluorooctanoic acid (PFOA) subject matter expert. We thank T. Horvath (UCSF) for training and assistance with developing our search strategy. Finally, we acknowledge B. Abbott, J. Boberg, J. Butenhoff, S. Fenton, A. Hagenaars, J. Dai, J. DeWitt, C. Lau, G. Kennedy, S. Kennedy, J. O’Brien, N. Onishchenko, A. Pinkas, S. White, J. Yanai, and their laboratories for their kind and timely response to requests for additional information.
This research was supported, in part, by appointments of E.K. and J.L. to the Internship/Research Participation Program at the National Center for Environmental Economics, U.S. EPA, administered by the Oak Ridge Institute for Science and Education through an interagency agreement between the U.S. Department of Energy and the U.S. EPA. T.J.W. is a member of the Philip R. Lee Institute for Health Policy Studies. Financial support for development of the PFOA case study was through grants from the New York Community Trust and the U.S. EPA through a contract with Abt Associates (GAIA-0-6-UCSF 17288). For 2009–2013, support for the development and dissemination of the Navigation Guide methodology was provided by the Clarence Heller Foundation, the Passport Foundation, the Forsythia Foundation, the Johnson Family Foundation, the Heinz Endowments, the Fred Gellert Foundation, the Rose Foundation, Kaiser Permanente, the New York Community Trust, the Philip R. Lee Institute for Health Policy Studies, the Planned Parenthood Federation of America, the National Institute of Environmental Health Sciences (grants ES018135 and ESO22841), and U.S. EPA STAR grants (RD83467801 and RD83543301).
The contents of this paper are solely the responsibility of the authors and do not necessarily represent the official views of the U.S. EPA. Further, the U.S. EPA does not endorse the purchase of any commercial products or services mentioned in the publication.
The authors declare they have no actual or potential competing financial interests.
Received: 4 June 2014
Accepted: 23 April 2014
Advance Publication: 25 June 2014
Final Publication: 1 October 2014
- Supplemental Material (581 KB) PDF
Background. In clinical research, systematic reviews have played a transformative role as a transparent, robust method for synthesizing the available evidence for incorporation into more efficient guidelines and recommendations related to medical interventions. Whereas systematic review methodology has been developed and tested in the clinical sciences for making evidence-based decisions for medical interventions, the methods are not fully transferable to environmental health science, largely because of their primary application to randomized controlled clinical trials, which are, for primarily ethical reasons, unavailable in environmental health. The Navigation Guide was developed to bridge this gap between clinical and environmental health sciences. The methodology provides the capacity to systematically and transparently evaluate the quality and strength of evidence from both human and nonhuman streams of evidence about the relationship between the environment and reproductive and developmental health (Woodruff and Sutton 2014; Woodruff et al. 2011a).
To test and refine the Navigation Guide systematic review methodology, we applied it to the evaluation of experimental animal evidence for the effects of exposure to the environmental contaminant perfluorooctanoic acid (PFOA) on fetal growth. The results of applying the method to the human evidence and integrating the animal and human data into an overarching strength of evidence rating are presented elsewhere (Johnson et al. 2014; Lam et al. 2014).
Rationale for selecting PFOA. Environmental exposures to the industrial chemical PFOA are widespread, and PFOA has been detected in the blood of > 95% of the U.S. population [Agency for Toxic Substances and Disease Registry (ATSDR) 2009; Centers for Disease Control and Prevention (CDC) 2009; Kato et al. 2011; U.S. Environmental Protection Agency (EPA) 2009] and in blood samples throughout the world (Kannan et al. 2004; U.S. EPA 2009). Voluntary efforts by eight major manufacturers of PFOA to eliminate global emissions and product content by the end of 2015 are ongoing, and significant progress has been made for both U.S. and non-U.S. operations (U.S. EPA 2008, 2012, 2013a). However, PFOA can remain in the environment, and with a half-life in humans of approximately 3.5 years (Olsen et al. 2007), the chemical will persist in people for years to come (U.S. EPA 2013b, 2014).
Fetal exposure to PFOA may be widespread because the chemical is ubiquitous in the blood of pregnant women and women of child-bearing age and in cord blood (Apelberg et al. 2007a; Calafat et al. 2007; Fei et al. 2007; Midasch et al. 2007; Mondal et al. 2012; Monroy et al. 2008; Woodruff et al. 2011b). The association between PFOA and fetal growth reported in individual human studies has been inconsistent, with some reporting statistically significant associations between prenatal exposure to PFOA and restricted fetal growth (Apelberg et al. 2007b; Fei et al. 2007, 2008) and others reporting no or nonstatistically significant associations (Hamm et al. 2010; Monroy et al. 2008; Washino et al. 2009). The animal literature also includes reports of inconsistent associations between PFOA and fetal growth, including findings of reduced birth weight following prenatal exposure to PFOA in rodents (Butenhoff et al. 2004; Hines et al. 2009; Lau et al. 2004, 2006).
Ubiquitous exposure to a chemical that lacks evidence of nontoxicity is a potential public health concern; moreover, PFOA has been associated with adverse impacts on the quality and duration of the gestation period—one of the most important indicators of an infant’s health and survival (Gluckman and Hanson 2006; Institute of Medicine 2007). Given the potential concern for an adverse developmental health outcome of public health importance and the availability of data, we selected PFOA to test and refine the Navigation Guide method.
We assembled a review team to include experts in the fields of risk assessment, environmental health, epidemiology, biology, systematic review, and toxicology to develop a protocol that covered the first three steps of the Navigation Guide systematic review method: 1) Specify the study question; 2) select the evidence; and 3) rate the quality and strength of the evidence (Koustas et al. 2013). Each of the steps of the Navigation Guide method described below involves application of standardized and transparent documentation, including expert judgment. Additional information regarding the Navigation Guide methodology is available elsewhere (Woodruff and Sutton 2014).
Step 1. Specify the Study Question
Our objective was to answer the question: “Does fetal developmental exposure to PFOA or its salts affect fetal growth in animals?” PICO (participants, interventions, comparator, and outcomes) is an aid used to formulate an answerable question in a systematic review and to provide more specific information about the scope of the review (O’Connor et al. 2011). Because we were evaluating environmental exposures, we used the acronym PECO (i.e., participants, exposure, comparator, and outcomes).
Participants. Animals were from nonhuman species studied during the reproductive/developmental time period (before and/or during pregnancy for females or during development for embryos).
Exposure. Exposure included one or more oral, subcutaneous, or other treatment(s) of any dosage of PFOA (CAS# 335-67-1) or its salts during the time before pregnancy and/or during pregnancy for females or directly to embryos.
Comparator. Experimental animals receiving different doses of PFOA or vehicle-only treatment were used for comparisons.
Outcomes. The outcomes examined for mammalian species were fetal weight near term (e.g., embryonic day 18 for mice and embryonic day 21 for rats) or at birth, and/or other measures of size near term or at birth, such as length. For nonmammalian species, outcomes were weight and/or other measures of size in late stages of embryonic development.
Step 2. Select the Evidence
Search methods. Our search was developed by analyzing the Medical Subject Headings (MeSH) and other terms from the title and abstract text of a group of seven papers known to us, judged to be relevant to our study question, and which represented different journals and years of publication (Abbott et al. 2007; Butenhoff et al. 2004; Hines et al. 2009; Lau et al. 2006; Staples et al. 1984; White et al. 2007, 2009). A list of common and unique terms was compiled and incorporated into a search strategy to address the exposure (PFOA) and outcomes of interest (reproductive/developmental toxicity), as defined in the PECO statement (see Supplemental Material, Tables S1, S2). To develop search terms to retrieve experimental animal studies, we adapted a search filter developed by Hooijmans et al. (2010b).
We searched PubMed (http://www.ncbi.nlm.nih.gov/pubmed) and Web of Science (http://apps.webofknowledge.com/) on 3 February 2012. Using PFOA terms, we searched 35 toxicological databases between 23 January and 6 February 2012. Our search was not limited by language or publication date. We hand searched the reference list of all included studies and searched for publications citing the included studies. We also consulted with a subject matter expert (C. Lau, U.S. EPA).
Data collection and management. We imported or manually entered all retrieved records into EndNote X4 reference management software (http://thomsonreuters.com/endnote/), and each record was assigned a source identification number, which was used to track individual studies throughout the course of the review. Two authors (E.K. and J.L.) independently screened the titles and abstracts of each record retrieved to identify those meeting our inclusion criteria using DistillerSR (Evidence Partners; http://www.systematic-review.net). We developed inclusion and exclusion criteria based on our PECO statement. All studies that compared experimental animals exposed to one or more doses of PFOA during reproductive or developmental periods with untreated control experimental animals were eligible for inclusion. We excluded studies if one or more of the following criteria were met: the article did not contain original data (i.e., review article); study subjects were not animals; PFOA was not administered to study subjects; and PFOA was not administered during the reproductive/developmental time period. Two authors (E.K. and J.L.) assessed the full text of studies that could not be excluded based on screening of the title and abstract. Potentially relevant non-English articles were translated to determine eligibility. To provide quality control, a third author (P.I.J.) screened the title and abstract of 5% of the search results and 5% or five articles—whichever was greater—of the search results eligible for full text. We considered studies that described more than one experiment or outcome measure as separate data sets.
Two authors (E.K. and J.L.) independently extracted data relating to study characteristics and outcome measures from all included articles into a Microsoft Access 2007 database. The list of extracted study characteristics was based on a compilation of previously published checklists and criteria (Guyatt et al. 2011; Higgins and Deeks 2011; Hooijmans et al. 2010a; Kilkenny et al. 2010).
One author (E.K.) performed data entry of the raw outcome data using Microsoft Excel 2007, and a second author (D.S.A.) verified all values. We contacted study authors when additional information was required for performing statistical analysis and/or analysis of the full data set. For example, we requested numerical estimates associated with figures presented in published articles, numbers of animals allocated to various test groups, and raw data values. In some cases, fetal growth data were not presented in the published study because the outcome was not of primary interest to the study authors. If there was a reason to believe the study authors may have measured fetal growth, we contacted them to obtain any data they may have collected during the course of the study. We also contacted all study authors to inform them of our systematic review and to verify values used in both the meta-analysis and analysis of the full data set.
Statistical analyses. Two authors (E.K. and J.L.) assessed study characteristics from all included articles for comparability (i.e., study features and biological heterogeneity) to determine which studies were suitable for meta-analysis. We consulted experts in the field of PFOA toxicity, toxicological study design, or human/animal toxicity reviews to develop these characteristics and their associated heterogeneity concerns beforehand. For example, we considered the differences in PFOA clearance rates between female mice (approximately 17 days) and rats (2–4 hr) as a potential biological heterogeneity concern (Lau et al. 2007).
From the assessment of specified characteristics, we determined that only a subset of data was combinable in a meta-analysis. This subset of seven studies (eight data sets) had the following characteristics:
- Species: mouse
- Route of exposure: gavage
- Method of outcome measurement: weight
- Time point of outcome measurement: at or soon after birth.
We used the mean (± SE) pup body weight at birth from each of the eight data sets for all PFOA doses < 5 mg/kg body weight (mg/kg BW)/day. We limited the dose range in order to focus on effects at lower tested doses and to minimize adverse impacts from responses at higher doses (such as litter loss) on the overall estimate. We used a two-step modeling approach. In the first step, we analyzed each data set separately using a linear mixed-effects model, and we obtained a slope estimate of the dose–response effect (and the associated SE). In the second step, we combined the slope and SE estimate from each data set using a random-effects model.
The result was an estimate of the overall mean change in body weight per offspring for a 1-unit increase in mg/kg BW/day dose, accounting for within- and between-study variability. We used the programming environment R, version 2.13.1 (R Development Core Team; http://www.R-project.org/) and its standard packages. We used the metafor package in R (Viechtbauer 2010) for conducting our random effects meta-analysis.
To visually assess the possibility of publication bias in a meta-analysis, we considered producing a funnel plot of the estimated effects. However, tests for funnel plot asymmetry are not recommended when there are < 10 studies because test power is usually too low to distinguish chance from real asymmetry (Sterne et al. 2011a). Because our meta-analysis was limited to 7 studies (8 data sets), we did not produce a funnel plot.
Statistical heterogeneity assessment. We sought to assess whether differences in estimated effect sizes among studies were consistent with random variation versus nonrandom heterogeneity among the studies. We estimated the between-study variance component and tested the null hypothesis that the between-study variability was absent using Cochran’s Q statistic. The test statistic follows a chi-square distribution with n – 1 degrees of freedom, where n is the number of studies. We considered p ≤ 0.05 statistically significant. We also calculated the I2 statistic, which estimates the percentage of variation across studies due to heterogeneity rather than chance (Higgins et al. 2003), and used the Cochrane Collaboration’s guidelines to interpret the statistic, where a value of > 50% may indicate substantial heterogeneity (Deeks et al. 2011). To assess the overall impact of existing study heterogeneity on the meta-analysis, we considered the magnitude/direction of effect estimates, the I2 statistic, and the p-value from the Cochran’s Q test.
Sensitivity analysis. We performed sensitivity analyses using subgroup analyses based on characteristics described above that were used to determine comparability across studies for the meta-analysis. To evaluate the influence of each individual study on the main meta-analysis results and assist in identifying any study characteristics that might be influential in the final results, we performed a sensitivity analysis by removing one data set at a time from the meta-analysis.
Analysis of the full data set. We analyzed all included animal studies identified via our search and exclusion/inclusion assessment to assess the totality of all available animal evidence. This was done to maximize use of all data, in addition to those determined appropriate to combine in the meta-analysis. To assess results from the full data set, we calculated the percentage change in outcome (weight or length) compared with the control group for each tested dose group for each of the data sets and used these values to create scatter plots. Two of the nonmammalian studies reported outcome measurements at multiple time points during larval development (Spachmo and Arukwe 2012; Wang et al. 2010). We selected the outcome measurement reported at the latest time point during the larval stage, based on justification that this allowed for consideration of maximal larval growth. For each study, we used the mean and SE estimates reported by authors to calculate a 95% confidence interval (CI) for the difference in means comparing each treatment group with the control group. We interpreted a 95% CI that overlapped zero as indicating no statistically significant difference between the mean weight in that treatment group with the mean weight in the control group.
Step 3. Rate the Quality and Strength of the Evidence
To rate the evidence, we a) determined the risk of bias for individual studies based on seven domains; b) rated the overall quality across all studies in the body of evidence based on five factors, including risk of bias; and c) rated the overall strength of evidence across all studies in the body of evidence based on four considerations, including the quality of the body of evidence (Figure 1).
Assessment of risk of bias. Two authors (E.K. and J.L.) assessed risk of bias defined as characteristics of a study that can introduce a systematic error in the magnitude or direction of the results of the study (Higgins et al. 2011) for included studies based on seven risk of bias domains using modified terminology and concepts in the Cochrane Collaboration’s Tool for Assessing Risk of Bias. Informed by empirical data from meta-analyses conducted on pharmacological treatments (Roseman et al. 2011), we considered funding source and reported conflicts of interest to be potential sources of bias. We did not ask study authors for additional information to inform our risk of bias determinations. However, if study authors mentioned study design details in their responses to our requests for data, we considered the information while evaluating risk of bias. See Table 1 for a summary of the risk of bias domains assessed for each included study (see also Supplemental Material, “Instructions for making risk of bias determinations”).
Rate the quality and strength of the body of evidence. Upon completion of the data analysis, each of the nine review authors compared the results of the systematic review to the Navigation Guide factors and considerations for rating the quality and strength of the nonhuman evidence. The Navigation Guide rating method (Woodruff et al. 2011a) was applied according to explicit written directions (Koustas et al. 2013). Because of fundamental biological differences between mammalian and nonmammalian model systems, we evaluated the mammalian and nonmammalian studies as separate bodies of evidence.
The possible ratings for the overall quality of the body of evidence were “high,” “moderate,” and “low.” These quality ratings were determined by assigning an initial rating according to the type of study, and then downgrading the rating if factors that decrease the quality level of the studies were present. The initial quality rating assigned to both the mammalian and nonmammalian bodies of evidence was “high,” comparable to the rating assigned to human experimental studies [i.e., randomized controlled trials (RCTs)] in systematic review methods used in the clinical sciences. An initial “high” quality rating for experimental animal studies was supported by the level of study control exercised in such studies and the limited heterogeneity within an experimental animal study population. This is also consistent with Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidelines for clinical evidence that consider randomization a key determinant of a “high” grade (Guyatt et al. 2011). Upgrades to the quality rating for experimental animal data were not considered because the initial quality level was “high.”
The overall body of evidence was evaluated for downgrading based on the presence of five factors (Figure 1):
- Risk of bias across studies: a substantial risk of bias existed across the body of evidence.
- Indirectness: Evidence was not directly comparable to the question of interest (i.e., population, exposure, comparator, and/or outcome). Beforehand, we decided not to downgrade experimental animal studies for indirectness because studies find that humans are as sensitive or more sensitive to chemical exposures than animals, strengthening the applicability of findings from experimental animal studies to human health outcomes (Kimmel et al. 1984; U.S. EPA 1996). However, in applying GRADE principles to the Navigation Guide, evidence would be rated down if the animal model was determined to be biologically inappropriate for the health outcome under study.
- Inconsistency: Estimates of effect were widely different (heterogeneity or variability in results).
- Imprecision: Studies had few participants and few events (wide CIs).
- Publication bias: Studies were missing from the body of evidence, resulting in an overestimate or underestimate of true effects from exposure.
According to GRADE, these five factors address nearly all issues that bear on the quality of evidence (Balshem et al. 2011). Each of the nine review authors reviewed the body of evidence and applied their expert judgment to independently and transparently grade the quality of evidence based on the presence of the five objective factors using detailed instructions (Koustas et al. 2013). Possible ratings were 0 (no change from “high” quality), –1 (one-level downgrade to “moderate” quality) or –2 (two-level downgrade to “low” quality). Consistent with GRADE’s approach to evaluating risk of bias across studies (Guyatt et al. 2011), authors were instructed to be conservative in making judgments to downgrade the evidence for all factors (i.e., high confidence of substantial concerns with the body of evidence before rating down). Authors reviewed the body of evidence as a way to initiate the group discussion and gather all perspectives for consideration. After independently evaluating the quality of the evidence, all authors discussed their evaluations. The discussion between coauthors was extensive and iterative and was carried out over several meetings until a consensus was reached. These collective decisions did not involve a “majority vote” or other tallying of perspectives. It was prespecified that discrepancies between review authors that could not be resolved through consensus would be resolved by the senior author (T.J.W.). However, for this case study, review authors were able to agree on a collective consensus for each rating and the arbiter was not necessary. The rationale for each collective decision on each of the five factors was recorded.
In systematic reviews in the clinical sciences, rating the quality of evidence is the final step because only one stream of evidence is considered in a decision. However, given that our purpose was to ultimately integrate the strength of multiple streams of evidence used in environmental health decision making (i.e., toxicology and epidemiology) leading to a concise “bottom line” statement about a chemical’s toxicity that brings all of the relevant evidence to bear, the Navigation Guide systematic review method specifies an additional step: moving from quality of evidence to strength of evidence.
We rated the overall strength of the evidence based on a combination of four considerations: a) quality of the body of evidence, b) direction of effect estimates, c) confidence in effect estimates (likelihood that a new study would change our conclusion), and d) other compelling attributes of the data that may influence certainty (Figure 1). The results of rating the strength of the nonhuman evidence were compared with the definitions specified in the Navigation Guide for “sufficient” evidence of toxicity; “limited” evidence of toxicity; “inadequate” evidence of toxicity; or “evidence of lack of toxicity” (Table 2), which were based on criteria in use by the International Agency for Research on Cancer (IARC 2006) and the U.S. EPA (1991, 1996). The procedure for rating the strength of the evidence was similar to rating the quality of evidence: All review authors independently evaluated the strength of the evidence according to the same four considerations, and then they compared their evaluations, resolved any discrepancies through discussion, and recorded the rationale for every collective decision.
Of the 2,049 unique records we identified (see Supplemental Material, Table S3 for the total number of hits retrieved from each database), 1,982 were excluded through title and abstract screening and 46 articles were excluded during full-text review, resulting in 21 studies describing 32 data sets included in the review (Figure 2). A summary of mammalian and nonmammalian study characteristics are provided in Tables 3 and 4, respectively. Detailed characteristics of each mammalian and nonmammalian study are provided in Supplemental Material, Tables S4–18 and Tables S19–S24, respectively. Various details of outcome data and study design characteristics necessary for data analysis were missing from all 21 articles. In some cases, published articles did not include details needed for our analysis, such as numerical outcome measurements or data on fetal growth, if this was not a primary outcome of interest for study authors. In other cases basic information, such as allocation numbers or the number of animals weighed to obtain given outcome values, was missing. Our efforts to contact study authors resulted in obtaining additional data for 18 of the 21 included studies, along with raw data in many instances (see Supplemental Material, Tables S4–S24).
Populations. Of the 21 studies, 15 were conducted on mammalian species (11 mouse and 4 rat) and 6 studies were conducted on nonmammalian species (3 chicken, 1 fruit fly, 1 zebrafish, and 1 salmon) (Tables 3 and 4).
Mammalian exposures. For all 15 mammalian studies, pregnant female dams were exposed to PFOA, and fetal growth was measured in the resulting progeny (Table 3). The primary route of exposure was oral gavage (13 studies), but some studies also evaluated exposures via inhalation, food, and water. Most of the mammalian studies (12) exposed dams to the ammonium salt form of PFOA (CAS# 3825-26-1), 1 study exposed dams to the free acid form (CAS# 335-67-1), and 2 studies did not specify the form used for exposure. The dose range tested varied widely across studies, ranging from 0.01 to 100 mg/kg BW/day. Inhalation study doses ranged between 0.1 and 25 mg/m3. The number of PFOA doses administered per study ranged from one to six. Although dams in all studies were exposed to PFOA at some point during their pregnancy, the window of exposure varied across studies from a single gavage exposure on a single day of pregnancy to exposure prior to conception that continued throughout pregnancy.
Mammalian comparators. Eleven gavage studies used water as a vehicle control and two used corn oil (Table 3). The inhalation study utilized three control groups: in-house air only, in-house air pair-fed 10 mg/m3 PFOA, and in-house air pair-fed 25 mg/m3 PFOA (Staples et al. 1984). The PFOA-treated food study (Onishchenko et al. 2011) used ethanol-treated food as a control, and the PFOA-treated water study (Hu et al. 2010) used untreated water as a control. Other than PFOA exposure, all control groups were treated similarly to dose groups for each data set.
Mammalian outcomes. Body weight was used as the outcome measure for all 15 mammalian studies (Table 3). Because pregnant dams were exposed to PFOA for all mammalian studies, the litter was used as the statistical unit; the total number analyzed across studies ranged from 8 to 183 litters.
The time point of weight measurement varied between fetal time points near term, typically gestation day (GD) 18 for mice and GD21 for rats, to at or near the time of birth, typically postnatal day (PND) 0 to PND2. The methods used to monitor parturition varied widely across birth weight studies, from constant monitoring to daily cage checks. PND1 was defined as either the day of birth or the day after birth.
The method of weight measurement varied across studies as well, from weighing offspring individually, grouped by litter, or grouped by sex, to weighing a subset of offspring from each litter. Offspring survival was statistically significantly reduced (based on the alpha level specified by study authors, generally < 0.05 or ≤ 0.05) at exposure to doses > 5 mg/kg BW/day in five studies; one study did not provide statistics or comment on litter sizes at birth.
Mammalian risk of bias assessment. On the basis of our risk of bias assessment, we concluded that the majority of studies had “probably high” risk of bias for allocation concealment and blinding, and “probably low” risk of bias for incomplete outcome data and selective reporting. Ratings for sequence generation and conflict of interest were mixed across studies, and ranged from low to high risk of bias. All studies had low risk of bias for the “other bias” domain (Figure 3A,B). See Supplemental Material, Tables S25–S39, for details on the risk of bias results for each mammalian study.
Figure 3 – Summary of review authors’ risk of bias judgments (low, probably low, probably high, and high risk) for each risk of bias item for each included study (A) and given as percentages across all included studies (B), separated into mammalian (n = 15) and nonmammalian (n = 6) studies.
Nonmammalian exposures. Developing embryos were directly exposed to PFOA in all six nonmammalian studies (Table 4). Routes of administration varied based on test species: injection of PFOA solution into eggs for chickens, immersion of eggs in PFOA solution for zebrafish and salmon, and PFOA-treated food for fruit flies. One study exposed organisms to the ammonium salt form of PFOA (CAS#3825-26-1), two studies exposed organisms to the free acid form of PFOA (CAS#335-67-1), and three studies did not specify the form of PFOA. The dose ranges across studies varied based on animal species tested: chicken (0.01–10 mg/kg egg), zebrafish (15–250 mg/L water), fruit fly (100–500 μM in food), and salmon (100 μg/L water). The number of PFOA doses administered per study ranged from one to eight.
In all nonmammalian studies, embryos were exposed during development, and the time period of exposure varied based on species. For the chicken studies, a single injection of PFOA was administered to eggs on incubation day 0; for zebrafish studies, eggs were exposed from 60 min after spawning to 120 hours post fertilization (hpf); for salmon studies, eggs and larvae were exposed to PFOA-containing water for 48 days; for fruit fly studies, female flies were placed in vials with PFOA-containing food and allowed to lay eggs for a period of 2 hr, and eggs were allowed to hatch and develop through 110 hr after egg laying (ael) or to the white pupae stage, depending on data set.
Nonmammalian comparators. Chicken studies used saline, dimethyl sulfoxide (DMSO), or sunflower oil as vehicle controls, and some studies included an uninjected control (Table 4). The zebrafish study used water as a vehicle control, the fruit fly study used untreated food as a vehicle control, and the salmon study used water with carrier solvent (methanol) as a vehicle control. Besides PFOA exposure, all control groups were treated similarly to dose groups for each data set.
Nonmammalian outcomes. Relevant outcome measures varied across nonmammalian studies and included length, weight, and larval volume (calculated from measurements of length and diameter) (Table 4). Because embryos were directly exposed to PFOA in the nonmammalian model systems, the embryo was used as the unit of statistical analysis, and the total number of embryos analyzed across studies varied between 37 and 378.
The time points of outcome measurement varied: from shortly before time of hatching, shortly after hatching, and multiple time points during larval development.
PFOA exposure delayed hatching and larval emergence in the zebrafish and fruit fly studies and induced mortality in the zebrafish study and in one chicken study. Pipping success (i.e., when a chick breaks its shell) and the developmental stage at embryo death were unaffected by PFOA exposure in one chicken study, whereas in a second chicken study, embryonic mortality was increased but hatchling mortality and hatching success were not affected. The salmon study did not provide details on larval survival rates.
Nonmammalian risk of bias assessment. On the basis of our risk of bias assessment, we found that the majority of studies had probably high risk of bias for sequence generation, allocation concealment, and blinding, and probably low risk of bias for selective reporting. Ratings for incomplete outcome data were mixed across studies, and ranged from low to high risk of bias. Finally, all studies had probably low or low risk of bias for conflict of interest and low risk of bias for the “other bias” domain (Figure 3A,B). See Supplemental Material, Tables S40–S45, for details of the risk of bias results for each nonmammalian study.
Impact of PFOA on Fetal Growth
Analysis. Across the eight data sets determined to be combinable in the meta-analysis, gavage exposure of pregnant mice to increasing concentrations of PFOA was associated with a decrease in birth weight. The combined estimate from the meta-analysis was a change in mean pup birth weight of –0.023 g (95% CI: –0.029, –0.016) per 1-unit increase in dose (mg/kg BW/day) (Figure 4). The I2 test statistic was calculated to be 0%, indicating no observed heterogeneity between studies that could not be explained by chance; this conclusion was further supported by the Q statistic, which produced a nonsignificant p-value of 0.73.
Figure 4 – Meta-analysis results from a two-step mixed-effects model using combined relevant mouse studies in which dams were treated with PFOA via gavage and progeny weight was measured at or soon after birth. Data are presented as the mean (95% CI) change in body weight (g) per 1-unit increase in dose (mg/kg BW/day). Each box represents the dose–response slope estimate for a study; the midpoint of the box is the slope estimated for that study, and the box area is proportional to the weight given to each study in the meta-analysis. The diamond is centered at the overall meta-analysis slope estimate. Wolf (2007) was split into two data sets: a) cross-foster (exposure on GDs 1–17), and b) windows of sensitivity (exposure groups for GDs 7–17, GDs 10–17, GDs 13–17, and GDs 15–17).
From the sensitivity analysis, where we removed one data set at a time, we found relatively small changes in the effect estimate, with a maximum of 9% change in the meta-analysis estimate (from –0.023 to –0.021) when the data set from White et al. (2011) was removed (data not shown). Figure 4 shows that the study of White et al. (2011) resulted in the largest estimate of decreased birth weight among those studies weighted more heavily in the meta-analysis (indicated by the larger size of the mean symbol), so it is not surprising that the removal of this study would have the largest effect on the meta-analysis estimate, and in particular shifting it to a smaller estimate of decreased birth weight. Although the data set of Abbott et al. (2007) had the largest effect estimate, removing that data set had little effect on the meta-analysis because of its small weight. The sensitivity analysis further demonstrated that the 95% CIs were also minimally affected and consistently did not include zero.
We created separate scatter plots to summarize all the mammalian study data for near-term, fetal weight measurements (Figure 5A) and for birth weight measurements (Figure 5B). The dose–response data for the nine studies not included in the meta-analysis showed mixed results, generally with lower doses showing increased weight compared with the control group (mostly nonsignificant) and higher doses showing decreased weight (some statistically significant and others not significant) (Figure 5B). The 95% CIs for the mean difference comparing birth weight in the treatment versus control group for each study are presented in Supplemental Material, Tables S46 and S47.
Figure 5 – Combined scatter plots of response for each tested dose of PFOA for all included mammalian studies. Response was measured as the percentage of weight change for progeny (A) near-term or (B) at birth. Each color represents a different study (separated by dashed lines), and each symbol represents a different species or exposure route category. Multiple symbols of the same color represent responses at multiple tested doses within the same study. Doses are given in mg/kg BW/day unless otherwise specified. For each study, doses decrease as the y-axis increases and are scaled appropriately (i.e., larger vertical gaps indicate larger gaps between doses); the minimum dose for all studies is zero. See Supplemental Material, Tables S46 and S47, for the 95% CIs for the point estimates shown in the figure.
aStudy split into two data sets: a) cross-foster (exposure on GDs 1–17), and b) windows of sensitivity (exposure groups for GDs 7–17, GDs 10–17, GDs 13–17, and GDs 15–17). *(Within symbols), p < 0.05 compared with the control group.
We also created scatter plots to summarize nonmammalian study data separately for weight measurements (Figure 6A) and for length measurements (Figure 6B). A qualitative evaluation of dose–response data showed mostly nonstatistically significant increases in body weight, even at the highest tested doses. The length data show mixed results, with two studies demonstrating statistically significant decreases in length and the other two studies showing nonsignificant increases in length. The 95% CIs for the mean difference comparing birth weight in the treatment versus control group for each study are presented in Supplemental Material, Tables S48 and S49.
Figure 6 – Combined scatter plots of response for each tested dose of PFOA for all included nonmammalian studies. Response was measured as the percentage of (A) weight change and (B) length change. Each color represents a different study (separated by dashed lines), and each symbol represents a different species or exposure route category. Multiple symbols of the same color represent responses at multiple tested doses within the same study. For each study, doses decrease as the y-axis increases and are scaled appropriately (i.e., larger vertical gaps indicate larger gaps between doses); the minimum dose for all studies is zero. See Supplemental Material, Tables S48 and S49, for the 95% CIs for the point estimates shown in the figure.
aStudy split into two data sets based on time of outcome measurement: a) embryonic day 19, and b) 16–24 hr posthatching. *(Within symbols), p < 0.05 compared with the control group.
Quality of evidence. We downgraded the overall quality rating of the mammalian evidence from “high” to “moderate” based on risk of bias across studies, because the majority of studies were deemed to have “probably high” risk of bias for allocation concealment and blinding. Our ratings and rationales for the overall quality of mammalian evidence are presented in Table 5.
We downgraded the overall quality rating of the nonmammalian evidence from “high” to “low” because of a) risk of bias across studies, given that most studies were deemed to have “probably high” risk of bias for the sequence generation, allocation concealment, and blinding domains; and b) indirectness—for the purposes of this case study, we did not have a rationale or evidence to support that all the nonmammalian species and their corresponding routes of exposure were directly applicable model systems for evaluating human fetal growth. Our ratings and rationales for the overall quality of nonmammalian evidence are presented in Table 6.
Strength of evidence rating. We excluded the nonmammalian data from the final strength of evidence rating. Our rationale was that the nonmammalian evidence was judged to be of low quality for the purposes of addressing our study question, and we had higher quality direct evidence on which to base a decision. Our strength of the evidence considerations were as follows:
- Quality of body of evidence: moderate
- Direction of effect estimates: decreasing birth weight with increasing exposure to PFOA
- Confidence in effect estimates: confidence based on the consistency of the results and overlapping CIs
- Other compelling attributes of the data that may influence certainty: none.
We compared these considerations with the definitions in Table 2 and concluded that the animal evidence is sufficient to conclude that exposure to PFOA or its salts adversely affect fetal growth in animals.
Animal Evidence for PFOA and Fetal Growth
Based on this first application of the Navigation Guide systematic review methodology, we found “sufficient” evidence that fetal developmental exposure to PFOA or its salts reduces fetal growth in animals. Our finding that the data were “sufficient” was based on “moderate” quality mammalian evidence, reduction in mean offspring birth weight from dams exposed to increasing concentrations of PFOA during pregnancy, and our confidence in the effect based on the consistency of the results and overlapping CIs. Analysis of the scatter plots of the studies excluded from the meta-analysis supported that the majority of these studies also found consistently small reductions in measures of fetal growth following maternal exposure to PFOA.
From the meta-analysis of eight mouse gavage data sets, we estimated that exposure of pregnant mice to increasing concentrations of PFOA was associated with a change in mean pup birth weight of –0.023 g (95% CI: –0.029, –0.016) per 1-unit increase in dose (mg/kg BW/day). To assess the biological significance of this estimate, we pooled birth weight measurements from each of the eight control groups to estimate an overall mean birth weight of 1.57 g for the pups in control groups. A 0.023 g decrease in body weight is equivalent to an approximate 1.46% decrease in average body weight per 1-unit increase in PFOA dose. Thus, for example, according to this model, a dose of 10 mg/kg BW/day PFOA to pregnant dams is estimated to result in approximately a 15% decrease in the litter’s average birth weight.
To address the heterogeneity of the available evidence, we limited the meta-analysis to data from mouse studies. The rationale for this decision was based in part on findings from pharmacokinetic studies documenting that the rate of elimination for PFOA is much faster for female rats compared with other mammalian species, including humans (Lau et al. 2007). Many of the studies included in our meta-analysis cited rate of elimination differences as a supporting reason for using mouse model systems. However, responses between mouse model systems may differ as well; evidence suggests that responses to PFOA may vary based on the mouse strain tested. One study noted that the 129S1/SvlmJ strain was more sensitive to PFOA exposure compared with the CD-1 strain (Abbott et al. 2007). We included data from the 129S1/SvlmJ strain in our meta-analysis because, in the absence of evidence supporting which mouse strain best matches human sensitivity to PFOA, there was no evidence to support a premise that humans are less sensitive than the most sensitive mouse. This is further supported by studies of agents known to cause reproductive toxicity, for which “humans appear to be as or more sensitive than the most sensitive animal species tested” (U.S. EPA 1996). Additionally, our sensitivity analysis found removing this study from the meta-analysis resulted in minimal changes in the meta-analysis estimate (< 2%) (data not shown).
The heterogeneity of the nonmammalian animal data precluded combining these studies quantitatively. Our identification of studies among such diverse species was unexpected, and for this case study, we combined all nonmammalian species into a single body of evidence. This did not impede decision making about toxicity of PFOA and fetal growth because more direct mammalian and human data were available. However, for other chemicals, heterogeneous indirect evidence may be the only data available on which to base a decision. This points to the need to anticipate and plan for the analysis of heterogeneous data—including whether it is appropriate to evaluate each species separately—and to determine relevance to human health beforehand in future protocols.
Application of the Navigation Guide Systematic Review Methodology
We found the application of the Navigation Guide method to be effective in producing a concise statement of health hazard in a systematic and transparent manner. Although our review did not identify any studies relevant to our study question that were published in languages other than English, it is difficult to predict in which cases excluding non-English studies may bias a systematic review (Sterne et al. 2011b). Therefore, for future reviews we would retain this strategy. Moreover, our systematic search identified > 1,900 studies that we did not find in a previous search that we conducted at the initiation of the project using traditional nonsystematic methods, and our improved search strategy nearly doubled the number of studies that met our prespecified inclusion criteria.
Despite a steep learning curve, designing and completing the search, eliminating duplicate records, screening studies, and extracting study characteristics and data took 2–3 months, including time to train review authors. Contact with study authors to obtain additional information took place over the course of approximately 3 months. Risk of bias assessment, data analysis, and evaluation of quality and strength of evidence took approximately 2–3 additional months.
An inevitable limitation of this first case study was that we were simultaneously developing and applying the method. As a result, we did not anticipate or define beforehand all the benchmarks we ultimately used for making judgments when rating the quality and strength of the evidence, and we found that our decision making was more difficult in the absence of prespecified definitions. To guide our judgments when assessing quality and strength of evidence factors that had not been prespecified, we a) sought an empirical basis for a judgment; b) conducted further analysis (i.e., sensitivity); c) relied on GRADE’s principle to be conservative in the judgment of rating down; and d) always documented the rationale for our judgment. Anticipating and defining prespecified criteria for as many judgments as possible will improve the method; however, it seems unlikely that all judgments can be anticipated. Thus, the principles we used for judgments subsequent to the analysis will be integrated into future protocols to transparently allow for such circumstances.
Challenges in Translating Experimental Animal Evidence into Improved Health Outcomes
In applying the Navigation Guide systematic review methodology, we found that the high prevalence of suboptimal study design and reporting in experimental animal studies that has been empirically documented in the preclinical literature (Bebarta et al. 2003; Landis et al. 2012; Macleod et al. 2004, 2008; McPartland et al. 2007; van der Worp and Macleod 2011; van der Worp et al. 2007; Vesterinen et al. 2011) may also be prevalent in the experimental animal data that inform decision making in environmental health. In nearly all of the studies included in our review, direct evidence to support risk of bias ratings, such as clear descriptions of randomization or blinding methods, was missing. Furthermore, many studies failed to report some of the basic data necessary for interpretation of results and incorporation into meta-analysis. For example, multiple studies failed to report data such as the number of animals included in outcome measurements (e.g., number of litters assessed, number of pups per litter), details on how offspring were weighed (e.g., individually, as a whole litter), or the time point of outcome assessment (e.g., clear definition of PND1, monitoring of parturition). To create scatter plots and perform a meta-analysis, we needed to contact the lead author of every study to obtain missing data. Fortunately, authors for most of the studies responded, and many generously took the time and effort to provide raw data for inclusion in this review. Our follow-up with the authors indicated that many of these missing data were a result of deficiencies in reporting and point to the need to include contacting study authors as a step in the protocol.
These findings underscore the urgency of calls for improved experimental-animal study design and reporting in the preclinical arena (Beronius et al. 2014; Krauth et al. 2013; Landis et al. 2012; van der Worp and Macleod 2011; Vesterinen et al. 2010, 2011). To this end, a major stakeholder meeting by the National Institute of Neurological Disorders and Stroke found that at a minimum, studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data (Landis et al. 2012). It will be important for environmental health scientists and journals that publish environmental health research to help support these nascent efforts to advance the translational relevance of animal evidence into improved health outcomes (Howells and Macleod 2013; Macleod et al. 2009; van der Worp et al. 2010; Vesterinen et al. 2011).
Summary and Conclusion
This case study documents that the Navigation Guide methodology can be used to effectively apply the rigor of evidence synthesis methods in use by the clinical sciences to questions in environmental health. The Navigation Guide methodology does not eliminate the need for expert judgment, but it does a) make clear the evidence that informs the authors’ judgments and b) require transparency and an explicit accounting of the judgments involved.
In addition to this review of the animal evidence, a separate systematic review was conducted evaluating the human evidence relevant to PFOA exposure and fetal growth, which resulted in a “sufficient” evidence of toxicity rating (Johnson et al. 2014). In another paper, the strength of the evidence ratings from the nonhuman and human evidence were combined according to the factors specified in the Navigation Guide (Woodruff et al. 2011a), resulting in an overall conclusion by the review authors that human exposure to PFOA is “known to be toxic” to human reproduction and development based on “sufficient” evidence of decreased fetal growth in both human and nonhuman mammalian species (Lam et al. 2014). Together, these reviews demonstrate the utility of the Navigation Guide in systematically approaching a complex body of scientific evidence.
The ultimate goal of our efforts is to refine the Navigation Guide systematic review methodology across diverse streams of evidence and to support the development of recommendations for prevention in clinical and policy spheres. As has been demonstrated in the clinical field, the adoption of systematic and transparent methods to synthesize the scientific evidence in the environmental health field would speed incorporation of research into decision making.
Abbott BD, Wolf CJ, Schmid JE, Das KP, Zehr RD, Helfant L, et al. 2007. Perfluorooctanoic acid–induced developmental toxicity in the mouse is dependent on expression of peroxisome proliferator–activated receptor-alpha. Toxicol Sci 98:571–581.
Apelberg BJ, Goldman LR, Calafat AM, Herbstman JB, Kuklenyik Z, Heidler J, et al. 2007a. Determinants of fetal exposure to polyfluoroalkyl compounds in Baltimore, Maryland. Environ Sci Technol 41:3891–3897.
Apelberg BJ, Witter FR, Herbstman JB, Calafat AM, Halden RU, Needham LL, et al. 2007b. Cord serum concentrations of perfluorooctane sulfonate (PFOS) and perfluorooctanoate (PFOA) in relation to weight and size at birth. Environ Health Perspect 115:1670–1676; doi: 10.1289/ehp.10334.
ATSDR (Agency for Toxic Substances and Disease Registry). 2009. Draft Toxicological Profile for Perfluoroalkyls. Available: http://www.atsdr.cdc.gov/toxprofiles/tp200.pdf [accessed 13 February 2013].
Beronius A, Molander L, Rudén C, Hanberg A. 2014. Facilitating the use of non-standard in vivo studies in health risk assessment of chemicals: a proposal to improve evaluation criteria and reporting. J Appl Toxicol 34:607–617; doi: 10.1002/jat.2991.
Boberg J, Metzdorff S, Wortziger R, Axelstad M, Brokken L, Vinggaard AM, et al. 2008. Impact of diisobutyl phthalate and other PPAR agonists on steroidogenesis and plasma insulin and leptin levels in fetal rats. Toxicology 250:75–81.
Calafat AM, Kuklenyik Z, Reidy JA, Caudill SP, Tully JS, Needham LL. 2007. Serum concentrations of 11 polyfluoroalkyl compounds in the U.S. population: data from the National Health and Nutrition Examination Survey (NHANES). Environ Sci Technol 41:2237–2242.
CDC (Centers for Disease Control and Prevention). 2009. Fourth National Report on Human Exposure to Environmental Chemicals. Atlanta, GA:CDC. Available: http://www.cdc.gov/exposurereport/ [accessed 6 February 2013].
Deeks JJ, Higgins JPT, Altman DG, eds. 2011. Chapter 9: Analysing data and undertaking meta-analyses. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (Higgins JPT, Green S, eds). Available: http://www.cochrane-handbook.org [accessed 15 April 2013].
Fei C, McLaughlin JK, Tarone RE, Olsen J. 2007. Perfluorinated chemicals and fetal growth: a study within the Danish National Birth Cohort. Environ Health Perspect 115:1677–1682; doi: 10.1289/ehp.10506.
Fenton SE, Reiner JL, Nakayama SF, Delinsky AD, Stanko JP, Hines EP, et al. 2009. Analysis of PFOA in dosed CD-1 mice. Part 2. Disposition of PFOA in tissues and fluids from pregnant and lactating mice and their pups. Reprod Toxicol 27:365–372.
Hagenaars A, Vergauwen L, De Coen W, Knapen D. 2011. Structure-activity relationship assessment of four perfluorinated chemicals using a prolonged zebrafish early life stage test. Chemosphere 82:764–772.
Higgins JPT, Altman DJ, Sterne JAC, eds. 2011. Chapter 8: Assessing risk of bias in included studies. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (Higgins JPT, Green S, eds). Available: http://www.cochrane-handbook.org [accessed 7 February 2013].
Higgins JPT, Deeks JJ, eds. 2011. Chapter 7: Selecting studies and collecting data. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (Higgins JPT, Green S, eds). Available: http://www.cochrane-handbook.org [accessed 7 February 2013].
Hines EP, White SS, Stanko JP, Gibbs-Flournoy EA, Lau C, Fenton SE. 2009. Phenotypic dichotomy following developmental exposure to perfluorooctanoic acid (PFOA) in female CD-1 mice: low doses induce elevated serum leptin and insulin, and overweight in mid-life. Mol Cell Endocrinol 304:97–105.
Hooijmans CR, Leenaars M, Ritskes-Hoitinga M. 2010a. A gold standard publication checklist to improve the quality of animal studies, to fully integrate the Three Rs, and to make systematic reviews more feasible. Altern Lab Anim 38:167–182.
Hooijmans CR, Tillema A, Leenaars M, Ritskes-Hoitinga M. 2010b. Enhancing search efficiency by means of a search filter for finding all studies on animal experimentation in PubMed. Lab Anim 44:170–175.
IARC (International Agency for Research on Cancer). 2006. IARC Monographs on the Evaluation of Carcinogenic Risks to Humans: Preamble. Available: http://monographs.iarc.fr/ENG/Preamble/CurrentPreamble.pdf [accessed 7 February 2013].
Institute of Medicine. 2007. Preterm Birth: Causes, Consequences, and Prevention. Washington, DC:National Academies Press. Available: http://books.nap.edu/openbook.php?record_id=11622 [accessed 25 August 2014].
Johnson PI, Sutton P, Atchley D, Koustas E, Lam J, Sen S, et al. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1028–1039; doi: 10.1289/ehp.1307893.
Kannan K, Corsolini S, Falandysz J, Fillmann G, Kumar KS, Loganathan BG, et al. 2004. Perfluorooctanesulfonate and related fluorochemicals in human blood from several countries. Environ Sci Technol 38:4489–4495.
Kimmel CA, Holson JF, Hogue CJ, Carlo GL. 1984. Reliability of Experimental Studies for Predicting Hazards to Human Development. NCTR Technical Report for Experiment 6015. Jefferson, AR:National Center for Toxicological Research.
Koustas E, Lam J, Sutton P, Johnson P, Atchley D, Sen S, et al. 2013. Applying the Navigation Guide: Case Study #1. The Impact of Developmental Exposure to Perfluorooctanoic Acid (PFOA) On Fetal Growth. A Systematic Review of the Non-Human Evidence: Final Protocol. Available: http://prhe.ucsf.edu/prhe/pdfs/PFOA%20NON-HUMAN%20PROTOCOL.pdf [accessed 26 August 2014].
Krauth D, Woodruff TJ, Bero L. 2013. Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review. Environ Health Perspect 121:985–992; doi: 10.1289/ehp.1206389.
Lam J, Koustas E, Sutton P, Johnson PI, Atchley DS, Sen S, et al. 2014. The Navigation Guide—evidence-based medicine meets environmental health: integration of animal and human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1040–1051; doi: 10.1289/ehp.1307923.
Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM, et al. 2009. Good laboratory practice: preventing introduction of bias at the bench. Stroke 40:e50–e52; doi: 10.1161/STROKEAHA.108.525386.
Macleod MR, van der Worp HB, Sena ES, Howells DW, Dirnagl U, Donnan GA. 2008. Evidence for the efficacy of NXY-059 in experimental focal cerebral ischaemia is confounded by study quality. Stroke 39:2824–2829.
Midasch O, Drexler H, Hart N, Beckmann MW, Angerer J. 2007. Transplacental exposure of neonates to perfluorooctanesulfonate and perfluorooctanoate: a pilot study. Int Arch Occup Environ Health 80:643–648.
Mondal D, Lopez-Espinosa MJ, Armstrong B, Stein CR, Fletcher T. 2012. Relationships of perfluorooctanoate and perfluorooctane sulfonate serum concentrations between mother–child pairs in a population with perfluorooctanoate exposure from drinking water. Environ Health Perspect 120:752–757; doi: 10.1289/ehp.1104538.
Mylchreest E. 2003. PFOA: Lactational and Placental Transport Pharmacokinetic Study in Rats. Laboratory Project ID: DuPont-13309. U.S. EPA Administrative Record 226–1551. Newark, DE:Haskell Laboratory for Health and Environmental Sciences. Available: http://www.epa.gov/oppt/tsca8e/pubs/8ehq/2004/jan04/8ehq_0104_00373ay.pdf [accessed 10 September 2014].
O’Brien JM, Crump D, Mundy LJ, Chu S, McLaren KK, Vongphachan V, et al. 2009. Pipping success and liver mRNA expression in chicken embryos exposed in ovo to C8 and C11 perfluorinated carboxylic acids and C10 perfluorinated sulfonate. Toxicol Lett 190:134–139.
O’Connor D, Green S, Higgins JPT, eds. 2011. Chapter 5: Defining the review question and developing criteria for including studies. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (Higgins JPT, Green S, eds). Available: http://www.cochrane-handbook.org [accessed 15 April 2013].
Olsen GW, Burris JM, Ehresman DJ, Froehlich JW, Seacat AM, Butenhoff JL, et al. 2007. Half-life of serum elimination of perfluorooctanesulfonate, perfluorohexanesulfonate, and perfluorooctanoate in retired fluorochemical production workers. Environ Health Perspect 115:1298–1305; doi: 10.1289/ehp.10009.
Sawaya GF, Guirguis-Blake J, LeFevre M, Harris R, Petitti D. 2007. Update on the methods of the U.S. Preventative Services Task Force: estimating certainty and magnitude of net benefit. Ann Intern Med 147:871–875.
Sterne JAC, Egger M, Moher D, eds. 2011b. Chapter 10: Addressing reporting biases. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (Higgins JPT, Green S, eds). Available: http://www.cochrane-handbook.org [accessed 22 April 2013].
Sterne JAC, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, et al. 2011a. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 343:d4002; doi: 10.1136/bmj.d4002.
U.S. EPA (U.S. Environmental Protection Agency). 1991. Guidelines for Developmental Toxicity Risk Assessment. Available: http://www.epa.gov/raf/publications/pdfs/DEVTOX.PDF [accessed 10 September 2014].
U.S. EPA (U.S. Environmental Protection Agency). 1996. Guidelines for Reproductive Toxicity Risk Assessment. Available: http://www.epa.gov/raf/publications/pdfs/REPRO51.PDF [accessed 10 September 2014].
U.S. EPA (U.S. Environmental Protection Agency). 2008. EPA Announces Substantial Decrease of PFOA [News Release]. Available: http://yosemite.epa.gov/opa/admpress.nsf/68b5f2d54f3eefd28525701500517fbf/8f9dbdd044050f71852573e50064439f!OpenDocument [accessed 3 February 2013].
U.S. EPA (U.S. Environmental Protection Agency). 2009. Long-Chain Perfluorinated Chemicals (PFCs) Action Plan. Available: http://www.epa.gov/oppt/existingchemicals/pubs/pfcs_action_plan1230_09.pdf [accessed 3 February 2013].
U.S. EPA (U.S. Environmental Protection Agency). 2012. Industry Progressing in Voluntary Effort to Reduce Toxic Chemicals / Companies Have Successfully Developed over 150 Alternatives to Long-Chain Perfluorinated Chemicals [News Release: ]. Available: http://yosemite.epa.gov/opa/admpress.nsf/79c090e81f0578738525781f0043619b/335d29e8d5e40864852579a0005f3760!OpenDocument [accessed 11 February 2013].
U.S. EPA (U.S. Environmental Protection Agency). 2013a. 2012 Annual Progress Reports. Available: http://www.epa.gov/oppt/pfoa/pubs/stewardship/preports6.html [accessed 25 September 2013].
U.S. EPA (U.S. Environmental Protection Agency). 2013b. America’s Children and the Environment. 3rd ed. Available: http://www.epa.gov/ace/publications/ACE3_2013.pdf [accessed 19 February 2013].
U.S. EPA (U.S. Environmental Protection Agency). 2014. Emerging Contaminants–Perfluorooctane Sulfonate (PFOS) and Perfluorooctanoic Acid (PFOA). Available: http://www2.epa.gov/sites/production/files/2014-04/documents/factsheet_contaminant_pfos_pfoa_march2014.pdf [accessed 10 September 2014].
van der Worp HB, Howells DW, Sena ES, Porritt MJ, Rewell S, O’Collins V, et al. 2010. Can animal models of disease reliably inform human studies? PLoS Med 7:e1000245; doi: 10.1371/journal.pmed.1000245.
Vesterinen HM, Egan K, Deister A, Schlattmann P, Macleod MR, Dirnagl U. 2011. Systematic survey of the design, statistical analysis, and reporting of studies published in the 2008 volume of the Journal of Cerebral Blood Flow and Metabolism. J Cereb Blood Flow Metab 31:1064–1072.
Washino N, Saijo Y, Sasaki S, Kato S, Ban S, Konishi K, et al. 2009. Correlations between prenatal exposure to perfluorinated chemicals and reduced fetal growth. Environ Health Perspect 117:660–667; doi: 10.1289/ehp.11681.
White SS, Calafat AM, Kuklenyik Z, Villanueva L, Zehr RD, Helfant L, et al. 2007. Gestational PFOA exposure of mice is associated with altered mammary gland development in dams and female offspring. Toxicol Sci 96:133–144.
White SS, Kato K, Jia LT, Basden BJ, Calafat AM, Hines EP, et al. 2009. Effects of perfluorooctanoic acid on mouse mammary gland development and differentiation resulting from cross-foster and restricted gestational exposures. Reprod Toxicol 27:289–298.
White SS, Stanko JP, Kato K, Calafat AM, Hines EP, Fenton SE. 2011. Gestational and chronic low-dose PFOA exposures and mammary gland growth and differentiation in three generations of CD-1 mice. Environ Health Perspect 119:1070–1076; doi: 10.1289/ehp.1002741.
Wolf CJ, Fenton SE, Schmid JE, Calafat AM, Kuklenyik Z, Bryant XA, et al. 2007. Developmental toxicity of perfluorooctanoic acid in the CD-1 mouse after cross-foster and restricted gestational exposures. Toxicol Sci 95:462–473.
Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; doi: 10.1289/ehp.1307175.
Woodruff TJ, Sutton P, Navigation Guide Work Group. 2011a. An evidence-based medicine methodology to bridge the gap between clinical and environmental health sciences. Health Aff (Millwood) 30:931–937.
Woodruff TJ, Zota AR, Schwartz JM. 2011b. Environmental chemicals in pregnant women in the United States: NHANES 2003–2004. Environ Health Perspect 119:878–885; doi: 10.1289/ehp.1002727.
York RG. 2002. Oral (Gavage) Two-Generation (One Litter per Generation) Reproduction Study of Ammonium Perfluorooctanoate (APFO) in Rats. Sponsor’s Study No. T-6889.6. U.S. EPA Administrative Record 226–1092. Horsham, PA:Argus Research.
York RG, Kennedy GL Jr, Olsen GW, Butenhoff JL. 2010. Male reproductive system parameters in a two-generation reproduction study of ammonium perfluorooctanoate in rats and human relevance. Toxicology 271:64–72.
Sign Up to Receive E-mail Alerts
Recent Advance Publications
Vehicular Traffic-Related Polycyclic Aromatic Hydrocarbon Exposure and Breast Cancer Incidence: The Long Island Breast Cancer Study Project (LIBCSP)
Prepubertal Serum Concentrations of Organochlorine Pesticides and Age at Sexual Maturity in Russian Boys
A Unified Probabilistic Framework for Dose–Response Assessment of Human Health Effects
A Case–Control Study of Prenatal Thallium Exposure and Low Birth Weight in China
Associations of Perfluoroalkyl Substances (PFASs) with Lower Birth Weight: An Evaluation of Potential Confounding by Glomerular Filtration Rate Using a Physiologically Based Pharmacokinetic Model (PBPK)