Review Volume 122 | Issue 10 | October 2014
Environ Health Perspect; DOI:10.1289/ehp.1307893
The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Human Evidence for PFOA Effects on Fetal Growth
Paula I. Johnson,1 Patrice Sutton,1 Dylan S. Atchley,1 Erica Koustas,2 Juleen Lam,2 Saunak Sen,3 Karen A. Robinson,4,5,6 Daniel A. Axelrad,7 and Tracey J. Woodruff1
Background: The Navigation Guide methodology was developed to meet the need for a robust method of systematic and transparent research synthesis in environmental health science. We conducted a case study systematic review to support proof of concept of the method.
Objective: We applied the Navigation Guide systematic review methodology to determine whether developmental exposure to perfluorooctanoic acid (PFOA) affects fetal growth in humans.
Methods: We applied the first 3 steps of the Navigation Guide methodology to human epidemiological data: 1) specify the study question, 2) select the evidence, and 3) rate the quality and strength of the evidence. We developed a protocol, conducted a comprehensive search of the literature, and identified relevant studies using prespecified criteria. We evaluated each study for risk of bias and conducted meta-analyses on a subset of studies. We rated quality and strength of the entire body of human evidence.
Results: We identified 18 human studies that met our inclusion criteria, and 9 of these were combined through meta-analysis. Through meta-analysis, we estimated that a 1-ng/mL increase in serum or plasma PFOA was associated with a –18.9 g (95% CI: –29.8, –7.9) difference in birth weight. We concluded that the risk of bias across studies was low, and we assigned a “moderate” quality rating to the overall body of human evidence.
Conclusion: On the basis of this first application of the Navigation Guide systematic review methodology, we concluded that there is “sufficient” human evidence that developmental exposure to PFOA reduces fetal growth.
Citation: Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1028–1039; http://dx.doi.org/10.1289/ehp.1307893
Address correspondence to P.I. Johnson, California Department of Public Health, Occupational Health Branch, 850 Marina Bay Parkway, Building P, Richmond, CA 94804 USA. Telephone: (510) 620-5711. E-mail: email@example.com
We acknowledge the following persons for their contributions: K. Guyton [National Center for Environmental Assessment, Washington Division, Office of Research and Development, U.S. Environmental Protection Agency (EPA)] for assistance with developing evidence evaluation methodologies and identifying relevant toxicological databases; K. Thayer, A. Rooney, and A. Boyles (Office of Health Assessment and Translation, National Toxicology Program), L. Bero [Department of Clinical Pharmacy, University of California, San Francisco (UCSF)], and L. Zeise (Reproductive and Cancer Hazard Assessment Branch, Office of Environmental Health Hazard Assessment, California Environmental Protection Agency) for assistance with developing risk of bias and evidence evaluation criteria; C. Lau (National Health and Environmental Effects Research Laboratory, Office of Research and Development, U.S. EPA) served as a perfluorooctanoic acid (PFOA) subject matter expert; T. Horvath (Prevention and Public Health Group, and Co-Managing Editor of the Cochrane Review Group on HIV/AIDS at UCSF) for training and assistance with developing our search strategy; J. Pan (UCSF) for assistance with data extraction and thoughtful comments. Finally, we are grateful to M.-H. Chen, K. Choi, L.R. Goldman, R. Kishi, J.-H. Lee, and M. Marcus for their kind and timely response to requests for additional data and information and to the anonymous reviewers who helped to improve this manuscript.
This research was funded through grants from New York Community Trust and the U.S. EPA through a contract with Abt Associates (GAIA-0-6-UCSF 17288). E.K. and J.L. were supported in part by appointments to the Internship/Research Participation Program at the National Center for Environmental Economics, U.S. EPA, administered by the Oak Ridge Institute for Science and Education through an interagency agreement between the U.S. Department of Energy and the U.S. EPA. For 2009–2013, support for the development and dissemination of the Navigation Guide methodology was provided by the Clarence Heller Foundation, the Passport Foundation, the Forsythia Foundation, the Johnson Family Foundation, the Heinz Endowments, the Fred Gellert Foundation, the Rose Foundation, Kaiser Permanente, the New York Community Trust, the UCSF Institute for Health Policy Studies, Planned Parenthood Federation of America, National Institute of Environmental Health Sciences (ES018135 and ESO22841), and U.S. EPA STAR grants (RD83467801 and RD83543301). T.J.W is a faculty member at the Philip R. Lee Institute for Health Policy Studies, UCSF.
The contents of this paper are solely the responsibility of the authors and do not necessarily represent the official views of the U.S. EPA. Further, the U.S. EPA does not endorse the purchase of any commercial products or services mentioned in the publication.
The authors declare they have no actual or potential competing financial interests.
Received: 15 November 2013
Accepted: 23 June 2014
Advance Publication: 25 June 2014
Final Publication: 1 October 2014
- Supplemental Material (1.4 MB) PDF
Synthesizing environmental health research from multiple streams of evidence is critical to translating the science into improved health outcomes. Robust, systematic, and transparent methods of research synthesis are an identified need in environmental health (National Research Council 2011). Such methods already exist to evaluate clinical evidence (GRADE Working Group 2012; Higgins and Green 2011) and include steps such as developing a prespecified protocol, a comprehensive search, and rating the quality of the evidence. Although methods of synthesizing clinical research are primarily applied to randomized controlled clinical trials, the evidence streams for environmental health science are different. The Navigation Guide systematic review methodology was developed to apply best practices in research synthesis in clinical medicine and environmental health to the evidence streams common in environmental health science (i.e., experimental toxicological studies and observational human studies) in order to reach an overall conclusion about the strength of evidence (Woodruff et al. 2011a). Additional background on the Navigation Guide is given in a companion commentary (Woodruff and Sutton 2014).
We undertook a case study to apply the Navigation Guide methodology. For this first case study, we evaluated the evidence for the effects of exposure to perfluorooctanoic acid (PFOA) on fetal growth. PFOA has been used for > 50 years in the manufacture of fluoropolymers used in industrial applications and consumer products to impart certain characteristics, such as fire and stain resistance [Prevedouros et al. 2006; U.S. Environmental Protection Agency (EPA) 2012]. We selected PFOA for evaluation based on pervasive human exposure and the evidence of associations with fetal growth (Agency for Toxic Substances and Disease Registry 2009; Apelberg et al. 2007; Fei et al. 2007, 2008; Kato et al. 2011; U.S. EPA 2012). In addition, there have been inconsistent conclusions about the evidence of an association between PFOA and fetal growth (DeWitt et al. 2009; Hekster et al. 2003; Jensen and Leffers 2008; Kennedy et al. 2004; Kudo and Kawashima 2003; Lau et al. 2004, 2007; Lindstrom et al. 2011; Olsen et al. 2009; Post et al. 2012; Steenland et al. 2010; White et al. 2011).
In this review, we evaluate the human epidemiologic evidence relating PFOA exposure to fetal growth using the Navigation Guide systematic review approach. The results of applying the Navigation Guide methodology to the nonhuman evidence are presented in another review (Koustas et al. 2014), and the results of applying the Navigation Guide methodology to integrate the human and nonhuman evidence streams are presented in a third review (Lam et al. 2014).
We assembled a review team with expertise in the fields of systematic review, environmental health, epidemiology, biology, statistics, and risk assessment to develop a a prespecified protocol for conducting the systematic review [University of California, San Francisco (UCSF) Program on Reproductive Health and the Environment 2013]. More information about the review team is available in the companion commentary by Woodruff and Sutton (2014).
Step 1. Specify the Study Question
Our objective was to answer the question: “Does fetal developmental exposure to PFOA affect fetal growth in humans?” We developed a PECO (participants, exposure, comparator, and outcomes) statement, which is used as an aid to developing an answerable question (Higgins and Green 2011). Our PECO statement included the following:
- Participants: humans who are studied during the reproductive/developmental time period (before and/or during pregnancy or development)
- Exposure: exposure to PFOA (CAS# 335-67-1) or its salts during the time before pregnancy and/or during pregnancy for females or directly to fetuses
- Comparators: humans exposed to lower levels of PFOA than the more highly exposed humans (i.e., a comparison across a range of exposures)
- Outcomes: effects on fetal growth, birth weight, and/or other measures of size, such as length.
Step 2. Select the Evidence
Search methods. We developed search terms to identify relevant literature by using the medical subject headings (MeSH) in PubMed (http://www.ncbi.nlm.nih.gov/pubmed) and other key words for five articles known to us and that we judged to be relevant to our study question. Our search was not limited by language or publication date. The search terms for each database, which include terms related to the exposure, the outcome, and the human subjects, are provided in Supplemental Material, Table S1. We searched PubMed (30 April 2012), Embase (http://www.elsevier.com/online-tools/embase; 7 May 2012), Web of Science (http://apps.webofknowledge.com/; 11 May 2012), and other databases (23–27 April 2012). The specific databases searched and numbers of records retrieved are provided in Supplemental Material, Table S2. We also hand searched the reference lists of all included studies and used Web of Science to search for articles that cited the included studies.
Study selection criteria. We selected studies in which human exposure to PFOA was measured or estimated, and associations with fetal growth were evaluated. We did not require fetal growth to be the main outcome of the study. We screened studies for inclusion using a structured form in DistillerSR (Evidence Partners; http://www.systematic-review.net). Two review authors (P.I.J. and D.S.A.) independently conducted a title and abstract screen of the search results to determine whether a reference met the inclusion criteria; studies that were not excluded based on the title and abstract were screened through a full-text review. A third author (P.S.) screened 5% of the search results at the title/abstract and full-text stages for quality assurance. Following the screening and in the case of discrepant results between reviewers, the initial two reviewers (P.I.J. and D.S.A.) discussed each discrepancy and brought in the third reviewer (P.S.) if necessary to discuss and decide on the status (include/exclude) of each discrepancy.
We excluded studies if
- The article did not contain original data or observations
- Study subjects were not humans
- Exposure to PFOA was not measured in, or estimated for, the study subjects
- PFOA exposure was not measured or estimated during the reproductive/developmental time period (any time before or during pregnancy for women, or directly in fetuses, including cord blood)
- Fetal or infant growth or birth weight was not measured.
Data collection. Two review authors (P.I.J. and D.S.A.) worked together to extract the data from all of the included articles. We compared all of the extracted data with the same data that was independently extracted by a third researcher (J. Pan; UCSF) for quality assurance and quality control. We planned to discuss any discrepancies among the three extractors to come to a consensus. We collected details of the study characteristics, exposure assessment, outcome measurements, and information used to assess risk of bias using a structured form in DistillerSR; we created this form by combining aspects of existing criteria and checklists (Guyatt et al. 2011b; Higgins and Deeks 2011; von Elm et al. 2008). We contacted study authors to obtain data needed for the analysis that were not reported in the published articles.
Step 3. Rate the Quality and Strength of the Evidence
We rated the quality and strength of the evidence by a) assessing “risk of bias,” defined as characteristics of a study that can introduce a systematic error in the magnitude or direction of the results of the study (Higgins and Green 2011), for each included study; b) rating the quality of the evidence across all studies; and c) rating the strength, or certainty, of the evidence across all studies (Figure 1).
Assessing the risk of bias for each included study. We assessed risk of bias for each included study using an instrument we developed by adapting existing risk of bias guidance used to evaluate human studies in the clinical sciences: the Cochrane Collaboration’s Risk of Bias tool (Higgins and Green 2011) and the Agency for Healthcare Research and Quality’s criteria (Viswanathan et al. 2012). We also included the funding source and declared conflicts of interest as a potential source of bias based on empirical data from studies conducted on pharmacological treatments that reported evidence of bias associated with funding source (Krauth et al. 2013; Lundh et al. 2012). We considered whether the study received “support from a company, study author, or other entity having a financial interest in the outcome of the study” (see Supplemental Material, “Instructions for Making Risk of Bias Determinations”). Although we refer generally to this risk of bias domain as “conflicts of interest,” we only assessed competing financial interests in this case study.
We assigned each risk of bias domain as “low risk,” “probably low risk,” “probably high risk,” “high risk,” or “not applicable” (risk of bias area not applicable to the study). Our protocol provided specific instructions for each classification to help ensure consistent interpretation. The specific risk of bias instrument is provided in Supplemental Material, “Instructions for Making Risk of Bias Determinations.” A summary of the criteria for “low risk” of bias for each domain is outlined in Table 1. Two review authors (P.I.J. and D.S.A.) independently made and documented risk of bias determinations for each study across all domains. When these two authors could not reach consensus on a risk of bias domain, two other authors (P.S. and J.L.) reviewed the results. If upon further discussion the four authors were unable to reach agreement on a risk of bias determination for a particular domain, the more conservative judgment was selected (e.g., if one reviewer made a judgment of “low risk” and the other made a judgment of “probably low risk,” the “probably low risk” judgment was used).
In addition to the instructions in the protocol, we made the following decisions for rating the blinding and confounding risk of bias domains. We judged a study to be low risk of bias for blinding when it described that specimen samples were coded or otherwise blinded. We judged a study to be probably low risk of bias when it described only partial blinding or described methods that would have effectively blinded investigators to the exposure and outcome groups (e.g., exposure was measured separately, and birth weight was obtained from a hospital record). Our criterion for designating low risk of bias for confounding required that studies account for only two potential confounders, those we deemed the main “important” confounders. Based on existing data and a priori knowledge of the exposure and outcome of interest in all the studies, we decided that maternal age and gestational age were the main “important” potential confounders for all the included studies. Maternal age and gestational age may be correlated with PFOA exposure and fetal growth (Fei et al. 2007; Halldorsson et al. 2012; Ode et al. 2013). We considered studies “low risk” of bias for confounding if the study authors accounted for both maternal age and gestational age in their design or analysis or if they reported that either confounder did not influence associations between PFOA and the outcome being asessed. We considered studies high risk of bias if the study authors did not account for either maternal age or gestational age, and probably high risk if they did not account for gestational age in the data analysis but restricted the analysis of birth weight to term births due to the potential for residual confounding by gestational age among term births.
Data evaluation and meta-analysis. We assessed the following study characteristics to determine whether studies were combinable in a meta-analysis: measure of fetal growth outcome, study design, exposure assessment, and data analysis. We compared different measures of exposure, such as cord or maternal serum, to determine whether they were comparable. Biomarkers and timing of PFOA exposure assessments differed across studies, that is, PFOA was measured at different times during pregnancy in cord serum, maternal serum, and maternal plasma. Despite these differences, there was evidence of high correlation of PFOA concentrations between these matrices within the same populations: between cord and maternal serum at birth (Fromme et al. 2010; Kim SK et al. 2011; Monroy et al. 2008); between cord and second or third trimester maternal serum or plasma (Fei et al. 2007; Kim S et al. 2011); and between first and second trimester maternal plasma (Fei et al. 2007). We combined studies in the meta-analyses with different measures of PFOA based on this concordance. We also assessed the following study design and data analysis parameters to determine which studies were combinable: the exposure and outcome statistic (continuous, dichotomous, or other scale), whether studies measured actual birth weights or only recorded whether the birth weight was “low” (i.e., < 2,500 g) and which variable was the dependent or independent variable in models of estimated effects. We contacted study authors to request information needed for meta-analysis. We requested linear regression model coefficients for the association between a 1-ng/mL increase in PFOA (modeled as an untransformed continuous variable) and each outcome from authors if they were not reported, or, if less burdensome for authors, the raw data needed to calculate the estimated difference in birth weight. When raw data were provided, we used linear regression models to calculate estimates of change in birth weight per nanogram per milliliter of serum PFOA. We evaluated potential confounders as provided by study authors, one at a time compared with an unadjusted model. We adjusted the regression models by the covariates provided by the study authors if inclusion of the covariate changed the estimate by > 10% compared with the unadjusted model.
We conducted computations for linear regressions, meta-analyses and heterogeneity statistics using STATA, version 12.1 (StataCorp LP). We used the “metaan” command in STATA with the DerSimonian-Laird random-effects method for all meta-analyses to account for potential heterogeneity across studies (DerSimonian and Laird 1986). We used estimates of association between PFOA and fetal growth and the standard error from each study to calculate an overall effect estimate for the following fetal growth measures at birth: weight, length, head circumference, and ponderal index (birth weight divided by length cubed, multiplied by 100).
To test statistical heterogeneity across the study estimates, we estimated the variance corresponding to the between-study variability, and tested the null hypothesis that the between-study variability was absent. We used the Cochran’s Q statistic for this test, which follows a chi-square distribution with n – 1 degrees of freedom (df), where n is the number of studies. We considered a p-value of ≤ 0.05 statistically significant. We calculated and evaluated the I2 test statistic [I2 = 100 × (Q – df)/Q], which is an estimate of the percentage of the variability among study estimates that is due to heterogeneity rather than chance (Higgins and Green 2011). We conducted sensitivity analyses to determine the effect of including estimates from studies with differing characteristics or high risk of bias.
Rating the quality of evidence across studies. The possible ratings for the overall quality of the body of evidence were ”high,” ”moderate,” or ”low.” Following the approach established by the Grading of Recommendations Assessment Development and Evaluation (GRADE) method used in the clinical sciences for making evidence-based decisions for medical interventions (GRADE Working Group 2012), we determined the final rating by assigning a prespecified initial quality rating to the body of evidence, and then considering adjustments (“downgrades” or “upgrades”) to the quality rating based on the characteristics of the studies constituting the body of evidence (Balshem et al. 2011). GRADE guidelines, developed for clinical interventions, assign experimental human studies an initial rating of “high” and observational studies an initial rating of “low” quality (Balshem et al. 2011). However, there is variability in the quality of studies, and not all observational studies are low quality (Viswanathan et al. 2012). In environmental health, human observational data are usually the most directly applicable data available for decision making because ethical considerations virtually preclude human randomized controlled trials (RCTs) in environmental health. We began by rating human observational studies at “moderate” quality to capture both the limitations of observational data and their recognized value in assessing associations between exposure and health outcomes and disease etiology in environmental and clinical sciences (Woodruff and Sutton 2014). When available, experimental human data or “natural experiments” may be considered as “high” quality data if they are comparable to RCTs; however, this was not relevant to this case study, and thus the criteria for determining comparability with RCTs is not yet developed.
We assessed the overall body of human evidence for downgrading and upgrading the prespecified “moderate” quality rating based on eight factors (Table 2). In addition, because we were primarily concerned with underestimating true positive associations in evaluating the potential for publication bias, we therefore considered a) whether the body of evidence was dominated by early studies with negative associations, particularly if the studies were small; b) whether studies were uniformly small; c) if there were enough studies to conduct an examination of patterns of study results (e.g., funnel plots) that might suggest publication bias; d) if we obtained unpublished studies with results that differed from published studies; or e) whether a comprehensive literature search was performed. Possible ratings were 0 (no change from “moderate” quality), –1 (one-level downgrade), –2 (two-level downgrade); +1 (one-level upgrade), or +2 (two-level upgrade). The review authors independently evaluated the quality of the evidence and then compared their ratings and rationale for each quality factor. We resolved discrepancies between individual author ratings through discussion until consensus was reached. We were conservative in our judgments of downgrading or upgrading the evidence, consistent with the GRADE approach (i.e., we required compelling rationale) (Guyatt et al. 2011a). We recorded the collective rationale for decisions on the eight factors and for the final rating.
Rating the strength of the evidence across studies. Rating the strength of the evidence across the human studies summarizes the human evidence; this summary will allow for the integration of human and nonhuman streams of evidence, ultimately leading to a concise statement about a chemical’s toxicity (Woodruff et al. 2011a).
We rated the overall strength of the body of human evidence based on a combination of four considerations: a) quality of the body of evidence (i.e., the rating from the previous step); b) direction of the effect estimate; c) confidence in the effect estimate (likelihood that a new study would change our conclusion); and d) other compelling attributes of the data that may influence certainty (Figure 1). We compared the results of rating the strength of the human evidence to the definitions specified in the Navigation Guide for “sufficient evidence of toxicity,” “limited evidence of toxicity,” ”inadequate evidence of toxicity,” or “evidence of lack of toxicity” (Table 3). We based the rating categories for the strength of the evidence on those used by the International Agency for Research on Cancer (IARC 2006). We used criteria and considerations used by IARC (2006), the U.S. Preventive Services Task Force (Sawaya et al. 2007), and the U.S. EPA (1991, 1996) for the type of evidence considered for each of these strength of evidence categories. Review authors independently evaluated the strength of the evidence according to the same four considerations and compared their evaluations, resolved discrepancies by discussion, and recorded the collective rationale for decisions.
Included studies. Our search retrieved a total of 3,023 unique records, of which 17 articles met the inclusion criteria (Figure 2). One of the 17 articles contained the results of two separate data sets (Savitz et al. 2012b), and hand searching the reference lists of the 17 included articles identified 1 additional study not yet indexed in the databases searched. Therefore, we included a total of 19 data sets in our analysis (Table 4). The studies covered the years 1988–2009, included populations located in nine countries, and ranged from 17 to 11,737 study subjects (Table 4).
Figure 2 – Flowchart showing the literature search and screening process. The primary goal of our search was to obtain comprehensive results; therefore, our search was not limited by language or publication date. The search terms for each database are provided in Supplemental Material, Table S1.
Risk of bias assessment for individual studies. We concluded that there was generally low risk of bias across the 19 data sets (Figure 3A). According to the Navigation Guide criteria, we identified confounding, exposure assessment, and conflict of interest as the most common types of risk of bias (Figure 3B). Although we considered risk of bias separately for each outcome (birth weight and other fetal growth measures), the results did not differ with respect to outcome, so only one summary is presented in Figure 3 (see also Supplemental Material, Tables S3–S21). One exception was Maisonet et al. (2012) (see Supplemental Material, Table S13), for which we designated a higher risk of bias for fetal growth measures other than birth weight because of a large amount of missing data for outcomes other than birth weight in that study.
Figure 3 – Summary of the risk of bias judgments (low, probably low, probably high, and high risk) for each included human study (A) and (B) given as percentages across all included human studies. Risk of bias designations for individual studies are assigned according to criteria provided in Supplemental Material, “Instructions for Making Risk of Bias Determinations.”
Statistical analysis. We found no discrepancies in the data with respect to different data extractors. We made 13 requests to study authors for additional data for our meta-analysis. Six study authors responded; 3 provided the requested statistics and 3 provided individual-level data from which we calculated the summary statistics. We plotted continuous effect estimates (11 studies) to visually assess the range, precision, and dose–response data for evaluating the relationship between PFOA and birth weight (Figure 4). A summary plot of all odds ratio estimates for low birth weight (< 2,500 g) is presented in Supplemental Material, Figure S1.
Figure 4 – Summary of data extracted from all studies of PFOA exposure that included continuous outcome of birth weight. The PFOA increase is the exposure contrast being compared in each study. Squares represent data for which there was an exposure gradient that can be evaluated in considering dose response in upgrading the quality of the evidence. Error bars indicate 95% CIs. Savitz et al. (2012b) presented additional alternative estimates based on different modeling assumptions that are not included here due to space limitations. Covariate abbreviations: bmi, body mass index; bsp, blood sampling period; cot, serum cotinine; delmode, delivery mode; dia, diabetes; edu, maternal education level; exposyr, year of exposure estimate; ga, gestational age; gabd, gestational age at blood draw; geomean(stdev), geometric mean (geometric SD); grav, gravidity; ma, maternal age; ht, maternal height; hyp, hypertension; mwt, maternal prepregnancy weight; NA, not applicable: ND, not detected; par, parity; PFOS, serum perfluorooctane sulfonic acid; SES, socioeconomic status; sex, infant sex; smk, smoking status; state, state of residence; wtg, maternal weight gain during pregnancy. This figure was created using Meta Data Viewer (http://ntp.niehs.nih.gov/help/browsers/metadata/index.html)(Boyles et al. 2011).
We combined data from 10 studies in the meta-analyses of the association between PFOA exposure and measures of fetal growth. Within the 10 studies, there were 9 data sets on birth weight, 5 data sets on length, 4 data sets on ponderal index, and 4 data sets on chest circumference. The studies that were not included in the meta-analyses (n = 9; Table 4) generally reported a statistical estimate that was not combinable with the others. The majority of the studies reported a continuous regression estimate with PFOA as the independent variable and fetal growth as the dependent variable. If a study reported an alternate statistic such as an odds ratio, mean, or correlation coefficient and we were unable to obtain data from the authors, then the study could not be combined with the majority of studies in the meta-analysis (Table 4). From the meta-analysis of 9 studies (4,149 births) of birth weight, we found an overall estimate of –18.9 [95% confidence interval (CI): –29.8, –7.9] g birth weight/ng/mL increase in serum or plasma PFOA (Figure 5, Table 5). We did not find a high level of heterogeneity among the studies in this meta-analysis (Cochran’s Q = 12.92; p = 0.12; I2 = 38%).
Figure 5 – Results of meta-analysis for birth weight (n = 9 studies, 4,149 births) shown as effect estimates [change in birth weight in grams per nanogram of PFOA per milliliter of serum or plasma (95% CIs)]. The percentages are weightings of the individual studies in the meta-analysis according to the inverse of the variance, and the sizes of the boxes are scaled accordingly. The dashed line indicates the overall effect estimate derived from the DerSimonian-Laird random effects meta-analysis, and the diamond indicates the 95% CI of the overall effect estimate. Heterogeneity statistics: Cochran’s Q = 12.92; p = 0.12; I2 = 38%. Estimates were adjusted as follows: Apelberg et al. (2007): maternal age and gestational age; Fei et al. (2007): maternal age, gestational age, quadratic gestational age, infant sex, socio-occupational status, parity, smoking, prepregnancy body mass index, and gestational week at blood draw; Hamm et al. (2010): maternal age, gestational age, race, gravidity, maternal prepregnancy weight, maternal height, smoking status, and infant sex; Washino et al. (2009): maternal age and gestational age; Fromme et al. (2010): unadjusted; Kim S et al. (2011): maternal age, gestational age, and parity; Whitworth et al. (2012): maternal age, gestational age, prepregnancy body mass index, and parity; Maisonet et al. (2012): smoking, prepregnancy body mass index, previous live birth, and gestational age; Chen et al. (2012): maternal age and gestational age.
We judged the study of Savitz et al. (2012b) to have “probably high” risk of bias for the exposure assessment domain based on its retrospectively modeled maternal serum PFOA (see Supplemental Material, Table S18). However, because this judgment fell within the uncertain (“probably”) area and because others may make a different judgment about the risk of bias, we also conducted the meta-analysis including this study (Table 5). The addition of Savitz et al.’s estimate [from study II, Bayesian calibrated estimate of –0.185 g/ng/mL (95% CI: –0.313, –0.058)] to the meta-analysis did not change the direction of the overall association but reduced its magnitude from an estimated 18.9-g reduction in birth weight/ng/mL serum or plasma PFOA to a 15.4-g reduction (95% CI: –26.5, –4.3), and increased the heterogeneity (from an I2 of 38% to 72%) (Table 5).
Only one study that we included in the meta-analysis for birth weight was assigned a high risk of bias for confounding (Fromme et al. 2010). This study was small and contributed little weight (< 1%) to the overall effect estimate. Omitting the study of Fromme et al. (2010) from the meta-analysis reduced the magnitude of the association from an estimated 18.9-g reduction in birth weight/ng/mL serum or plasma PFOA to a 17.4-g reduction (95% CI: –26.8, –8.0) and reduced the heterogeneity (from an I2 of 38% to 27%). Fei et al. (2007) was the only study that we included in the meta-analysis that was assigned a high risk of bias for conflict of interest. Omitting that study increased the magnitude of the association from an estimated 18.9-g reduction in birth weight/ng/mL serum or plasma PFOA to a 22.7-g reduction (95% CI: –36.9, –8.4) and did not change the heterogeneity.
We found through meta-analysis that PFOA exposure was also associated with lower values of other fetal growth measures at birth (Table 5). A 1-ng/mL increase in serum or plasma PFOA was associated with a –0.1 (95% CI: –0.1, –0.02) cm change in birth length, a –0.01 (95% CI: –0.03, 0.01) change in ponderal index, and a –0.03 (95% CI: –0.1, 0.01) cm change in head circumference. Individual study estimates included in these analyses, and weights assigned to each, are provided in Supplemental Material, Tables S22–S24.
We explored the potential effect that a new study might have on our meta-analysis of birth weight to assess our confidence in our overall conclusion that there is an inverse relationship between PFOA and birth weight. First, we determined a hypothetical effect estimate necessary to shift our meta-analysis under two scenarios: a) that the 95% CI of the meta-analysis overlaps zero (becomes statistically insignificant), and b) that the meta-analysis effect estimate is greater than zero (moves in the opposite direction). We assumed that the new hypothetical study would have a standard error of 5.18 g/ng/mL, equal to the smallest in our group of studies (Fei et al. 2007). By inserting the values for the hypothetical study’s standard error and effect estimate into the meta-analysis, we found that another new study would have to have an effect estimate of 18 g/ng/mL in the positive direction in order to enlarge our CIs to overlap zero, and 225 g in the positive direction to shift our effect estimate to greater than zero. Second, to investigate how residual confounders might influence the meta-analysis, we conducted a separate meta-analysis using only unadjusted estimates from all the studies. Because Hamm et al. (2010) provided only an unadjusted estimate and p-value on a natural log (ln)-transformed scale, we made a log transformation for this study to obtain the untransformed estimate, and the standard error was calculated from the p-value (Altman and Bland 2011; Higgins et al. 2008). We found that the overall unadjusted estimate for change in birth weight was –30.9 (95% CI: –49.3, –12.5) g/ng/mL increase in serum or plasma PFOA. Compared with the effect estimate from the unadjusted meta-analysis, the adjusted estimate (–18.9 g) was closer to the null but more precise with less heterogeneity (unadjusted analysis: Cochran’s Q = 23.27, p = 0.002, I2 = 66%; adjusted analysis: Cochran’s Q = 12.92, p = 0.12, I2 = 38%).
Quality of the body of evidence. We did not downgrade or upgrade the rating of the human evidence on any of the criteria, resulting in an overall quality of the human evidence rating of “moderate” (Table 6). There were not enough studies to utilize a funnel plot analysis to assess publication bias. However, we did not find any suggestion of publication bias according to the considerations we assessed, that is, we conducted a comprehensive literature search and found studies of variable sizes and funding sources with generally consistent findings.
Strength of the body of evidence rating. Our strength of the evidence considerations were as follows:
- Quality of body of evidence: moderate
- Direction of effect estimate: decreasing birth weight with increasing exposure to PFOA
- Confidence in effect estimate: unlikely that a new study would have an effect estimate that would make the results of the meta-analysis null or statistically insignificant
- Other compelling attributes of the data that may influence certainty: none.
We compared these considerations to the definitions in Table 3 and concluded that there was “sufficient” human evidence that exposure to PFOA affects fetal growth in humans.
Based on this first application of the Navigation Guide systematic review methodology, we concluded that there was sufficient evidence of an association between PFOA exposure and reduced fetal growth. Our conclusion that the human data were sufficient was based on “moderate” quality evidence, a meta-analysis estimating a decrement in birth weight in relation to PFOA exposure in which we judged that the confidence bounds were narrow, and our confidence that a new study would be unlikely to have an effect estimate that would change the overall effect estimate of the meta-analysis. The smaller meta-analyses of other fetal growth measures were also consistent in the direction of the effect estimate.
The existence of unmeasured confounders will always be possible with observational studies, but we decided to not let this undermine our ability to make a statement about the available data. Additional information that may arise can and should inform future conclusions. We felt that we could rule out confounding “with reasonable confidence” (Table 3, definition of “Sufficient evidence of toxicity”) based on our assessment of the available data. We did not find any evidence suggesting substantial residual confounding. To get an idea of how residual confounding may influence the effect estimate of the association between PFOA exposure and birth weight, we conducted a meta-analysis using unadjusted estimates. Although the unadjusted meta-analysis had a larger effect estimate (i.e., adjusting for confounders attenuated the estimate), the CIs were wider and there was substantial heterogeneity among the unadjusted studies. As in the Bradford Hill considerations for causation, the GRADE approach considers consistency in effect estimates when evaluating confidence in the association and rating the quality of evidence (Schunemann et al. 2011). Because the effect estimates were more homogeneous after adjustment, we considered it more likely that the adjusted estimate was closer to the true association. If adjustment resulted in more heterogeneity, we would have been more concerned with potential residual confounding. Although this analysis does not prove that residual confounding does not exist, it did not uncover any evidence of unmeasured confounders, and we considered this as support for our interpretation that substantial effects of residual confounding are unlikely.
We also considered alternative hypotheses for the relationship between PFOA exposure and birth weight. For instance, an author of one of the studies included in our meta-analysis proposed that the pharmacokinetics of PFOA during pregnancy may influence the relationship between PFOA body burdens and fetal growth such that associations may be due to reverse causality (Whitworth et al. 2012). That is, mothers of lower-birth-weight babies might experience less plasma volume expansion and therefore reduced clearance of PFOA through glomerular filtration. To investigate the plausibility of an alternate hypothesis of reverse causation, we searched for evidence on the relationship between fetal growth and glomerular filtration rate, including relationships within the hypothesized causal pathway (i.e., between fetal growth and plasma volume expansion, and between plasma volume expansion and glomerular filtration rate) (for a list of studies that we systematically reviewed, see the Supplemental Material of Lam et al. 2014). Overall we found limited and inconsistent data that were inadequate to draw conclusions on the association between fetal growth and glomerular filtration rate. Thus, although we did not find evidence to suggest that the observed association between PFOA exposure and fetal growth can be explained, wholly or partially, by reverse causality, we cannot disprove this hypothesis. Nevertheless, we decided at this time there was no compelling evidence of reverse causation to justify altering our conclusions about the strength of the evidence. As others have pointed out (Savitz 2007), future studies should attempt to better separate biological determinants of body burdens and birth weight from a causal effect. In addition, experimental animal studies, in which dosing prior to outcome assessment precludes reverse causality, support our conclusions about the human data. On the basis of our companion review applying the Navigation Guide systematic review methodology to the nonhuman evidence, we concluded that there is sufficient evidence that fetal developmental exposure to PFOA reduces fetal growth in animals (Koustas et al. 2014).
We also considered that studies of the population that was highly exposed to PFOA through groundwater contamination found little evidence of an association with low birth weight (Nolan et al. 2009; Savitz et al. 2012a, 2012b; Stein et al. 2009) and on the continuous scale of birth weight (Savitz et al. 2012b). However, these studies differed from the studies included in our main meta-analysis with respect to exposure estimation as described in the risk of bias assessment; that is, these studies estimated exposure based on residence (ecological exposure), retrospective modeling of several parameters, or maternal postnatal exposure, and these studies primarily examined odds of low birth weight (< 2,500 g) rather than a change in birth weight on a continuous scale. We did not conduct a meta-analysis with odds ratios for low birth weight because so few studies (three populations) provided this measure and because a continuous change in birth weight provides more information than dichotomized birth weight. We did, however, conduct a meta-analysis including an effect estimate from one of the studies that retrospectively modeled exposure (Savitz et al. 2012b) and found minimal change in the results (Table 5); these results did not change our conclusions.
Although the magnitude of the effect estimate of PFOA on fetal growth may not be considered large at the individual or clinical level, it is important to consider implications at the population level. A relatively modest and subclinical effect size may be associated with substantial population burden if the exposure is prevalent (Bellinger 2012). From the meta-analysis we found an overall estimate of –18.9 (95% CI: –29.8, –7.9) g birth weight/ng/mL increase in serum or plasma PFOA (Figure 5). In the National Health and Nutrition Examination Survey 2003–2004, there was a 3.0-ng/mL difference in serum PFOA between the 50th and 95th percentiles of pregnant women (Woodruff et al. 2011b). This 3.0-ng/mL change, multiplied by the meta-analysis result of –18.9 g/ng/mL PFOA, yields a 56.7-g change in birth weight across these percentiles. To give a public health context to interpret this change in birth weight on a population level, we used 2010 U.S. National Vital Statistics birth weight data from the National Center for Health Statistics (NCHS) (Martin et al. 2012). The NCHS birth weight data are grouped into 500-g bins. We assumed that the data follow a skew t-distribution (Azzalini and Capitanio 2003), allowing us to fit a continuous distribution to the grouped data and producing a better fit to the data than assuming a normal distribution. Using the fitted distribution, the proportion of babies weighing < 2,500 g (low birth weight) was 8.6%. We estimated a 56.7-g increase in birth weight associated with a reduction in serum PFOA from the 95th to the 50th percentile. If the average birth weight in 2010 were increased by 56.7 g, the proportion of babies < 2,500 g would theoretically fall to 7.6% (95% CI: 7.0–8.2%), a reduction in the proportion of low birth weight babies in the U.S. of about 1%, or 40,000 babies in a year. However, because the population median of serum PFOA may be only about 3 ng/mL, this estimated benefit of reducing PFOA exposure and increasing birth weight may not be attributed equally across the population. Individuals with already low levels of PFOA (i.e., below the median) may not benefit, and individuals with the highest levels would benefit the most.
Our conclusion that there was sufficient evidence that developmental exposure to PFOA was associated with reduced fetal growth differed from the findings of an expert panel appointed to review the human health effects of PFOA (C8 Science Panel 2011). The panel concluded that PFOA was probably not linked to low birth weight and that the evidence of small reductions in average birth weight in relation to PFOA exposure was inconsistent. Our review occurred at a later date and therefore included more recent publications. These later publications (Chen et al. 2012; Maisonet et al. 2012; Whitworth et al. 2012) were included in our meta-analysis, showing consistent results and an overall reduction in birth weight associated with PFOA exposure. Our protocol specified contacting authors as a means to obtaining additional data or data on a scale that could be combined in a meta-analysis, and this contact proved essential in including many of the studies in the meta-analysis (Apelberg et al. 2007; Chen et al. 2012; Fromme et al. 2010; Kim S et al. 2011; Maisonet et al. 2012; Washino et al. 2009). In addition, by contacting authors of one of the included studies (Wang et al. 2011), we were alerted to an additional study on the same cohort under review at the time (Chen et al. 2012) and were able to include that study in the meta-analysis.
The meta-analysis provided a quantitative summary of the studies, combining and weighting studies to integrate information across multiple studies, and effectively increasing the power to detect an association among a group of studies that might otherwise appear to have disparate findings. Although there was a high level of consistency in the direction of the estimated effects except for one very small study in the meta-analysis (Kim S et al. 2011), a statistically significant inverse association between PFOA exposure and fetal growth was not detected in several individual studies, (Chen et al. 2012; Hamm et al. 2010; Washino et al. 2009; Whitworth et al. 2012).
The objective of our search was to be as comprehensive and inclusive of relevant research as possible. Our search identified 3,023 records, which were narrowed down to 17 during the title/abstract or full-text screening steps. Although our search retrieved many references that were irrelevant to our study question, because we applied prespecified exclusion criteria, screening the references was efficient. The average time to screen an abstract was 12 sec, and we excluded the majority of irrelevant references in < 10 hr. The process from search to rating the quality and strength of the human evidence was about 9 months.
A limitation to this review, and to all reviews in general, is that reviews are based on the available data, which may be insufficient in depth or breadth or may be otherwise limited. Future reviews could be strengthened if more investigators followed standardized reporting criteria such as the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines (von Elm et al. 2008), enabling improved quality assessment. In addition, we found that contacting study authors was essential to obtaining the data necessary to include some of the studies in the meta-analysis. Not all study authors were able to provide data that could be included in the meta-analysis. Future efforts in meta-analysis could also be supported by data repositories.
Our risk of bias tool also had limitations. Although there is existing guidance for assessing risk of bias of human observational studies (Viswanathan et al. 2012; Wells 2014), there is no universally accepted tool (Sanderson et al. 2007). The risk of bias domains “exposure assessment” and “confounding” were less developed than other domains that were transferred more directly from established evidence-based risk of bias tools. Additionally, in future reviews, we will consider the assessment of outcome as a separate risk of bias domain. For this case study, potential bias resulting from outcome misclassification fell under “other” risk of bias and was not a problematic risk because the outcomes were standard birth measurements that did not vary across study groups. However, it is possible that in future cases of other outcomes more attention will need to be given to potential bias in the assessment of those outcomes.
Because we were simultaneously developing and applying the Navigation Guide method, a limitation of this review is that we did not anticipate and define a priori all the benchmarks we ultimately used for rating the quality and the strength of the evidence, such as our analysis of what a new study would have to find in order to change our confidence in the effect estimate and direction of the meta-analysis. In assessing quality and strength according to factors and considerations that had not been prespecified, we conducted further analysis and abided by GRADE’s principle to be conservative in changing the rating of the body of evidence up or down (Balshem et al. 2011). It may be impossible to anticipate all instances for which a judgment or decision must be made in the conduct of a systematic review; therefore, the principles we used for addressing these instances will be integrated into future protocols. A protocol, a set of instructions, and definitions does not, however, take the place of expert judgment. The strength of systematic review methods is that, as new studies become available, a conclusion can be systematically and transparently reevaluated. Finally, the components of the Navigation Guide methodology that were not taken from empirically supported preexisting methods need validation in future cases.
On the basis of our evaluation and the Navigation Guide criteria, we concluded that there is sufficient evidence of an association between PFOA exposure and reduced fetal growth. There may be remaining uncertainty. However, we investigated residual confounding and evidence for reverse causality via reduced renal clearance, and despite the cross-sectional nature of the human evidence, our judgment was that chance, bias, and confounding could be ruled out with reasonable confidence. The proof-of-concept case study demonstrates the use of the Navigation Guide to efficiently apply the rigor and transparency of systematic review methodology to environmental health questions. The method does not take the place of expert judgment, but it requires transparency in the rationale exercised by the experts. Further refinement and proof-of-concept applications of the Navigation Guide methodology will continue, with the ultimate goal of supporting timely evidence-based recommendations for the prevention of harm to public health.
Agency for Toxic Substances and Disease Registry. 2009. Draft Toxicological Profile for Perfluoroalkyls. Atlanta, GA: Agency for Toxic Substances and Disease Registry. Available: http://www.atsdr.cdc.gov/toxprofiles/tp200.pdf [accessed 29 August 2014].
Altman DG, Bland JM. 2011. How to obtain the confidence interval from a p value. BMJ 343:d2304; doi: 10.1136/bmj.d2304.
Apelberg BJ, Witter FR, Herbstman JB, Calafat AM, Halden RU, Needham LL, et al. 2007. Cord serum concentrations of perfluorooctane sulfonate (PFOS) and perfluorooctanoate (PFOA) in relation to weight and size at birth. Environ Health Perspect 115:1670–1676; doi: 10.1289/ehp.10334.
Arbuckle TE, Kubwabo C, Walker M, Davis K, Lalonde K, Kosarac I, et al. 2012. Umbilical cord blood levels of perfluoroalkyl acids and polybrominated flame retardants. Int J Hyg Environ Health 216:184–194.
C8 Science Panel. 2011. Probable Link Evaluation of Preterm Birth and Low Birthweight. Available: http://www.c8sciencepanel.org/pdfs/Probable_Link_C8_Preterm_and_LBW_birth_5Dec2011.pdf [accessed 5 December 2011].
Chen MH, Ha EH, Wen TW, Su YN, Lien GW, Chen CY, et al. 2012. Perfluorinated compounds in umbilical cord blood and adverse birth outcomes. PLoS One 7:e42474; doi: 10.1371/journal.pone.0042474.
DeWitt JC, Shnyra A, Badr MZ, Loveless SE, Hoban D, Frame SR, et al. 2009. Immunotoxicity of perfluorooctanoic acid and perfluorooctane sulfonate and the role of peroxisome proliferator-activated receptor alpha. Crit Rev Toxicol 39:76–94.
Fei C, McLaughlin JK, Tarone RE, Olsen J. 2007. Perfluorinated chemicals and fetal growth: a study within the Danish National Birth Cohort. Environ Health Perspect 115:1677–1682; doi: 10.1289/ehp.10506.
GRADE Working Group. 2012. GRADE Homepage. Available: http://www.gradeworkinggroup.org/ [accessed 13 September 2012].
Halldorsson TI, Rytter D, Haug LS, Bech BH, Danielsen I, Becher G, et al. 2012. Prenatal exposure to perfluorooctanoate and risk of overweight at 20 years of age: a prospective cohort study. Environ Health Perspect 120:668–673; doi: 10.1289/ehp.1104034.
Higgins JPT, Deeks JJ. 2011. Chapter 7: Selecting studies and collecting data. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 (Higgins JPT, Green S, eds). Available: http://handbook.cochrane.org/chapter_7/7_selecting_studies_and_collecting_data.htm [accessed 29 August 2014].
Higgins JPT, Green S, eds. 2011. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 [updated March 2011]. Available: http://www.cochrane-handbook.org [accessed 4 September 2014].
IARC (International Agency for Research on Cancer). 2006. IARC Monographs on the Evaluation of Carcinogenic Risks to Humans: Preamble. Available: http://monographs.iarc.fr/ENG/Preamble/index.php [accessed 2 September 2014].
Kim SK, Lee KT, Kang CS, Tao L, Kannan K, Kim KR, et al. 2011. Distribution of perfluorochemicals between sera and milk from the same mothers and implications for prenatal and postnatal exposures. Environ Pollut 159:169–174.
Koustas E, Lam J, Sutton P, Johnson PI, Atchley DS, Sen S, et al. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of nonhuman evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1015–1027; doi: 10.1289/ehp.1307177.
Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992; doi: 10.1289/ehp.1206389.
Lam J, Koustas E, Sutton P, Johnson PI, Atchley DS, Sen S, et al. 2014. The Navigation Guide—evidence-based medicine meets environmental health: integration of animal and human evidence for PFOA effects on fetal growth. Environ Health Perspect 122:1040–1051; doi: 10.1289/ehp.1307923.
Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. 2012. Industry sponsorship and research outcome. Cochrane Database Syst Rev 12:MR000033; doi: 10.1002/14651858.MR000033.pub.
Maisonet M, Terrell ML, McGeehin MA, Christensen KY, Holmes A, Calafat AM, et al. 2012. Maternal concentrations of polyfluoroalkyl compounds during pregnancy and fetal and postnatal growth in British girls. Environ Health Perspect 120:1432–1437; doi: 10.1289/ehp.1003096.
Martin JA, Hamilton BE, Ventura SJ, Osterman MJK, Wilson EC, Mathews TJ, et al. 2012. Births: Final Data for 2010. National Vital Statistics Reports, vol 61, no 1. Hyattsville, MD:National Center for Health Statistics. Available: http://www.cdc.gov/nchs/data/nvsr/nvsr61/nvsr61_01.pdf [accessed 6 March 2014].
National Research Council. 2011. Review of the Environmental Protection Agency’s Draft IRIS Assessment of Formaldehyde. Washington, DC:National Academies Press. Available: http://www.nap.edu/catalog.php?record_id=13142 [accessed 4 September 2014].
Nolan LA, Nolan JM, Shofer FS, Rodway NV, Emmett EA. 2009. The relationship between birth weight, gestational age and perfluorooctanoic acid (PFOA)-contaminated public drinking water. Reprod Toxicol 27:231–238.
Ode A, Rylander L, Lindh CH, Källén K, Jönsson BA, Gustafsson P, et al. 2013. Determinants of maternal and fetal exposure and temporal trends of perfluorinated compounds. Environ Sci Pollut Res Int 20:7970–7978.
Sanderson S, Tatt ID, Higgins JPT. 2007. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol 36:666–676.
Savitz DA. 2007. Biomarkers of perfluorinated chemicals and birth weight. Environ Health Perspect 115:A528–A529; doi: 10.1289/ehp.10923.
Savitz DA, Stein CR, Elston B, Wellenius GA, Bartell SM, Shin HM, et al. 2012b. Relationship of perfluorooctanoic acid exposure to pregnancy outcome based on birth records in the mid-Ohio Valley. Environ Health Perspect 120:1201–1207; doi: 10.1289/ehp.1104752.
Sawaya GF, Guirguis-Blake J, LeFevre M, Harris R, Petitti D. 2007. Update on the methods of the U.S. Preventive Services Task Force: estimating certainty and magnitude of net benefit. Ann Intern Med 147(12):871–875.
Steenland K, Fletcher T, Savitz DA. 2010. Epidemiologic evidence on the health effects of perfluorooctanoic acid (PFOA). Environ Health Perspect 118:1100–1108; doi: 10.1289/ehp.0901827.
UCSF (University of California, San Francisco) Program on Reproductive Health and the Environment. 2013. Clinical Practice & Policy: Navigation Guide. An Evidence-Based Medicine Methodology to Bridge the Gap Between Clinical and Environmental Health Sciences. Application of the Navigation Guide: Case Study of PFOA Effects on Fetal Growth. Available: http://prhe.ucsf.edu/prhe/navigationguide.html [accessed 20 February 2014].
U.S. EPA (U.S. Environmental Protection Agency). 1991. Guidelines for Developmental Toxicity Risk Assessment. Available: http://cfpub.epa.gov/ncea/cfm/recordisplay.cfm?deid=23162#Download [accessed 27 February 2014].
U.S. EPA (U.S. Environmental Protection Agency). 1996. Guidelines for Reproductive Toxicity Risk Assessment. Available: http://www.epa.gov/raf/publications/pdfs/REPRO51.PDF [accessed 27 February 2014].
U.S. EPA (U.S. Environmental Protection Agency). 2012. Basic Information, Perfluorooctanoic acid (PFOA) and Fluorinated Telomers. Available: http://epa.gov/oppt/pfoa/pubs/pfoainfo.html#background [accessed 9 May 2013].
Viswanathan M, Ansari M, Berkman N, Chang S, Hartling L, McPheeters L, et al. 2012. Assessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions. Agency for Healthcare Research and Quality Methods Guide for Comparative Effectiveness Reviews. AHRQ Publication No. 12-EHC047-EF. Available: http://effectivehealthcare.ahrq.gov/ehc/products/322/998/MethodsGuideforCERs_Viswanathan_IndividualStudies.pdf [accessed 5 September 2014].
von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. 2008. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol 61:344–349.
Washino N, Saijo Y, Sasaki S, Kato S, Ban S, Konishi K, et al. 2009. Correlations between prenatal exposure to perfluorinated chemicals and reduced fetal growth. Environ Health Perspect 117:660–667; doi: 10.1289/ehp.11681.
Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, et al. 2014. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomized Studies in Meta-Analyses. Available: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp [accessed 29 August 2014].
Whitworth KW, Haug LS, Baird DD, Becher G, Hoppin JA, Skjaerven R, et al. 2012. Perfluorinated compounds in relation to birth weight in the Norwegian Mother and Child Cohort study. Am J Epidemiol 175:1209–1216.
Woodruff TJ, Sutton P. 2014. The Navigation Guide sytematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122:1007–1014; doi: 10.1289/ehp.1307175.
Woodruff TJ, Sutton P, The Navigation Guide Work Group. 2011a. An evidence-based medicine methodology to bridge the gap between clinical and environmental health sciences. Health Aff (Millwood) 30:931–937.
Woodruff TJ, Zota AR, Schwartz JM. 2011b. Environmental chemicals in pregnant women in the United States: NHANES 2003–2004. Environ Health Perspect 119:878–885; doi: 10.1289/ehp.1002727.
Children’s Health Collection 2015The Children’s Health Collection 2015 is now available. This compilation of the past year's children’s health research, commentary, and news offers something for everyone concerned about children’s environmental health—researchers, regulators, advocates, health care providers, policy makers, educators, community developers, and parents.
Sign Up to Receive E-mail Alerts
Recent Advance Publications
The Genetic Basis for Variation in Sensitivity to Lead Toxicity in Drosophila melanogaster
Methods to Estimate Acclimatization to the Urban Heat Island Effects on Heat- and Cold-Related Mortality
Particulate Matter Exposure and Cardiopulmonary Differences in the Multi-Ethnic Study of Atherosclerosis
Prenatal Arsenic Exposure and Birth Outcomes among a Population Residing near a Mining-Related Superfund Site
Air Pollution and Pulmonary Tuberculosis: A Nested Case-Control Study among Members of a Northern California Health Plan