Literature DB >> 31449464

Using Birth Cohort Data to Estimate Prenatal Chemical Exposures for All Births around the New Bedford Harbor Superfund Site in Massachusetts.

Roxana Khalili1, Scott M Bartell1,2,3,4, Jonathan I Levy5,6, M Patricia Fabian5,6, Susan Korrick6,7, Verónica M Vieira1,2.   

Abstract

BACKGROUND: Children born near New Bedford, Massachusetts, have been prenatally exposed to multiple environmental chemicals, in part due to an older housing stock, maternal diet, and proximity to the New Bedford Harbor (NBH) Superfund site. Chemical exposure measures are not available for all births, limiting epidemiologic investigations and potential interventions.
OBJECTIVE: We linked biomonitoring data from the New Bedford Cohort (NBC) and birth record data to predict prenatal exposures for all contemporaneous area births.
METHODS: We used prenatal exposure biomarker data from the NBC, a population-based cohort of 788 mother-infant pairs born during 1993–1998 to mothers living near the NBH, linked to their corresponding Massachusetts birth record data, to build predictive models for cord serum polychlorinated biphenyls (expressed as a sum, [Formula: see text]), [Formula: see text] (DDE), hexachlorobenzene (HCB), cord blood lead (Pb), and maternal hair mercury (Hg). We applied the best fit models (highest pseudo [Formula: see text]), with multivariable smooths of continuous variables, to predict exposure biomarkers for all 10,270 births during 1993–1998 around the NBH. We used 10-fold cross validation to validate the exposure models and the bootstrap method to characterize sampling variability in the exposure predictions.
RESULTS: The 10-fold cross-validated [Formula: see text] for the [Formula: see text], DDE, HCB, Pb, and Hg exposure models were 0.54, 0.40, 0.34, 0.46, and 0.40, respectively. For each exposure model, multivariable smooths of continuous variables improved the fit compared with linear models. Other variables with significant effects on exposure estimates were paternal education, maternal race/ethnicity, and maternal ancestry. The resulting exposure predictions for all births had variability consistent with the NBC measured exposures.
CONCLUSIONS: Predictive models using multivariable smoothing explained reasonable amounts of variance in prenatal exposure biomarkers. Our analyses suggest that prenatal chemical exposures can be predicted for all contemporaneous births in the same geographic area by modeling available biomarker data for a subset of that population. https://doi.org/10.1289/EHP4849.

Entities:  

Mesh:

Substances:

Year:  2019        PMID: 31449464      PMCID: PMC6792387          DOI: 10.1289/EHP4849

Source DB:  PubMed          Journal:  Environ Health Perspect        ISSN: 0091-6765            Impact factor:   9.031


Introduction

Many potential epidemiologic analyses are constrained by the ability to obtain reliable individual-level chemical exposure estimates. It is cost prohibitive and logistically challenging to measure exposures for large populations, and for retrospective analyses or investigations using administrative data sets, it is often impossible. In multiple contexts, researchers have developed strategies to assign exposures to large populations by leveraging measurements for a subset of locations or participants. For example, in air pollution studies (Hoek et al. 2008), researchers collect measurements at a representative subset of geographic locations and construct land use regression (LUR) models to explain variability in those measurements. LUR models evaluate the relationship between observed air pollution concentrations and predictor variables such as land use and traffic conditions in a multivariable regression model to estimate concentrations at unmonitored locations. A defining feature of LUR models intended for epidemiologic studies is that they use as predictors covariates that are available for all geographic locations under study so that all study participants can have exposure assignment. Although less common, this regression approach can also be used to evaluate the relationship between measured biomarkers and predictor variables such as sociodemographic covariates in a subset of the population to predict exposure levels for the entire population. Analogous to LUR models, we developed exposure regression models for biomarkers of prenatal exposure to organochlorines and metals using data obtained from pregnant women enrolled in the New Bedford Cohort (NBC) and predicted prenatal exposures for all contemporaneous births in the study area. The NBC is an ongoing birth cohort study of 788 mother–infant pairs born during 1993–1998 to mothers residing in one of the four towns adjacent to the polychlorinated biphenyl (PCB)–contaminated New Bedford Harbor (NBH) Superfund site (Figure 1) in Massachusetts. The NBH was designated a Superfund site by the U.S. Environmental Protection Agency (EPA) in 1982 because of extensive PCB contamination from local electronics manufacturing facilities (U.S. EPA 2015). Heavy metals, including lead (Pb), are also present in NBH sediments (Shine et al. 1995) and the area contains a number of other hazardous waste sites and industrial sources of pollution. The region’s old housing stock (and associated Pb paint and Pb-containing water distribution systems) and relatively low socioeconomic status (SES) also contributes to Pb exposure risk (Friedrich 2000). Despite these local sources of chemical contamination, diet remains an important route of chemical exposure for the population; for example, fish intake correlates with PCB and methylmercury (MeHg) biomarker levels in the NBC (Choi et al. 2006; Sagiv et al. 2012b).
Figure 1.

Four study area towns surrounding the New Bedford Harbor (NBH) Superfund site in southeast Massachusetts. The NBH was designated a Superfund site by the U.S. EPA in 1982 because of extensive polychlorinated biphenyl (PCB) contamination from local electronics manufacturing facilities.

Four study area towns surrounding the New Bedford Harbor (NBH) Superfund site in southeast Massachusetts. The NBH was designated a Superfund site by the U.S. EPA in 1982 because of extensive polychlorinated biphenyl (PCB) contamination from local electronics manufacturing facilities. We modeled PCBs, (DDE), hexachlorobenzene (HCB), Pb, and mercury (Hg) because they have been associated with several childhood health outcomes of interest in this population. Prenatal exposure to organochlorines, including PCBs, has been associated with impaired neurodevelopment (Grandjean et al. 2001; Sagiv et al. 2008, 2010, 2012a), altered immune function (Dewailly et al. 2000), acute respiratory infections (Dallaire et al. 2004, 2006), and decreased birthweight (Govarts et al. 2012). Impaired neurological development has been also observed with prenatal exposure to Hg (Orenstein et al. 2014; Sagiv et al. 2012b) and Pb (Bellinger et al. 1987; Hu et al. 2006). Although the exposure routes to contaminants in this community include diet and old housing stock, proximity to the harbor has been associated with increased exposure to airborne PCBs (Martinez et al. 2017) as well as with important nonchemical stressors, including low SES and a poor home environment (Vieira et al. 2017). The significance of predicting prenatal exposures for all contemporaneous births in this community is that it allows for future epidemiologic analyses of health outcomes in a large study population for which it is impractical or infeasible to obtain exposure biomarkers.

Methods

Study Population

. During 1993–1998, 788 New Bedford area newborns and their mothers were recruited as participants in the NBC birth cohort study. During pregnancy, the NBC mothers lived in one of the four towns surrounding the NBH Superfund site, including New Bedford, Acushnet, Fairhaven, and Dartmouth. The NBC was designed to assess relationships of prenatal and early life chemical exposures with subsequent child neurodevelopment (Orenstein et al. 2014; Sagiv et al. 2010, 2012a, 2012b). Study infants’ prenatal exposures to organochlorines (PCBs, DDE, and HCB) were measured in cord serum and exposure to Pb was measured in cord whole blood; maternal peripartum hair was analyzed for total Hg as a proxy biomarker for MeHg exposure. The majority of Hg in hair is methylated and it correlates with MeHg levels in blood and integrates exposure over a longer time period than in blood, thereby decreasing measurement error in individual exposure assignments (Bartell et al. 2004; IPCS 1990). For PCBs, as previously, we focused on the sum of four prevalent PCB congeners: 118, 138, 153, and 180 (). NBC cord blood samples were collected at birth with one aliquot centrifuged for removal of the serum fraction and a second aliquot collected for whole blood analyses. Organochlorines were measured in the cord serum at the Harvard T.H. Chan School of Public Health Organic Chemistry Laboratory (Boston, MA) using liquid–liquid extraction with extracts analyzed by gas chromatography with electron capture detection. Details of the method and quality assurance/quality control performance are reported elsewhere and include excellent reproducibility and sensitivity; for example, for most PCB congeners, detection limits were (Korrick et al. 2000). Because of insufficient volume, lipid content could not be measured in NBC cord serum, so organochlorine concentrations are expressed on a wet weight basis as nanograms per gram serum. Metal measurements were done at the Harvard T.H. Chan School of Public Health Trace Metals Laboratory (Boston, MA). Cord whole blood Pb levels were measured using isotope dilution inductively coupled plasma–mass spectrometry with excellent sensitivity [limit of detection (LOD) of ] and precision (). As a proxy for MeHg, total Hg was measured in maternal peripartum hair samples using atomic absorption spectroscopy with an average LOD of and excellent quality control performance (Sagiv et al. 2012b). For both organochlorine and metal analyses, we used quantifiable values below the detection limit to optimize statistical power and avoid bias associated with censoring at the method detection limit (Kim et al. 1995). Questionnaire and medical record data on sociodemographic and birth outcome characteristics were available for NBC participants and are shown in Table 1. After excluding three sets of twins, the analysis included data for 782 NBC mother–infant pairs.
Table 1

Characteristics of mother–infant pairs born during 1993–1998 to mothers residing near the New Bedford Harbor from three sources: the New Bedford Cohort (NBC) from study data (), the NBC Massachusetts birth record data (), and the Massachusetts Birth Record Cohort (MBRC) birth record data ().

CharacteristicsNBC: study data (n=782)NBC: birth record data (n=779)MBRC: birth record data (n=10,270)PCC or percentage agreement (%)a
Child’s birthweight (g) (mean±SD)3,394±4553,396±4553,382±6590.99
 Missing [n (%)]0 (0)3 (0.4)36 (0.4)
Child’s year of birth [n (%)]1.00
 1993–1994257 (32.9)256 (32.9)3,617 (35.2)
 1995–1996300 (38.4)298 (38.3)3,262 (31.8)
 1997–1998225 (28.8)225 (28.9)3,391 (33.0)
Maternal age at birth (y) (mean±SD)26.3±5.425.9±5.426.0±5.91.00
Maternal pregnancy weight gain (kg) (mean±SD)15.1±6.413.6±5.713.6±5.81.00
 Missing [n (%)]153 (19.6)10 (1.3)136 (1.3)
Maternal race/ethnicity [n (%)]95%
 Non-Hispanic white533 (68.2)607 (77.9)8,050 (78.4)
 Non-Hispanic African American33 (4.2)47 (6.0)474 (4.6)
 Hispanic/Latino60 (7.7)74 (9.5)1,055 (10.3)
 Non-Hispanic, other race62 (7.9)49 (6.3)665 (6.5)
 Missing94 (12.0)2 (0.3)26 (0.2)
Maternal ancestry [n (%)]77%
 Azores/Portugal209 (26.7)186 (23.4)2,573 (25.1)
 Cape Verde74 (9.5)77 (10.0)821 (8.0)
 Other351 (44.9)516 (66.2)6,841 (66.6)
 Missing148 (18.9)3 (0.4)35 (0.3)
Maternal smoking during pregnancy [n (%)]90%
 Yes204 (26.1)196 (25.2)2,306 (22.5)
 No476 (60.9)580 (74.5)7,931 (77.2)
 Missing102 (13.0)3 (0.4)33 (0.3)
Maternal alcohol use in pregnancy [n (%)]79%
 Yes137 (17.5)16 (2.1)179 (1.7)
 No494 (63.2)760 (97.6)10,058 (98.0)
 Missing151 (19.3)3 (0.4)33 (0.3)
Previous lactation [n (%)]b85%
 Yes193 (24.7)197 (25.3)4,171 (40.6)
 No441 (56.4)578 (74.2)6,030 (58.7)
 Missing148 (18.9)4 (0.5)69 (0.7)
Annual block group household income at birth [n (%)]94%
<$20,000/y175 (22.4)167 (21.4)2,235 (21.8)
$20,000/y606 (77.5)608 (78.0)8,029 (78.2)
 Missing1 (0.1)4 (0.5)6 (0.05)
Married at birth [n (%)]93%
 Yes402 (51.4)431 (55.3)5,877 (57.2)
 No325 (41.6)348 (44.7)4,393 (42.8)
 Missing55 (7.0)0 (0)0 (0)
Maternal education at birth [n (%)]93%
<High school131 (16.8)180 (23.1)2,940 (28.6)
High school594 (76.0)595 (76.4)7,285 (70.9)
 Missing57 (7.3)4 (0.5)45 (0.4)
Parity [n (%)]95%
 0301 (38.5)312 (40.1)4,551 (44.3)
 1315 (40.3)307 (39.4)3,388 (33.0)
 2119 (15.2)115 (14.8)1,467 (14.3)
347 (6.0)45 (5.8)812 (7.9)
 Missing0 (0)0 (0)52 (0.5)
Adequate prenatal care during pregnancy [n (%)]c93%
 Yes589 (75.3)757 (97.2)9,669 (94.1)
 No41 (5.2)14 (1.8)463 (4.5)
 Missing152 (19.4)8 (1.0)138 (1.3)
Paternal education at birth [n (%)]89%
<High school188 (24.0)257 (33.0)3,388 (33.1)
High school526 (67.3)443 (56.9)5,730 (55.8)
 Missing68 (8.7)79 (10.1)1,152 (11.2)
Residential distance to harbor (m) (mean±SD)d1,572±1,9341,557±1,9111,617±1,9120.95
Residential distance to major roadway (m) (mean±SD)d191±359189±366200±4030.95
Build year for home at birth (mean±SD)e1925±37.71928±38.61929±39.50.60
 Missing92 (11.8)245 (31.5)3,404 (33.1)

Note: Pb, lead; PCC, Pearson Correlation Coefficient; SD, standard deviation.

PCC and percentage agreement were calculated for the nonmissing data values.

Previous lactation was not considered in the Hg exposure model.

Adequate prenatal care during pregnancy was not directly measured in the NBC. Prenatal vitamin use was used as a proxy measure.

Residential distance to the harbor was not considered in the Pb exposure model.

Residential distance to the nearest major roadway and build year for home at birth were considered only in the Pb-exposure model.

Characteristics of mother–infant pairs born during 1993–1998 to mothers residing near the New Bedford Harbor from three sources: the New Bedford Cohort (NBC) from study data (), the NBC Massachusetts birth record data (), and the Massachusetts Birth Record Cohort (MBRC) birth record data (). Note: Pb, lead; PCC, Pearson Correlation Coefficient; SD, standard deviation. PCC and percentage agreement were calculated for the nonmissing data values. Previous lactation was not considered in the Hg exposure model. Adequate prenatal care during pregnancy was not directly measured in the NBC. Prenatal vitamin use was used as a proxy measure. Residential distance to the harbor was not considered in the Pb exposure model. Residential distance to the nearest major roadway and build year for home at birth were considered only in the Pb-exposure model. . The Massachusetts Birth Record Cohort (MBRC) includes data from birth certificate data for all births in Massachusetts during 1993–1998, including the mothers recruited into the NBC. Birth records in Massachusetts are linked to several subsequent health outcomes data sets including maternal and child hospital discharge records, emergency department data, the birth defects registry, newborn hearing screening data and the Massachusetts Healthy Start, Early Intervention, and Women, Infants and Children (WIC) Programs (Barfield et al. 2008; Girguis et al. 2016, 2018; Khalili et al. 2018; Kotelchuck 2010; Manning et al. 2011). All Massachusetts children born in the four NBC towns were identified (). Many of the same sociodemographic variables available in the NBC are also available for the MBRC (Table 1).

NBC Chemical Exposure Models

Exposure models were built to explain variability in measured NBC exposure biomarkers as a function of covariates available in the MBRC. Births in the NBC cohort were linked to Massachusetts birth record data. Previously developed prenatal exposure models for the NBC (Fabian et al. 2013, 2016) were used as a reference although these models did not exclusively focus on covariates available in the MBRC and did not include all exposures in the present analysis. Table 1 shows that the continuous variables available in the birth records are highly correlated with the same characteristics from the NBC study questionnaires and medical record reviews (Pearson correlation) and that there was high percentage agreement among categorical variables. Previous lactation is not directly available in the MBRC, but a proxy measure was constructed using breastfeeding initiation at the hospital and parity. Mothers with previous live births who initiated breastfeeding at the hospital were coded as having previous lactation. There was 85% agreement between this categorical proxy variable and the previous lactation variable available in the NBC data (Table 1). The other birth record variable considered in the exposure models that was not directly available in the NBC study was adequacy of prenatal care. For the purposes of comparing data collected in the NBC to data in the birth record, Table 1 includes NBC data on prenatal vitamin use as a proxy for adequate prenatal care. In addition to the available birth record data, we calculated proximity measures for all geocoded birth addresses. Residential distance in meters to the nearest major roads () was estimated using geographic information systems (GIS) and road segments obtained from the Massachusetts Department of Transportation. Major roads include limited-access highways, multilane highways, numbered routes, and major roads. Residential distance to roadway was included in the analysis for the cord blood Pb model, as was age of home, which was obtained from the Massachusetts tax assessor database for 2016/2017. Distance to the harbor was also calculated using GIS and was included in the , DDE, HCB, and Hg models based on previous spatial associations with important sociodemographic predictors (Vieira et al. 2017). Geocoded addresses were also used to determine the median block group–level household income for the NBC and the MBRC using 2000 decennial U.S. Census data (U.S. Census Bureau 2000). Exposure models were built for , DDE, HCB, Pb, and Hg using generalized additive models (GAMs) of complete data for each chemical exposure biomarker. The following GAM framework was used for each exposure model: where y(exposure) is the predicted log exposures for a given chemical, S(x1, x2, …, xN) is the multivariable loess (locally weighted scatter plot smoothing) term(s) for the N continuous predictors, ′ is the vector of parameters, and is the vector of parametric covariates. The GAM was selected as the primary modeling approach because of its flexibility and ease of interpretation (Hastie and Tibshirani 1990); specifically, a loess smooth adapts to changes in data density and the model reduces to a linear regression without the smooth. The exposure models were built using log-transformed chemical biomarkers due to their skewed distribution. We considered variables in Table 1 as predictors, starting with the full model and using backward elimination to select the final variables for inclusion. First, all continuous variables were modeled using univariable and multivariable smooth terms as well as linear terms, and the model structure that maximized the pseudo was selected. We calculated the pseudo as 1 – (residual deviance/null deviance) for variable selection. Based on the higher pseudo , all continuous variables in the exposure models were modeled with smooth terms. We then eliminated categorical variables with p-values generated from the F-statistic that were greater than 0.2 in order of highest p-value if they did not increase the pseudo value. Variables that were tested but not retained in the final exposure models are indicated as not significant (NS) in Tables 2 and 3.
Table 2

Estimates of the percentage difference in cord serum , DDE, and HCB in the NBC for parametric categorical terms in the generalized additive exposure models built using complete case data.

CharacteristicsΣPCB4 (n=659) CV R2=0.54DDE (n=658) CV R2=0.40HCB (n=590) CV R2=0.34
Est.a95% CIEst.a95% CIEst.a95% CI
Maternal race/ethnicity
 Non-Hispanic African American19.343.4, 14.923.818.2, 87.5NSNS
 Hispanic/Latino17.92.5, 42.639.111.1, 74.2NSNS
 Non-Hispanic, other race13.119.0, 58.4114.044.4, 217.1NSNS
Maternal ancestry
 Azores/Portugal36.020.6, 53.433.315.7, 53.513.61.2, 27.4
 Cape Verde19.813.1, 65.28.537.3, 33.519.20.5, 42.7
Maternal smoking during pregnancyNSNSNSNS7.84.7, 22.0
Maternal alcohol use in pregnancy1.732.7, 43.52.134.5, 59.213.640.2, 25.0
Previous lactation4.716.6, 8.98.221.5, 7.44.616.2, 8.6
Block group household income at birth <$20,000/yNSNS13.025.8, 2.02.79.9, 17.0
Married at birthNSNSNSNSNSNS
Maternal education (<high school at birth)11.42.7, 27.50.515.2, 16.64.08.7, 18.6
Parity
 14.916.6, 8.43.817.5, 12.21.810.3, 15.5
 218.431.7, 2.513.429.8, 6.66.421.1, 11.1
316.835.2, 6.721.541.5, 5.25.025.6, 21.3
Adequate prenatal careNSNSNSNSNSNS
Paternal education <high school at birth14.22.0, 27.92.514.6, 11.44.014.0, 7.2

Note: NS indicates variable that were not significant () and did not improve the and so were dropped from the final exposure model. CI, confidence interval; CV, cross validated; DDE, dichlorodiphenyl dichloroethylene; est., estimate; HCB, hexachlorobenzene; NBC, New Bedford Cohort; NS, not significant; , sum of four prevalent PCB congeners (118, 138, 153, 180).

Percentage difference using the following reference groups: non-Hispanic white, ancestry other than Azores, Portugal, and Cape Verde, no maternal smoking during pregnancy, no maternal alcohol consumption during pregnancy, no previous lactation, block group–level household income , unmarried at birth, maternal education at birth, nulliparous, prenatal care not adequate, and paternal education at birth.

Table 3

Estimates of the percentage difference in cord blood Pb and maternal hair total Hg in the NBC for parametric terms in the generalized additive exposure models built using complete case data.

CharacteristicsPb (n=442) CV R2=0.46Hg (n=459) CV R2=0.40
Est.a95% CIEst.a95% CI
Maternal race/ethnicity
 Non-Hispanic African American5.037.0, 43.320.554.5, 38.9
 Hispanic/Latino2.221.0, 21.16.129.0, 24.2
 Non-Hispanic, other race28.313.8, 90.928.255.2, 15.1
Maternal ancestry
 Azores/Portugal3.69.9, 19.032.214.1, 53.3
 Cape Verde6.335.4, 36.019.226.1, 92.3
Maternal smoking during pregnancy31.513.2, 52.8NSNS
Maternal alcohol use in pregnancy26.553.4, 16.223.723.4, 99.8
Previous lactation18.829.9, 5.9NTNT
Block group household income at birth (<$20,000/y)NSNS8.48.8, 28.9
Married at Birth5.29.9, 19.0NSNS
Maternal education (<high school at birth)20.64.1, 39.8NSNS
Parity
 10.513.4, 16.519.330.6, 6.3
 24.321.1, 16.016.632.5, 3.2
32.626.5, 29.029.447.4, 5.1
Adequate prenatal care1.041.9, 68.9NSNS
Father’s education (<high school at birth)3.78.5, 17.47.96.3, 24.2

Note: NS indicates variable that were not significant () and did not improve the and so were dropped from the final exposure model. NT indicates the variable was not tested for inclusion in the exposure model. CI, confidence interval; CV, cross validated; est., estimate; Hg, mercury; NBC, New Bedford Cohort; NS, not significant; NT, not tested; Pb, lead.

Percentage difference using following reference groups: non-Hispanic white, other ancestry, no maternal smoking during pregnancy, no maternal alcohol consumption during pregnancy, no previous lactation, household income , unmarried at birth, maternal education at birth, nulliparous, prenatal care not adequate, and paternal education at birth.

Estimates of the percentage difference in cord serum , DDE, and HCB in the NBC for parametric categorical terms in the generalized additive exposure models built using complete case data. Note: NS indicates variable that were not significant () and did not improve the and so were dropped from the final exposure model. CI, confidence interval; CV, cross validated; DDE, dichlorodiphenyl dichloroethylene; est., estimate; HCB, hexachlorobenzene; NBC, New Bedford Cohort; NS, not significant; , sum of four prevalent PCB congeners (118, 138, 153, 180). Percentage difference using the following reference groups: non-Hispanic white, ancestry other than Azores, Portugal, and Cape Verde, no maternal smoking during pregnancy, no maternal alcohol consumption during pregnancy, no previous lactation, block group–level household income , unmarried at birth, maternal education at birth, nulliparous, prenatal care not adequate, and paternal education at birth. Estimates of the percentage difference in cord blood Pb and maternal hair total Hg in the NBC for parametric terms in the generalized additive exposure models built using complete case data. Note: NS indicates variable that were not significant () and did not improve the and so were dropped from the final exposure model. NT indicates the variable was not tested for inclusion in the exposure model. CI, confidence interval; CV, cross validated; est., estimate; Hg, mercury; NBC, New Bedford Cohort; NS, not significant; NT, not tested; Pb, lead. Percentage difference using following reference groups: non-Hispanic white, other ancestry, no maternal smoking during pregnancy, no maternal alcohol consumption during pregnancy, no previous lactation, household income , unmarried at birth, maternal education at birth, nulliparous, prenatal care not adequate, and paternal education at birth. Continuous predictors in the exposure models included space and time represented by latitude and longitude of residential address, infant year of birth, and maternal age at birth. Results of a previous NBC study showed infant year of birth was strongly associated with PCB exposures (Choi et al. 2006). Furthermore, exposure to lipophilic organochlorines often increases with maternal age due to bioaccumulation (Axelrad et al. 2009; Birch et al. 2014). Birthweight, maternal weight gain (in kg), distance measures, and year the home was built were also tested as continuous predictors. Because the age of the home is often associated with the potential presence of Pb in plumbing or paint, we considered only build year in the Pb exposure model; build year was not tested (NT; Table 3) as a predictor in the Hg or organochlorine models. Categorical variables considered in all exposure models included maternal race/ethnicity and ancestry, parental education, mother’s marital status, block group income, parity, adequate prenatal care, maternal smoking and alcohol consumption during pregnancy, and previous lactation. Breastfeeding was tested in all models except the Hg model because it is not believed to be relevant for excretion of Hg (Table 3). The distributions for all variables are presented in Table 1. We calculated a predictive 10-fold cross-validation value by randomly dividing the NBC data into 10 groups. For each fold, 1 group was used as the test data and the remaining groups combined as the training data set. The models were fit on the training set and evaluated against the test set. Each group served as a test set once. The correlation between the observed exposures and predicted exposures for the 10 test sets were then averaged to calculate the 10-fold cross-validation value. The optimal degree of smoothing in the GAMs was chosen by maximizing the 10-fold cross-validation for each model.

Exposure Predictions for the MBRC

Each NBC exposure model was used to predict the exposures for all births with complete data in the MBRC from 1993 through 1998 for the study towns of New Bedford, Acushnet, Fairhaven, and Dartmouth; we calculated the mean, median, and the 25th and 75th percentiles of those estimates. To account for the effects of sampling variability on our NBC exposure prediction model, we also applied the bootstrap method to each NBC exposure model to generate a distribution of plausible exposure biomarker values. We drew repeated samples 1,000 times, with replacement, from the NBC. The exposure model was refit each time, arriving at a different set of coefficients for the model terms, and applied to data from the MBRC to obtain 1,000 predicted log-transformed exposure values. After back-transforming those values, we calculated the median, the 25th and 75th percentiles, and the corresponding interquartile range (IQR) for the population and individual bootstrapped exposure estimates. For the individual estimates, the median and the 25th and 75th percentiles were calculated across the 1,000 bootstrapped values predicted for each birth and then averaged. For the population estimates, the median and the 25th and 75th percentiles were calculated across the entire cohort population of 10,270 births for each bootstrap, resulting in a distribution of 1,000 values for each statistic (the median and the 25th and 75th percentiles). We then took the mean and 95% probability intervals (PIs) of each statistic’s distribution to assess the population exposures. Because the predictive characteristics of the population varied, we expected that the IQR of population exposures would be wider than the IQR for the exposures predicted for each individual birth using the bootstrap method. All calculations were performed using R (version 3.4.4; R Development Core Team), and the “gam” package was used for the models.

Exposure Model Performance

We also compared the performance of the GAMs to individual model and ensemble results from the SuperLearner package in R. SuperLearner evaluates the performance of multiple machine learning models, creates an optimal weighted average of the best performing models referred to as an ensemble, and provides comparisons of the ensemble to the other models using cross validation (Kennedy 2017). Using the SuperLearner function, we first fit the following models simultaneously: GAM, lasso, randomForest, XGBoost, SVM, and the mean of Y. The output provides a risk estimate for each as a measure of model performance, with lower risk estimates indicating better performance. The function also creates an ensemble with a weighted average of the individual models. We then calculated a predictive 10-fold cross-validation , using the ensemble to compare with the GAM models we developed for each exposure. To evaluate the performance of the individual models in the SuperLearner to the ensemble, we used the CV.SuperLearner function, which calculates the standard errors of each via a nested 10-fold cross validation. The risk estimates and standard errors were then plotted for comparison.

Results

NBC and MBRC Characteristics

We successfully linked 779 of the 782 NBC births to their Massachusetts birth record data. When the birth record characteristics for the NBC subset were compared with the entire MBRC for the study area, we saw very similar proportions. In general, sociodemographic and behavioral characteristics collected in the NBC were similar to those available for the MBRC from the same time period (Table 1). In both data sets, mothers were on average 26 y of age, and the majority of mothers were non-Hispanic white and married at the time of the child’s birth. The MBRC had a higher proportion of maternal ancestry from other than the Azores/Portugal or Cape Verde compared with the NBC variable (66% vs. 45%). Agreement between the two data sources for maternal ancestry was generally good (84%), and the higher proportion of missing data in the NBC may account for differences in the proportion of other ancestry. Reported smoking during pregnancy was high in both the NBC (26%) and the MBRC (23%), and there was 90% agreement between the two data sources, but there were significant differences in reported alcohol consumption during pregnancy (18% in the NBC vs. 2% in the MBRC; 79% agreement). In addition, differences in maternal education levels were observed, with 16.8% of the NBC reporting less than a high school education versus 28.6% of the MBRC. This difference may be due to the amount of missing data for this variable in the NBC (7.3% vs. 0.5% in the linked Massachusetts birth data) given that the percentage of mothers with at least a high school education was similar between the NBC data and the linked Massachusetts birth data (76.0% and 76.4% respectively). With paternal education, 24.0% of the NBC compared with 33.1% of the MBRC reported less than a high school education. However, when using the linked Massachusetts birth data for paternal education among the NBC subset, the proportion with a high school education was similar to the larger MBRC.

NBC Exposure Models

The 10-fold cross-validated values for the , DDE, HCB, Pb, and Hg exposure models were 0.54, 0.40, 0.34, 0.46, and 0.40, respectively (Tables 2 and 3). Tables 2 and 3 present the estimates of the percentage difference in biomarker levels of PCB, DDE, HCB, Pb, and Hg associated with categorical variables modeled parametrically. For all the exposure models except Pb, maternal ancestry was a significant predictor, with higher biomarker levels seen for mothers born in the Azores/Portugal. Compared with non-Hispanic whites, Hispanics and non-Hispanic women in other nonwhite racial groups had higher DDE levels. Conversely, non-Hispanic whites had higher Hg levels compared with other groups. For mothers who smoked during pregnancy, there was a significant increase in cord blood Pb compared with mothers who did not smoke, consistent with smoking’s association with blood Pb in other populations (Deutch and Hansen 1999; Rodosthenous et al. 2017; Saoudi et al. 2018). Paternal education was a significant predictor of PCB levels, with a 14% increase [95% confidence interval (CI): 2%, 28%] for infants whose fathers had less than a high school level education. Cord blood Pb levels were 21% higher (95% CI: 4%, 40%) among infants whose mothers had not completed high school compared with those whose mothers had at least a high school education. To assess the effect of continuous covariates modeled using smooths, exposures were predicted by varying one covariate at a time while holding the other variables constant at the median value (Table 4). Older mothers tended to have higher exposure estimates, whereas nonlinear effects in maternal age were observed for HCB and Hg, with women at the 75th percentile value of maternal age (30 y) having higher exposures than the oldest mothers (41 y of age). Although a change from the 25th to 75th percentile value for maternal age nearly doubled the prediction for DDE (0.232 to serum), an interquartile change in year of infant birth had little effect on the predictions (0.302 to serum). Nonlinear effects were also observed with birth weight. Cord blood Pb level predictions were higher for older homes compared with newer homes, and higher at the 25th than 75th percentile of distance to nearest road ( and compared with and ). Varying location, represented by longitude and latitude, also resulted in different exposure predictions, with the highest exposures generally at lower latitudes (closer to the ocean, Figure 1).
Table 4

Exposure predictions in the NBC calculated for a range of values of nonparametric continuous covariates in the generalized additive exposure models built using complete case data.

VariableValueΣPCB4 (ng/g)DDE (ng/g)HCB (ng/g)Hg (μg/g)Pb (μg/dL)
LongitudeMin71.0430.1200.2430.0240.4651.48
25th70.9390.1580.2970.0170.5371.34
Median70.9310.1620.3030.0170.5441.32
75th70.9220.1670.3090.0160.5521.31
Max70.8330.2060.3600.0120.6161.21
LatitudeMin41.5380.1930.4100.0120.7931.47
25th41.6240.1670.3200.0160.5831.35
Median41.6460.1620.3030.0170.5441.32
75th41.6660.1600.2940.0170.5261.31
Max41.7500.1380.2300.0210.3861.20
Infant year of birthMin19930.1960.3020.0240.6251.75
25th19940.1780.3020.0230.5831.52
Median19950.1620.3030.0170.5441.32
75th19970.1340.3040.0160.4741.01
Max19980.1220.3040.0220.4420.88
Maternal age (y)Min180.0830.1780.0120.5621.11
25th210.1130.2320.0150.3141.21
Median250.1620.3030.0170.5441.32
75th300.2560.4220.0230.6101.48
Max410.5400.8740.0160.1711.88
Pregnancy weight gain (kg)Min00.1620.4150.0190.4871.83
25th9.50.1560.2880.0170.5311.45
Median13.60.1620.3030.0170.5441.32
75th16.80.1560.3030.0160.5481.31
Max41.70.0900.1540.0100.4291.40
Birth weight (g)Min1,8710.1670.2470.0110.5581.38
25th3,0900.1670.2950.0170.5651.30
Median3,4020.1620.3030.0170.5441.32
75th3,6850.1550.2960.0170.5281.35
Max5,2160.1340.3220.0150.4311.41
Distance to harbor (m)aMin00.1550.2590.0170.426
25th4710.1590.2910.0170.528
Median9290.1620.3030.0170.544
75th1,6200.1670.2810.0160.576
Max8,5260.1700.3510.0120.601
Distance to road (m)aMin01.11
25th431.41
Median1031.32
75th1931.23
Max4,0571.18
Build year for home at birthaMin17281.49
25th19031.41
Median19201.32
75th19601.19
Max19981.07

Note: Predictions were made varying only the continuous variable of interest, holding the other continuous variables constant at the median. Categorical variables were held constant at the referent groups: non-Hispanic white, other ancestry, no maternal smoking during pregnancy, no maternal alcohol consumption during pregnancy, no previous lactation, household income , unmarried at birth, maternal education at birth, nulliparous, prenatal care not adequate, and paternal education at birth. —, not applicable; DDE, dichlorodiphenyl dichloroethylene; HCB, hexachlorobenzene; Hg, mercury; max, maximum; min, minimum; NBC, New Bedford Cohort; , sum of four prevalent PCB congeners (118, 138, 153, 180); Pb, lead.

Distance to harbor was not included in the Pb model. Distance to nearest road and build year for home at birth were included only in the Pb model.

Exposure predictions in the NBC calculated for a range of values of nonparametric continuous covariates in the generalized additive exposure models built using complete case data. Note: Predictions were made varying only the continuous variable of interest, holding the other continuous variables constant at the median. Categorical variables were held constant at the referent groups: non-Hispanic white, other ancestry, no maternal smoking during pregnancy, no maternal alcohol consumption during pregnancy, no previous lactation, household income , unmarried at birth, maternal education at birth, nulliparous, prenatal care not adequate, and paternal education at birth. —, not applicable; DDE, dichlorodiphenyl dichloroethylene; HCB, hexachlorobenzene; Hg, mercury; max, maximum; min, minimum; NBC, New Bedford Cohort; , sum of four prevalent PCB congeners (118, 138, 153, 180); Pb, lead. Distance to harbor was not included in the Pb model. Distance to nearest road and build year for home at birth were included only in the Pb model.

Predicted Exposures for the MBRC

Biomarker levels predicted for the MBRC using the entire NBC (prior to bootstrapping) showed similar distributions as the NBC biomarkers (Figure 2). Table 5 presents the mean and 95% PIs of the median and the 25th and 75th percentiles of the predicted biomarker concentrations and corresponding IQR across the entire population of the Massachusetts birth cohort using the bootstrap method. Based on these predicted biomarkers, it was possible to characterize highly exposed subpopulations. For example, women with ancestry from the Azores/Portugal had predicted median PCB exposure of , whereas women with other ancestry had predicted median PCB exposure of . In addition, women above the 90th percentile in PCBs were disproportionately older mothers with ancestry from the Azores/Portugal. In addition, for each birth, we found the median, the 25th and 75th percentiles, and IQR difference across the 1,000 bootstrapped exposure estimates predicted for that birth and then averaged over all the births (Table 6). The average individual IQRs (Table 6) are much smaller than the population IQRs (Table 5) as expected given that the characteristics for predicting exposures vary across the population but not at the individual level.
Figure 2.

Box plot of exposure biomarker predictions for the Massachusetts Birth Records Cohort (MA_Births; in gold) compared with measured exposure biomarker concentrations for the New Bedford Cohort (NBC; in red-violet). The lower and upper boundaries of the boxes represent the exposure values for the 25th to 75th percentiles of the exposure distribution. The line in each box represents the median of the distribution, and the whiskers represent 1.5 times the interquartile range. The points indicate outlier values beyond this range.

Table 5

Mean and 95% probability interval (PI) of the median and the 25th and 75th percentiles of the biomarker exposure concentrations and corresponding interquartile range (IQR) across the entire population of the MBRC () predicted using the NBC exposure models with bootstrapping.

BiomarkersMedian (95% PI)25th percentile (95% PI)75th percentile (95% PI)IQR
ΣPCB4 (ng/g)0.18 (0.17–0.20)0.13 (0.12–0.14)0.26 (0.25–0.28)0.13
DDE (ng/g)0.31 (0.29–0.33)0.23 (0.21–0.25)0.42 (0.39–0.46)0.19
HCB (ng/g)0.022 (0.021–0.024)0.017 (0.016–0.018)0.029 (0.028–0.031)0.012
Hg (μg/g)0.47 (0.44–0.50)0.35 (0.32–0.38)0.63 (0.58–0.69)0.28
Pb (μg/dL)1.31 (1.25–1.42)1.01 (1.00–1.07)1.73 (1.62–1.86)0.72

Note: DDE, dichlorodiphenyl dichloroethylene; HCB, hexachlorobenzene; Hg, mercury; MBRC, Massachusetts Birth Record Cohort; NBC, New Bedford Cohort; Pb, lead; , sum of four prevalent PCB congeners (118, 138, 153, 180).

Table 6

Mean of the median, the 25th and 75th percentiles of the predicted biomarker concentrations, and interquartile range (IQR) across the 1,000 bootstrapped results for each individual birth in the MBRC ().

BiomarkerMedian25th percentile75th percentileIQR
ΣPCB4 (ng/g)0.190.170.210.04
DDE (ng/g)0.320.280.350.07
HCB (ng/g)0.0220.0190.0260.007
Hg (μg/g)0.470.410.540.13
Pb (μg/dL)1.341.211.490.28

Note: DDE, dichlorodiphenyl dichloroethylene; HCB, hexachlorobenzene; Hg, mercury; MBRC, Massachusetts Birth Record Cohort; Pb, lead; , sum of four prevalent PCB congeners (118, 138, 153, 180).

Box plot of exposure biomarker predictions for the Massachusetts Birth Records Cohort (MA_Births; in gold) compared with measured exposure biomarker concentrations for the New Bedford Cohort (NBC; in red-violet). The lower and upper boundaries of the boxes represent the exposure values for the 25th to 75th percentiles of the exposure distribution. The line in each box represents the median of the distribution, and the whiskers represent 1.5 times the interquartile range. The points indicate outlier values beyond this range. Mean and 95% probability interval (PI) of the median and the 25th and 75th percentiles of the biomarker exposure concentrations and corresponding interquartile range (IQR) across the entire population of the MBRC () predicted using the NBC exposure models with bootstrapping. Note: DDE, dichlorodiphenyl dichloroethylene; HCB, hexachlorobenzene; Hg, mercury; MBRC, Massachusetts Birth Record Cohort; NBC, New Bedford Cohort; Pb, lead; , sum of four prevalent PCB congeners (118, 138, 153, 180). Mean of the median, the 25th and 75th percentiles of the predicted biomarker concentrations, and interquartile range (IQR) across the 1,000 bootstrapped results for each individual birth in the MBRC (). Note: DDE, dichlorodiphenyl dichloroethylene; HCB, hexachlorobenzene; Hg, mercury; MBRC, Massachusetts Birth Record Cohort; Pb, lead; , sum of four prevalent PCB congeners (118, 138, 153, 180).

Exposure Model Performance Comparison

The 10-fold cross-validated values for the , DDE, HCB, Pb, and Hg exposure models using the GAMs we developed (0.54, 0.40, 0.34, 0.46, and 0.40, respectively) were similar to the 10-fold cross-validated values using the ensemble output from the SuperLearner package in R (cross-validated values of 0.54, 0.45, 0.33, 0.44, 0.32, respectively). The results of the nested SuperLearner cross validation showed that the GAM model performance was statistically similar to other modern modeling approaches, including lasso, randomForest, and the ensemble (see Figures S1–S5); the risk estimates and standard errors overlap. In building the GAM exposure models, modeling continuous variables using nonlinear smooths increased the pseudo compared with linear models (see Tables S1–S5).

Discussion

The exposure models built in this study explained variability across several different chemicals using predictors available from the MBRC linked to biomarkers measured in the NBC, allowing for both exposure predictions for epidemiological studies and identification of susceptible subgroups. Our previous research with the NBC indicated that the range of exposures modeled in the MBRC, as well as the differential exposures associated with key sociodemographic covariates, are sufficient to be associated with adverse child health outcomes in epidemiologic analyses (Sagiv et al. 2010, 2012a, 2012b). In considering susceptible subgroups, a significant predictor across all exposure models, with the exception of Pb, was maternal ancestry from the Azores/Portugal. This could be due to distinctive dietary patterns, such as fish consumption (FAO 2011), or to differential early life exposures to bioaccumulative chemicals among mothers either born in these countries or exposed transgenerationally via the previous generation’s exposures. The fact that maternal ancestry was a more consistent predictor than race/ethnicity emphasizes the potential importance of more granular demographic predictors when available. Location should also be considered in exposure models when available. We observed nonlinear associations with longitude and latitude, with births closer to the coastline, where industrial activities are located in this community, having higher exposures. Individuals living closer to the coastline may also be more likely to have higher seafood consumption, which is a known route of exposure for some of these contaminants. Inverse associations were generally observed in parous compared with nulliparous mothers, consistent with chemical elimination from breastfeeding or pregnancy (ATSDR 2004; Nickerson 2006). Although some of these associations do not reflect modifiable risk factors, they do allow for differential exposure assignment for epidemiology, and potential exploration of underlying exposure pathways for which intervention may be possible. The strength of paternal (as well as maternal) educational attainment in predicting many biomarker levels suggests that this is also an indicator of household SES within this population, especially in the absence of individual-level or household-level measures of income. Inclusion of residential distance to the nearest major road and build year for home at birth as predictors of Pb reinforces previous findings that residential exposure pathways persist, especially in lower-income urban settings with an older housing stock. One limitation of the analysis was that paternal education and home build year were missing for a large proportion of the birth records. Although our exposure models used complete data only, future epidemiologic analyses that use the exposure predictions may consider multiple imputation methods to address the issue of missing data. Another limitation of the analysis is that variables in the NBC such as diet that could have increased the variance explained by the exposure models were not available in the MBRC. Diet, including fish and organ meat consumption, are important predictors for many of the exposures we targeted for study (Choi et al. 2006). Although maternal ancestry may have served as an indicator of dietary habits, having additional food intake information may have improved our models and increased their ability to ascertain routes of exposure. That said, administrative data sets rarely have dietary and other behavioral information, so our ability to explain significant variance in the absence of these data is notable. Last, our exposure regression models may not be generalizable to other geographic areas. Although residential distance to the harbor (a term specific to the New Bedford area) was not associated with umbilical cord serum PCB levels in a previous analysis (Choi et al. 2006), we included it in the exposure models (except for Pb) to capture any residual sociodemographic effects based on results from a spatial study that showed associations with proximity to the harbor (Vieira et al. 2017). Other sociodemographic variables might have different meanings in different settings. That said, the approach is generalizable to any setting where biomarker measurements and sociodemographic information are available for a contemporaneous subset of study area participants. We used GAMs to build our exposure models but acknowledge that other models with comparable flexible modeling features may have performed similarly. We were able to increase the pseudo value of each model, compared with linear models, by smoothing continuous variables. Using the SuperLearner package in R, we showed that the GAM performed as well as other modeling techniques, including lasso and randomForest, and that the 10-fold cross-validated values for the GAM exposure models we developed were similar to the ensemble results from the SuperLearner. Moreover, GAMs have been applied previously to NBC data (Vieira et al. 2017) and can yield valuable insight regarding functional forms that facilitate model interpretability. Our cross-validated values showed comparable performance to exposure regression models used in other successful epidemiologic studies, including simulation studies that illustrated the robustness of exposure–outcome associations (Avanasi et al. 2016; Baxter et al. 2010; Shin et al. 2011). Although there are several approaches for building exposure models, we used the model that resulted in the highest value to decrease the bias in our estimates. Using this method would suggest putting all of the variables into the model, given that increasing variables increases the , but we allowed our sample size to change due to missingness from each variable to determine which variables in the model would give the largest pseudo value. Although using a liberal variable selection method decreased the bias in our estimates and is generally recommended for model selection when a subset of the data is available (Rubin 1996), it contributed to uncertainty in our exposure predictions. The bootstrap method accounted for sampling variability without assuming a parametric distribution, as reflected by the 95% PIs shown in Table 5. Those intervals are reasonably narrow, indicating that the central tendency and IQR of predicted exposure are fairly stable. Our approach does not account for other sources of uncertainty. For example, our model was not able to predict all the variation in observed biomarker concentrations; unexplained residual variation contributes to the overall uncertainty in biomarker predictions but is not assessed by ordinary bootstrap estimation methods. Future work might include generating parametric or nonparametric bootstrap prediction distributions for more comprehensive evaluation of the effects of individual exposure uncertainty in epidemiological analyses. In summary, our study showed how multiple prenatal chemical exposures can be estimated in a general population administrative data set by modeling available measured biomarker data for a subset of the population using GAMs and key sociodemographic and behavioral information. Our models can be used to predict exposure biomarker concentrations in future epidemiological investigations of health outcomes. In addition, they yielded valuable insights about residents in a community near a Superfund site who may have been at increased risk of exposure to a range of chemicals. Click here for additional data file. Click here for additional data file.
  35 in total

1.  Measurement of PCBs, DDE, and hexachlorobenzene in cord blood from infants born in towns adjacent to a PCB-contaminated waste site.

Authors:  S A Korrick; L M Altshul; P E Tolbert; V W Burse; L L Needham; R R Monson
Journal:  J Expo Anal Environ Epidemiol       Date:  2000 Nov-Dec

2.  Neurobehavioral deficits associated with PCB in 7-year-old children prenatally exposed to seafood neurotoxicants.

Authors:  P Grandjean; P Weihe; V W Burse; L L Needham; E Storr-Hansen; B Heinzow; F Debes; K Murata; H Simonsen; P Ellefsen; E Budtz-Jørgensen; N Keiding; R F White
Journal:  Neurotoxicol Teratol       Date:  2001 Jul-Aug       Impact factor: 3.763

3.  Evaluating the Healthy Start program: a life course perspective.

Authors:  Milton Kotelchuck
Journal:  Matern Child Health J       Date:  2010-09

4.  Effects of exposure measurement error in the analysis of health effects from traffic-related air pollution.

Authors:  Lisa K Baxter; Rosalind J Wright; Christopher J Paciorek; Francine Laden; Helen H Suh; Jonathan I Levy
Journal:  J Expo Sci Environ Epidemiol       Date:  2009-02-18       Impact factor: 5.563

5.  Using linked data to assess patterns of early intervention (EI) referral among very low birth weight infants.

Authors:  Wanda D Barfield; Karen M Clements; Kimberly G Lee; Milton Kotelchuck; Nancy Wilber; Paul H Wise
Journal:  Matern Child Health J       Date:  2007-06-12

6.  Maternal exposure to traffic-related air pollution and birth defects in Massachusetts.

Authors:  Mariam S Girguis; Matthew J Strickland; Xuefei Hu; Yang Liu; Scott M Bartell; Verónica M Vieira
Journal:  Environ Res       Date:  2015-12-17       Impact factor: 6.498

7.  Neuropsychological measures of attention and impulse control among 8-year-old children exposed prenatally to organochlorines.

Authors:  Sharon K Sagiv; Sally W Thurston; David C Bellinger; Larisa M Altshul; Susan A Korrick
Journal:  Environ Health Perspect       Date:  2012-02-22       Impact factor: 9.031

8.  Effect of prenatal exposure to polychlorinated biphenyls on incidence of acute respiratory infections in preschool Inuit children.

Authors:  Frédéric Dallaire; Eric Dewailly; Carole Vézina; Gina Muckle; Jean-Philippe Weber; Suzanne Bruneau; Pierre Ayotte
Journal:  Environ Health Perspect       Date:  2006-08       Impact factor: 9.031

9.  Prenatal organochlorine exposure and measures of behavior in infancy using the Neonatal Behavioral Assessment Scale (NBAS).

Authors:  Sharon K Sagiv; J Kevin Nugent; T Berry Brazelton; Anna L Choi; Paige E Tolbert; Larisa M Altshul; Susan A Korrick
Journal:  Environ Health Perspect       Date:  2008-05       Impact factor: 9.031

10.  Prenatal organochlorine and methylmercury exposure and memory and learning in school-age children in communities near the New Bedford Harbor Superfund site, Massachusetts.

Authors:  Sara T C Orenstein; Sally W Thurston; David C Bellinger; Joel D Schwartz; Chitra J Amarasiriwardena; Larisa M Altshul; Susan A Korrick
Journal:  Environ Health Perspect       Date:  2014-08-06       Impact factor: 9.031

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.