Literature DB >> 35913906

Estimating National Exposures and Potential Bladder Cancer Cases Associated with Chlorination DBPs in U.S. Drinking Water.

Richard J Weisman1, Austin Heinrich1, Frank Letkiewicz2, Michael Messner1, Kirsten Studer1, Lili Wang1, Stig Regli1.   

Abstract

BACKGROUND: Disinfection byproducts (DBPs) in public water systems (PWS) are an unintended consequence resulting from reactions between mostly chlorine-based disinfectants and organic and inorganic compounds in source waters. Epidemiology studies have shown that exposure to DBP (specifically trihalomethanes) was associated with an increased risk of bladder cancer.
OBJECTIVE: Our goal was to characterize the relative differences in exposures and estimated potential bladder cancer risks for people served by different strata of PWS in the United States and to evaluate uncertainties associated with these estimates.
METHODS: We stratified PWS by source water type (surface vs. groundwater) and population served (large, medium, and small) and calculated population-weighted mean trihalomethane-4 (THM4) concentrations for each stratum. For each stratum, we calculated a population attributable risk (PAR) for bladder cancer using odds ratios derived from published pooled epidemiology estimates as a function of the mean THM4 concentration and the fraction of the total U.S. population served by each stratum of systems. We then applied the stratum-specific PARs to the total annual number of new bladder cancer cases in the U.S. population to estimate bladder cancer incidence in each stratum.
RESULTS: Our results show that approximately 8,000 of the 79,000 annual bladder cancer cases in the United States were potentially attributable to DBPs in drinking water systems. The estimated attributable cases vary based on source water type and system size. Approximately 74% of the estimated attributable cases were from surface water systems serving populations of >10,000 people. We also identified several uncertainties that may affect the results from this study, primarily related to the use of THM4 as a surrogate measure for DBPs relevant to bladder cancer. DISCUSSION: Despite significant reductions in exposure over the past several decades, our study suggests that ∼10% of the bladder cancer cases in the United States may still be attributed to exposure to DBPs found in drinking water systems. https://doi.org/10.1289/EHP9985.

Entities:  

Mesh:

Substances:

Year:  2022        PMID: 35913906      PMCID: PMC9342685          DOI: 10.1289/EHP9985

Source DB:  PubMed          Journal:  Environ Health Perspect        ISSN: 0091-6765            Impact factor:   11.035


Introduction

More than 250 million people in the United States are served by public water systems (PWS) that chemically disinfect their water to kill or inactivate pathogenic microbial contaminants.[1] The control of infectious diseases resulting from clean water and improved sanitation has been noted as one of the most significant public health advancements of the 20th century.[2] Although not nearly as significant a risk as undisinfected, high-risk waters, chemical disinfection may also pose health risks of its own due to the formation of disinfection byproducts (DBPs).[3,4] DBPs, including trihalomethane-4 (THM4, comprising chloroform, bromodichloromethane, chlorodibromomethane, and bromoform), are formed from reactions between chlorine-based disinfectants and organic and inorganic compounds in source waters.[5] Researchers have identified more than 700 different DBPs that can form during the chlorination process.[6] In addition to chlorine, the formation of these DBPs can also incorporate bromine, iodine, and nitrogen depending on precursor presence in the drinking water source.[7] Over the past 40 y, the U.S. Environmental Protection Agency (U.S. EPA) has sequentially promulgated three regulations to reduce exposures to DBPs in PWS and their associated health risks: the interim Total Trihalomethane (TTHM) Rule, and the Stage 1 and Stage 2 Disinfectants and Disinfection Byproducts Rules (D/DBPRs).[4,8,9] These regulations include maximum contaminant levels (MCLs) as well as requirements for treatment techniques and monitoring. The U.S. EPA also promulgated corresponding Surface Water Treatment Rules to prevent increases in microbial risk while systems made changes to comply with the DBP rules (see Supplemental Material, “Additional Information about U.S. EPA DBP Regulations.”).[10-12] Other countries that have developed DBP regulations or guidelines include Australia, Canada, Germany, Japan, the Netherlands, New Zealand, South Africa, Sweden, and the United Kingdom.[13] To our knowledge, 90 countries have legislation and/or conducted monitoring for total THM (i.e., THM4).[14,15] Epidemiology studies have shown that increased exposure to THM4 in drinking water was associated with a higher risk of bladder cancer,[16-23] and other health outcomes.[24-27] Despite the considerable epidemiological evidence, specific causative DBPs and their mode of action relevant to bladder cancer have not been clearly established; the lack of a good animal model for THM-associated bladder carcinogenicity is also a limitation.[28] Nonetheless, the U.S. EPA used THM4 for development of its dose–response function to estimate baseline and potential reductions in bladder cancer risk resulting from promulgation of the Stage 1 and Stage 2 D/DBPRs.[29] In its economic analysis for Stage 2, the U.S. EPA estimated the annual number of potential bladder cancer cases in the United States attributable to chlorination DBPs (i.e., those formed due to any use of chlorine within the treatment plant) in drinking water and the expected reduction of these cases from implementation of the Stage 1 and Stage 2 D/DBPRs.[29] The U.S. EPA developed a dose–response function examining the relationship between THM4 concentration in drinking water and increased bladder cancer risk based on a pooled-data analysis of six case–control studies.[21] Using national THM4 occurrence data from 1997 to 1998 combined with this dose–response function, the U.S. EPA estimated that the proportion of lifetime bladder cancer [i.e., population attributable risk (PAR)] associated with chlorination DBPs in drinking water was 17.1% as a pre-Stage 1 baseline risk (i.e., the baseline risk prior to implementation of the Stage 1 D/DBPR).[29] However, in the Stage 2 economic analysis, the U.S. EPA also noted that a causal relationship between bladder cancer and exposure to any individual DBP or combinations of DBPs had not yet been established and that the lower bound of the potential risk estimates could be as low as zero.[29] More recently, Regli et al.[30] reexamined the Stage 2 D/DBPR dose–response function to further evaluate the uncertainty around the estimates derived from its application to THM4 concentration levels. One source of uncertainty in the estimation of nationwide THM4 levels was the use of older data from the Information Collection Rule[31] collected from PWS serving a population people during the period July 1997 to December 1998.[32] More recent data collected from the period 2006–2011 as part of the third Six-Year Review (SYR3) of national primary drinking water regulations represent the most complete summary of DBP occurrence at PWS in the United States since the 1996 rule.[33,34] Given the updated and more representative occurrence data, the purpose of this analysis is to characterize the relative potential differences in exposures from THM4 in drinking water and the associated potential bladder cancer cases. Second, we expanded the scope to add more specificity on potential risk related to groups of people served by different strata of PWS based on the type of source water (surface vs. groundwater) and the size of the PWSs serving that stratum (i.e., small, medium, and large PWS). In addition, we evaluate uncertainties associated with the limits of these characterizations, with an emphasis on those associated with the use and potential relevance of THM4 as a surrogate for the suite of chlorination DBPs and the potential changes in DBP mixtures over the past few decades.

Methods

Stratification of PWS

For the analyses performed here, we stratified the PWS into six groups based on different combinations reflecting the following: Two source water categories as defined by the U.S. EPA: surface water (all types of surface waters including Groundwater Under the Direct Influence of Surface Water) or groundwater (all types of groundwater systems) Three size groups based on population served by PWS: small ( people served), medium (10,000–100,000 people served), or large ( people served). The surface water vs. groundwater distinction is important because surface water–supplied systems typically have higher concentrations of organic DBP precursors and DBPs than groundwater systems.[35] The PWS-size groups help to inform potential differences in DBP levels, and hence DBP exposures, across these groups. For example, small PWS were first required to meet a THM4 MCL limit about 20 y later than the medium and large PWS (which were required to comply with the 1979 interim MCL of ). Additionally, large PWS were part of the extensive study conducted in the period 1997–1998 about DBP occurrence and treatment,[32] which allows for a more detailed evaluation of changes in those systems over time than is possible with the small or medium systems. The PWS in each source-water/size stratum were also grouped into two THM4 concentration range bins: and based on system annual mean THM4 concentrations. In the Stage 1 and Stage 2 D/DBPRs,[4,9] is the threshold level representing the concentration below which systems may qualify for reduced monitoring.

Calculation of Population-Weighted Mean THM4 Concentrations

As shown in Figure 1, we used the compliance monitoring data from the SYR3 data set to calculate a population-weighted mean THM4 concentration for PWS in each of the six strata.[36] The SYR3 data set used in this study consists of THM4 concentrations and number of people served by individual PWS as reported by states and other primacy agencies. Prior to calculation of the population-weighted mean THM4 concentrations, the SYR3 data set was examined to ensure that it met minimum data quality assurance and quality control (QA/QC) criteria.[34] The examination of implausible values for DBPs included errors in reported units of measurement, sample type, sample location (i.e., only from distribution systems; no entry point data were included), sample date, and outliers (i.e., THM4 concentrations greater than , or 10 times the MCL of , were excluded as likely reporting errors). Fewer than 0.05% of records were excluded due to missing measurement units and erroneous sample types or as outliers, and 2% were excluded for not being distribution system samples. THM4 concentrations reported below the reporting limit were counted as zero to estimate.
Figure 1.

Overview of methodology used to estimate U.S. national exposures and potential bladder cancer cases for each stratum. This illustrates information sources and actions applied for each stratum.

Overview of methodology used to estimate U.S. national exposures and potential bladder cancer cases for each stratum. This illustrates information sources and actions applied for each stratum. Our calculation of the population-weighted mean THM4 concentrations focused on concentration data from community water systems (CWS) and nontransient non-CWS (NTNCWS) because they were subject to the Stage 1 and Stage 2 D/DBPRs. CWS are PWS that serve at least 15 service connections used by year-round residents or regularly serve at least 25 year-round residents. NTNCWS are PWS that are not CWS and that regularly serve at least 25 of the same people for more than 6 months per year. CWS account for about 99% of the population served by systems in our analysis. We assumed that individuals receiving water from CWS and NTNCWS experience long-term exposure. Although the SYR3 data set contains compliance monitoring data for 6 y (2006–2011), our study was limited to data from only calendar year, 2011, because it is the most recent year in the data set. The 2011 data used in this study were from 20,760 disinfecting systems serving a total of nearly 198 million people in 42 states/tribal lands (see Figure 2, which shows the states and tribal lands that submitted THM4 compliance monitoring data for 2011). Approximately 86,000 THM4 monitoring records were available from those systems; the average number of records varied based on system size and source water type (additional information about the number of THM4 records for 2011 and supporting data showing representatives of the 42 states is provided in Tables S1 and S2, respectively). Data from 2011 (referred to in this paper as post-Stage 1) also reflects occurrence following the effective date for the Stage 1 D/DBPR for all PWS (generally considered as spanning from 2001 to 2004), but prior to the effective date for the Stage 2 D/DBPR (generally considered as spanning from 2012 to 2014).
Figure 2.

States and tribal lands that submitted THM4 compliance monitoring data for calendar year 2011 and comprising Six-Year Review 3 data set (shown with shading). Data for 20,760 disinfecting systems serving a total of nearly 198 million people. See Supplemental Material Table S1 for information about number of THM4 records by system size and source water type. Map was created in R (version 4.0.0; R Development Core Team). Note: THM4, trihalomethane-4.

States and tribal lands that submitted THM4 compliance monitoring data for calendar year 2011 and comprising Six-Year Review 3 data set (shown with shading). Data for 20,760 disinfecting systems serving a total of nearly 198 million people. See Supplemental Material Table S1 for information about number of THM4 records by system size and source water type. Map was created in R (version 4.0.0; R Development Core Team). Note: THM4, trihalomethane-4. For each PWS in a given stratum, its THM4 annual mean concentration was multiplied by its population served (i.e., as reported by states and other primacy agencies in the SYR3 data set). Those products for each stratum were summed and divided by the total population served by all systems in that stratum to arrive at a population-weighted mean concentration for each stratum. Although the population-weighted mean THM4 concentration for each stratum is based on data for both CWS and NTNCWS, the national analysis shown in the “Results” section represents only CWS to avoid potential double-counting of those residents/users who obtain some portion of their drinking water from a CWS and another portion from an NTNCWS. For groundwater strata that was derived from the SYR3 data, we accounted for the population served by nondisinfecting groundwater systems to arrive at a national population-weighted mean reflecting both disinfecting and nondisinfecting groundwater systems. We used data from the U.S. EPA Stage 2 economic analysis[29] showing the percent of the population served by disinfecting and nondisinfecting groundwater systems to make this adjustment. We assumed that the THM4 concentrations at nondisinfecting groundwater systems were . An example of the approach for applying this assumption is for small groundwater systems, which had a population-weighted mean for disinfecting systems estimated to be from the SYR3 data. Because approximately 17% of the population served by small groundwater systems is served from nondisinfecting groundwater systems,[29] the national population-weighted mean concentration for all small groundwater systems was calculated to be [i.e., ].

Post-Stage 2 THM4 Concentration Methodology

To estimate the post-Stage 2 THM4 mean concentrations, we used summary-level data from the U.S. EPA Stage 2 economic analysis[29] on the predicted percent reduction in average THM4 concentration from post-Stage 1 to post-Stage 2 and applied those estimated reductions to the post-Stage 1 concentrations obtained from the SYR3 data described above. In its Stage 2 economic analysis, the U.S. EPA estimated a reduction in overall average THM4 concentration of 7.8%, with a range (based on system size) of 7.2%–9.2% for surface water systems and 1.4%–2.0% for groundwater systems (see Exhibit 5.23 of the U.S. EPA Stage 2 economic analysis[29] for fifth and 95th percentile estimates). Based on that information for surface water systems, and assuming a similar degree of uncertainty for the percentage reduction in groundwater systems, the estimated mean percentage reduction estimates (with fifth and 95th percentile values) were: Surface water serving people: 9.2% (Fifth percentile: 5.1%, 95th percentile: 13.5%) Surface water serving people: 7.2% (Fifth percentile: 4.7%, 95th percentile: 9.7%) Groundwater serving people: 1.4% (Fifth percentile: 0.8%, 95th percentile: 2.1%) Groundwater serving people: 2.0% (Fifth percentile: 1.3%, 95th percentile: 2.7%) All systems: 7.8% (Fifth percentile: 4.5%, 95th percentile: 11.2%). The U.S. EPA Stage 2 economic analysis[29] showed a breakdown of the mean percent reductions by water source and system size but did not provide separate removal estimates for the concentration range bins used in this evaluation (i.e., and ). We anticipate that most of the reduction in THM4 concentration would be reflected by PWS in the range rather than in the range. For this study, we assumed that 100% of the THM4 reductions would be in the range, and no reductions in the range, for both surface water and groundwater systems. Footnote “d” in Table 2 provides an example showing how this approach was applied to estimating post-Stage 2 THM4 mean concentrations for one specific stratum (i.e., surface water systems serving people).
Table 2

Estimate of THM4 mean concentrations among U.S. community water systems in year 2011 post-Stage 1 D/DBPR and any year post-Stage 2 D/DBPR (see Excel Table S2 for underlying data).

Source water typeSystem size (population served)Post-Stage 1 THM4 mean concentrationsa (μg/L)Percentage reduction from Stage 1 to Stage 2b,cPost-Stage 2 THM4 mean concentrationsd (μg/L)
40μg/L>40μg/L80μg/LTotalAll systems40μg/L>40μg/L80μg/LTotal
Surface water systems<10,00022.554.739.09.2%22.548.036.2
10,000–100,00023.652.434.29.2%23.643.731.1
>100,00023.449.433.47.2%23.441.430.4
Subtotal23.451.034.223.442.931.1
Groundwater systems<10,0006.356.410.91.4%6.348.710.7
10,000–100,00011.053.817.11.3%11.051.516.8
>100,00016.450.519.61.7%16.447.619.4
Subtotal10.254.215.210.250.014.9
All systemsTotal18.551.428.77.8%18.543.726.4

Note: —, not applicable; D/DBPR, U.S. Environmental Protection Agency Disinfectants and Disinfection Byproducts Rule; THM4, trihalomethane-4.

Stage 1 Disinfectants and Disinfection Byproducts Rule.

From Stage 2 economic analysis, Exhibit 5.23 with groundwater system reductions adjusted for nondisinfecting systems.

Using the fifth and 95th percentile estimates of percent reduction from Stage 1 to Stage 2, the overall range of percent reduction was estimated to be 4.4%–11.2%, resulting in an overall range for the post-Stage 2 THM4 concentration of . Calculation of the post-Stage 2 concentrations is based on two assumptions: a) All Stage 2 reductions will occur in the systems, and therefore the post-Stage 2 concentrations for the systems are the same as the Stage 1 concentrations; and b) For each source and size strata, the post-Stage 2 concentration for all systems is a population-weighted average of the concentrations in the two ranges of interest.

The to concentrations can be expressed as . Using the data for the surface water systems serving people as an example to calculate the THM4 post-Stage 2 concentration for the range results in: .

Calculation of the Odds Ratio (OR)

As described in Regli et al.[30] the stratum-specific ORs derived from pooled data of Villanueva et al.[21] were based on the following Equation 1: where is the mean THM4 concentration for the i stratum, and 0.00427 [95% confidence interval (CI): 0.00164, 0.00626] is the model parameter (i.e., the weighted slope for ORs as a function of THM4 concentration). Villanueva et al.[21] combined data from six case–control studies conducted in the United States and Europe that included 2,806 cases and 5,254 controls for whom estimates of THM4 exposure were available for at least 70% of the exposure window. The authors used logistic regression to obtain ORs that were adjusted for study site, age, sex, education, smoking status (never, current, ex-smoker), work in a high-risk occupation for bladder cancer, heavy coffee consumption, and total fluid intake.[21] Although it may be unclear whether they are related to DBP exposures, these potential confounding factors are important to control for because of their contribution to or influence on bladder cancer incidence. Despite this uncertainty, given the magnitude of some of these bladder cancer risk factors, such as smoking, sex, and occupational hazards, control for these covariates in this pooled analysis by Villanueva et al. was warranted.[37] Given that we also calculated stratum-specific ORs based on upper and lower CIs noted above, this analysis did not further evaluate the confounding factors associated with the population served by the PWS in each stratum.

Calculation of the Population Attributable Risk

For each stratum, we calculated a PAR for bladder cancer using stratum-specific ORs derived from Villanueva et al. as a function of the mean THM4 concentration and the fraction of the total U.S. population served by each stratum of systems. The calculation of the PAR for each stratum used Equation 2, with ORs used as a measure of relative risk: where equals the PAR for the i stratum, equals the fraction of the total population in the i stratum, and equals the OR for the i stratum as calculated above. The population fraction for a given stratum is an estimate of the portion of the total population in the United States that is served by the CWS stratum (269.3 million people, as shown in Table 1). There were approximately 38.7 million people in the United States who get drinking water from private wells,[38] and we accounted for them in our estimate of the fraction of the total population in each of the strata. We assumed that all private wells are undisinfected (i.e., none are using chlorinated water) and that their THM4 concentrations are zero.
Table 1

Number of U.S. community water systems and populations served by strata in year 2011 post-Stage 1 D/DBPR (see Excel Table S1 for underlying data).

Source water typeSystem size (population served)Number of systems with THM4 mean concentrationsaPopulation served by systems with THM4 mean concentrations in ranges indicated (millions)
40μg/L >40μg/L80μg/L Total 40μg/L >40μg/L80μg/L Total
Surface water systems <10,000 4,2134,7488,9618.29.517.7
10,000–100,0001,4049382,34240.323.964.2
>100,000 24211135366.942.3109.2
Subtotal5,8595,79711,656115.475.7191.1
Groundwater systems <10,000 35,0092,82137,83026.83.129.9
10,000–100,0001,2931861,47928.84.933.6
>100,000,000 6186913.31.414.7
Subtotal36,3643,01439,37868.99.378.2
All systemsTotal42,2238,81251,034184.385.0269.3

Note: D/DBPR, U.S. Environmental Protection Agency Disinfectants and Disinfection Byproducts Rule; MCL, maximum contaminant level; PWS, public water system; THM4, trihalomethane-4.

PWS with THM4 mean concentrations were assumed to reduce their concentrations to achieve compliance with the MCL over time and included in the range bin with the average concentration for systems in that bin.

Number of U.S. community water systems and populations served by strata in year 2011 post-Stage 1 D/DBPR (see Excel Table S1 for underlying data). Note: D/DBPR, U.S. Environmental Protection Agency Disinfectants and Disinfection Byproducts Rule; MCL, maximum contaminant level; PWS, public water system; THM4, trihalomethane-4. PWS with THM4 mean concentrations were assumed to reduce their concentrations to achieve compliance with the MCL over time and included in the range bin with the average concentration for systems in that bin. The for the systems with THM4 mean concentrations and systems with THM4 mean concentrations were obtained by applying the SYR3 population fractions for each concentration range to the total population values nationally. Fewer than 3% of the systems had THM4 mean concentrations , and those were assumed to reduce their concentrations to achieve compliance with the MCL over time. Those systems all served relatively small populations (i.e., people) and account for approximately 1% of the total population in this study. Those systems were not excluded from this analysis but rather were included in the range bin and assumed to have the average concentration for systems in that bin.

Application of the PAR

The final step in the calculation was to multiply the PAR value by the number of annual new bladder cancer cases in the United States, estimated to be 79,030, based on National Cancer Institute (NCI) data for 2017.[39] We used this number to estimate the number of post-Stage 1 and post-Stage 2 D/DBPR attributable bladder cancer cases. Additional information on perspectives about historical NCI data is provided in the Supplemental Material, “National Cancer Institute Bladder Cancer Data Description.” This estimation was done separately for each stratum and then summed to obtain the national total number of cases attributable to drinking water sources.

Evaluation of Relative Uncertainties Associated with Estimating National Exposures and Potential Bladder Cancer Cases

To evaluate uncertainties associated with the use of THM4 as a surrogate for the suite of chlorination DBPs, we examined the effects of brominated DBPs on the exposure characterizations underlying the ORs. We assessed relative differences in brominated DBPs between surface water and groundwater systems by examining the bromine incorporation factor (BIF), which gives a molar-based estimate of the fraction of brominated species, for large systems using free chlorine (distinguished from those using a chloramine residual in the distribution system), on a PWS-specific basis, relative to THM4. For this evaluation, we used THM4 data from the SYR3 2011 data set and disinfectant type information from the Third Unregulated Contaminant Monitoring Rule (UCMR3).[40] To evaluate uncertainties associated with potential changes in the distribution of DBP mixtures over the past few decades and how this may affect the surrogate value of THM4, we examined metrics informing changes over time in organic content and the formation of brominated DBPs. We used the ratio of haloacetic acid-5 (HAA5) to THM4 (HAA5:THM4) as a surrogate metric to inform changes in natural organic matter (consistent with studies by Liang and Singer[41]), and we used the ratio of THM3 to THM4, which gives a mass-based result (THM3 refers to the three brominated species of THM4), and BIF to inform potential relative changes in the content of brominated DBPs. Changes in natural organic matter and/or brominated DBP could lead to potential changes in the distribution of DBP mixtures. To the extent that there have been increases in bromide levels in the United States, the relative distribution of brominated species—not just THMs but also other DBP classes like HAAs and haloacetonitriles that include brominated compounds—would likely be relatively higher.[30]

Results

A total of 51,034 CWS serving 269.3 million people were stratified based on source water type and population served, along with THM4 concentration ranges used in this evaluation, as shown in Table 1. These represent all CWS in the United States as of 2011 (supporting information for Table 1 is provided in Excel Table S1 of the Supplemental Material). Table 2 shows a national-level population-weighted mean THM4 concentration of for post-Stage 1 and a corresponding post-Stage 2 THM4 concentration of . That table also shows mean THM4 concentration estimated for each of the strata and concentration range bins. Estimate of THM4 mean concentrations among U.S. community water systems in year 2011 post-Stage 1 D/DBPR and any year post-Stage 2 D/DBPR (see Excel Table S2 for underlying data). Note: —, not applicable; D/DBPR, U.S. Environmental Protection Agency Disinfectants and Disinfection Byproducts Rule; THM4, trihalomethane-4. Stage 1 Disinfectants and Disinfection Byproducts Rule. From Stage 2 economic analysis, Exhibit 5.23 with groundwater system reductions adjusted for nondisinfecting systems. Using the fifth and 95th percentile estimates of percent reduction from Stage 1 to Stage 2, the overall range of percent reduction was estimated to be 4.4%–11.2%, resulting in an overall range for the post-Stage 2 THM4 concentration of . Calculation of the post-Stage 2 concentrations is based on two assumptions: a) All Stage 2 reductions will occur in the systems, and therefore the post-Stage 2 concentrations for the systems are the same as the Stage 1 concentrations; and b) For each source and size strata, the post-Stage 2 concentration for all systems is a population-weighted average of the concentrations in the two ranges of interest. The to concentrations can be expressed as . Using the data for the surface water systems serving people as an example to calculate the THM4 post-Stage 2 concentration for the range results in: . Based on post-Stage 1 data, 9,080 of the 79,000 annual bladder cancer cases were potentially attributable to THM4 in drinking water (Table 3) [i.e., an overall PAR value of 11.5% (9,080/79,030)]. Approximately 84% (7,670) of the cases are from surface water systems, and more than half of those (4,610, or 60%) are attributable to DBPs from surface water systems with mean THM4 concentrations in the range. More than half of those cases (2,470) in the higher range of THM4 concentrations are for large systems serving people. The total population estimate in the United States from 2011 includes populations served by both CWS (269.3 million) and private wells (38.6 million). Based on post-Stage 2 data, there would be approximately 8,240 attributable annual new cases of bladder cancer potentially attributable to chlorination DBP among U.S. CWS (Table 3). The post-Stage 2 estimate corresponds to an overall PAR value of 10.4% (8,240/79,030) [supporting information for Tables 2 and 3 is provided in Excel Tables S2 (occurrence and cases for post-Stage 1) and S3 (occurrence and cases for post-Stage 2), respectively].
Table 3

Estimate of bladder cancer cases potentially attributable to chlorination DBPs among U.S. community water systems in year 2011 post-Stage 1 D/DBPR and any year post-Stage 2 D/DBPR (see Excel Table S3 for underlying data).

Source water typeSystem size (population served)ORPARNumber of annual cases attributable to DBPs
40μg/L >4080μg/L 40μg/L >4080μg/L 40μg/L >4080μg/L Total
Surface water systems–post-Stage 1a<10,0001.10091.26310.27%0.80%212635847
10,000–100,0001.10611.25101.37%1.91%1,0801,5102,590
>100,0001.10511.23472.23%3.12%1,7702,4704,230
Subtotal1.10521.24343.79%5.64%3,0604,6107,670
Groundwater systems–post-Stage 1a <10,000 1.02721.27250.24%0.27%186215401
10,000–100,0001.04791.25830.44%0.41%352321673
>100,0001.07281.24070.30%0.11%24885333
Subtotal1.04451.26030.99%0.78%7866211,410
All systems–post-Stage 1aTotal1.08211.24524.68%6.34%3,8505,2409,080
Surface water systems–post-Stage 2b <10,000 1.10091.22730.27%0.70%212549761
10,000–100,0001.10611.20491.37%1.57%1,0801,2402,320
>100,000 1.10521.19332.23%2.59%1,7702,0403,810
Subtotal1.10521.20113.79%4.71%3,0603,8306,890
Groundwater systems–post-Stage 2b <10,000 1.02721.23110.24%0.23%186183369
10,000–100,0001.04791.24580.45%0.39%352306658
>100,000 1.07281.22520.31%0.10%24879327
Subtotal1.04451.23790.99%0.72%7865681,350
All systems–post-Stage 2bTotal1.08211.20514.68%5.36%3,8504,4008,240

Note: Estimates on this table reflect rounding. Example calculation for OR, PAR, and number of cases [shown for post-Stage 1, surface water systems serving people and with a population-weighted THM4 mean of (see Table 2)]: . Fraction of . . (shown in Table 3 as 2,470 due to rounding). DBP, disinfection byproducts; D/DBPR, U.S. Environmental Protection Agency Disinfectants and Disinfection Byproducts Rule; OR, odds ratio; PAR, population attributable risk; THM4, trihalomethane-4; U.S. EPA, U.S. Environmental Protection Agency.

Stage 1 U.S. EPA Disinfectants and Disinfection Byproducts Rule.

Stage 2 U.S. EPA Disinfectants and Disinfection Byproducts Rule.

Estimate of bladder cancer cases potentially attributable to chlorination DBPs among U.S. community water systems in year 2011 post-Stage 1 D/DBPR and any year post-Stage 2 D/DBPR (see Excel Table S3 for underlying data). Note: Estimates on this table reflect rounding. Example calculation for OR, PAR, and number of cases [shown for post-Stage 1, surface water systems serving people and with a population-weighted THM4 mean of (see Table 2)]: . Fraction of . . (shown in Table 3 as 2,470 due to rounding). DBP, disinfection byproducts; D/DBPR, U.S. Environmental Protection Agency Disinfectants and Disinfection Byproducts Rule; OR, odds ratio; PAR, population attributable risk; THM4, trihalomethane-4; U.S. EPA, U.S. Environmental Protection Agency. Stage 1 U.S. EPA Disinfectants and Disinfection Byproducts Rule. Stage 2 U.S. EPA Disinfectants and Disinfection Byproducts Rule. As noted in the “Methods” section, we were able to quantify two sources of uncertainty that potentially affected the post-Stage 2 attributable bladder cancer estimate: a) uncertainty in the percent reduction in THM4 concentrations from post-Stage 1 to post-Stage 2, and b) uncertainty in the dose–response function derived from Villanueva et al.[21] The uncertainty in the percent reductions in THM4 concentrations results in a relatively narrow range of 7,900 to 8,600 cases, whereas the uncertainty in the dose–response function results in a much wider range of 3,060 to 12,400 cases relative to the central estimate of 8,240 annual cases identified above. Note that both are assuming there is a causal relationship between exposure to chlorination DBP in drinking water and bladder cancer and that THM4 can be used as a surrogate for such exposure. The data and equations used to estimate the uncertainty in the percent reductions in THM4 concentrations are provided in Excel Tables S4 and S5, whereas the data and equations used to estimate the uncertainty in the dose–response function are provided in Excel Tables S6 and S7. Figure 3 illustrates the relative consistency between the estimated slope and confidence regions for several of the key studies used to compare ORs to THM4 exposure, including the confidence regions that can be inferred from the Costet et al.[18] meta-analysis for males, the central curve from the Villanueva et al.[21] pooled analysis, and the OR plot from Regli et al.[30] This figure shows much of the confidence region inferred from the most updated meta-analysis[18] falling within the CIs of the dose–response function in Villanueva et al.[21] Each of these studies describes the basis and methodology used to estimate their respective confidence regions. The shaded region of Figure 3 is based on the lower and upper CIs for the four exposure category results from Costet et al.,[18] which presents information only for males, and consists of three adjoining rectangular regions, one for each THM4 exposure range in comparison with the reference level of . The R script used to develop Figure 3 and for the two model parameters based on the lower- and upper-95% CI curves in Villanueva et al.[21] are provided in the Supplemental Material, “R Script of Data and Equations for Figure #3 (R Core Team).”
Figure 3.

Comparison of THM4 and bladder cancer epidemiological dose–response information. The slope shows the odds ratio plot from Regli et al.[30]; also shown is the central, upper, and lower curves from the Villanueva et al.[21] pooled analysis; the shaded region is based on the lower and upper confidence intervals for the four exposure category results (males) from Costet et al.[18] See Supplemental Material, “R Script of Data and Equations,” for Figure 3.

Comparison of THM4 and bladder cancer epidemiological dose–response information. The slope shows the odds ratio plot from Regli et al.[30]; also shown is the central, upper, and lower curves from the Villanueva et al.[21] pooled analysis; the shaded region is based on the lower and upper confidence intervals for the four exposure category results (males) from Costet et al.[18] See Supplemental Material, “R Script of Data and Equations,” for Figure 3. The Costet et al.[18] meta-analysis, which included data from Villanueva et al.[23] and from five of the six studies used by Villanueva et al.[21] provided the largest data set to date for informing the association of THM4 with bladder cancer and included data from both North American and European studies (see the total international meta-analysis from their Table 4 for more details). Their analysis showed statistically significant increasing ORs relative to increasing THM4 concentrations () for males when considering both North American and European populations together. Costet et al. used males for their evaluation as the most reliable data for comparing European vs. North American studies and did so because that was where significance was identified in Villanueva et al.[21] Additionally, males have a much greater bladder cancer incidence rate than females. Costet et al.[18] saw no evidence of a differential exposure–response relation for THM4 and bladder cancer between Europe and North America. Use of data only for males in the shaded regions of Figure 3 (from Costet et al.) translates to results that are slightly higher than the ORs from Regli et al.[30] and the lower curve from Villanueva et al.[21] both of which include information for both males and females. In examining the effects of brominated DBP on the exposure characterizations underlying the ORs, we found an inverse relationship between THM4 concentrations and BIF (Figure 4, where n values are the total number of systems within the groupings; Excel Table S8 includes the underlying data). In contrast, we found a positive relationship between the use of groundwater systems and BIF, indicating a likelihood for a higher proportion of brominated species in the THM4 mixture. We saw a statistically significant () difference between BIFs for surface water and groundwater systems.
Figure 4.

Bromine Incorporation Factor (BIF) vs. THM4 for 903 free chlorine systems serving people stratified by water source. BIF was calculated for each annual system-level average THM4 sample based on the molar concentration and number of bromine atoms for each THM specie. Systems were grouped in increments based on system average THM4 concentrations. For each group, standard error was estimated as the standard deviation divided by the square root. See Excel Table S8 for underlying data. Note: THM4, trihalomethane-4.

Bromine Incorporation Factor (BIF) vs. THM4 for 903 free chlorine systems serving people stratified by water source. BIF was calculated for each annual system-level average THM4 sample based on the molar concentration and number of bromine atoms for each THM specie. Systems were grouped in increments based on system average THM4 concentrations. For each group, standard error was estimated as the standard deviation divided by the square root. See Excel Table S8 for underlying data. Note: THM4, trihalomethane-4. For the brominated DBP parameters (the ratio of THM3 to THM4 and BIF), we found, in general, minimal temporal differences from 1998 to 2011. Based on the cumulative distributions for common systems of the ratio of THM3 to THM4 in 1998 vs. 2011 (Figure 5; Excel Table S9 includes the underlying data), we saw no differences in mean values () or variances () that were compared. A similar evaluation of BIF for common systems in 1998 vs. 2011 showed no differences in means () or variances ().
Figure 5.

Cumulative distribution for the mass-based ratio of THM3 (i.e., brominated THMs) to THM4 for common systems between 1998 and 2011 data sets (). Researchers calculated mass-based ratio for each system from the 1997–1998 Information Collection Rule data set that provided both THM3 and THM4 concentrations and compared to matching ratio from 2011 Six-Year Review 3 data set. Statistical testing performed using R (version 4.1.2; R Development Core Team) for the hypothesis that the means and variances were not different. See Excel Table S9 for underlying data. Note: THM3, three brominated species of THM4; THM4, trihalomethane-4.

Cumulative distribution for the mass-based ratio of THM3 (i.e., brominated THMs) to THM4 for common systems between 1998 and 2011 data sets (). Researchers calculated mass-based ratio for each system from the 1997–1998 Information Collection Rule data set that provided both THM3 and THM4 concentrations and compared to matching ratio from 2011 Six-Year Review 3 data set. Statistical testing performed using R (version 4.1.2; R Development Core Team) for the hypothesis that the means and variances were not different. See Excel Table S9 for underlying data. Note: THM3, three brominated species of THM4; THM4, trihalomethane-4. For the parameter used to inform qualitative changes in natural organic matter (HAA5:THM4), we saw a slight decrease in the ratio, potentially related to changes in system operation or source waters following the Stage 1 D/DBPR (Figure 6; Excel Table S10 includes the underlying data) [means are significantly different (); variances are significantly different ()]. This was also evaluated for PWS with THM4 concentrations greater than in 1998 and 2011; testing about the means showed results comparable to those described for Figures 5 and 6.
Figure 6.

Cumulative distribution for the ratio of HAA5 to THM4 for common systems between 1998 and 2011 data sets (). Researchers calculated mass-based ratio for each system from the 1997–1998 Information Collection Rule data set that provided both HAA5 and THM4 concentrations and compared to matching ratio from 2011 Six-Year Review 3 data set. Statistical testing performed using R (version 4.1.2; R Development Core Team) for the hypothesis that the means and variances were not different. See Excel Table S10 for underlying data. Note: HAA5, haloacetic acid-5; THM4, trihalomethane-4.

Cumulative distribution for the ratio of HAA5 to THM4 for common systems between 1998 and 2011 data sets (). Researchers calculated mass-based ratio for each system from the 1997–1998 Information Collection Rule data set that provided both HAA5 and THM4 concentrations and compared to matching ratio from 2011 Six-Year Review 3 data set. Statistical testing performed using R (version 4.1.2; R Development Core Team) for the hypothesis that the means and variances were not different. See Excel Table S10 for underlying data. Note: HAA5, haloacetic acid-5; THM4, trihalomethane-4.

Discussion

We estimated the bladder cancer PAR of 10.4% based on the most current data and information (post-Stage 2); as expected, this is lower than estimates based on earlier periods such as post-Stage 1 () and pre-Stage 1 (). This current estimate advances earlier efforts because it is based on the most comprehensive and representative THM4 data set from 2011 capturing 42 of 50 states/tribes in the United States. A strength of the SYR3 data relied on here is that it contained THM4 data representing 269.4 million people served by CWS. Another sensitivity analysis addressed the representatives of the most complete year (2011) of monitoring data used for the PAR and showed limited variation across other years from the SYR3. Last, a comparison of our post-Stage 2 occurrence estimates showed that they were generally consistent with the information in Seidel et al.[42] for systems serving more than 100,000 people (additional information is provided in the Supplemental Material, “Literature Information about Post-Stage 2 THM4 Concentration Estimates”), and, more broadly, with the post-Stage 2 occurrence estimates in Evans et al.[43] Our analyses were based on various assumptions that may lead to some uncertainty in our PAR estimates. Some factors that may change over time can impact overall exposure estimates that are not addressable in our analysis but may not be completely characterized and integrated in the underlying epidemiological studies; for example, residential mobility (people may move during their lifetime to locations with different exposure levels), use of household interventions such as in-home filters, and variable exposure route-related activities (e.g., exposure from swimming) are factors that may change over time. In addition, our estimates for both post-Stage 1 and post-Stage 2 conditions assume full compliance with the Stage 1 and Stage 2 D/DBPRs as well as constant THM4 levels over time. They are based on estimated lifetime exposure to THM4 (and co-occurring DBP) for each of the six strata. These assumptions do not take into consideration the gradual attenuation of risk from lower levels of THM4 resulting from compliance with the Stage 1 and Stage 2 D/DBPRs (i.e., cessation lag). By not accounting for cessation lag and assuming full compliance with the DBP rules, we are underestimating the potential risks due to both current and historical DBP concentrations. We used this approach to enable comparisons with previous occurrence estimates and the associated remaining post-Stage 1 and post-Stage 2 risks that were made in the Stage 2 economic analysis. As discussed there, we also recognize, given the anticipated cessation lag, that the reduction in the number of bladder cancer cases from pre-Stage 1 to post-Stage 1 and to post-Stage 2 would take many years to be fully realized if this relationship is causal.[29] One novel aspect of our current analysis was the ability to estimate stratum-specific estimates of PAR across water source type and system size. The relatively large percentage of cases from surface water systems with mean THM4 concentrations in the range is noteworthy, given that the population served by those PWS is 34% lower than the population served by surface water PWS in the range (75.7 million vs. 115.4 million people). The reductions from post-Stage 1 to post-Stage 2 in THM4 concentrations in those systems within the range is consistent with the trends we expect in that period, given the emphasis in the Stage 2 D/DBPR of seeking to reduce concentrations at locations with the higher post-Stage 1 occurrence levels. One limitation of the stratified analysis was the assumption that all PWSs reduced the average THM4 concentrations to because our approach collapsed all PWS into between and . We anticipate this source of uncertainty to result in a slight underestimation of the potential risks.

Use of THM4 as a Surrogate

Although there is some uncertainty as to whether THM4 is the most toxicologically relevant surrogate to gauge risks presented by the broad suite of chlorination DBPs in drinking water,[44-48] many existing studies use it as a surrogate measure for chlorination DBPs.[18,19,21] However, other than recognizing that in general, as THM4 increases many other classes of chlorination DBPs also increase, relationships between THM4 and DBP classes can vary widely depending on conditions for specific water systems as shown by other studies.[41,44,49] Many factors such as source water characteristics that impact DBP formation [e.g., organic matter, typically considered as total organic carbon (TOC), and inorganic matter, most significantly bromide] may result in lack of comparability of DBP mixtures across distribution systems being examined by THM4 levels in epidemiological studies. For example, Richardson and Plewa[50] and Li and Mitch[45] have raised concerns about potential changes in the composition or distribution of different classes of DBP in DBP mixtures over the past few decades, such as with effluent organic matter,[51] and algal matter in some PWS. Changes in the DBP mixtures from pre-Stage 1 to our current understanding may have been affected by a variety of factors—for example, increases in source water concentrations of bromide[52-55] or changes to the composition of organic matter caused by harmful algal blooms.[56,57] Some PWS have also changed treatment practices by shifting the point of chlorination, removing more precursors before the addition of chlorine, and/or using chloramination before entering the distribution systems, all of which can change the composition of the mixture.[5,58] Nonetheless, of all the known DBP, THM4 is considered to be the predominant chlorination DBP on a mass basis in drinking water. The OR vs. THM4 dose–response relationship shown in Figure 3 may be influenced, in part, by the extent to which the proportion of brominated THMs vary as a function of THM4 concentration and type of source water. Brominated DBP are generally considered to have greater toxicity than their chlorinated analogs.[6] Our observation about BIF decreasing with higher concentrations of THM4 (Figure 4) is relevant when considering the data used to calculate ORs from low or unexposed reference groups (for example, those with THM4 levels below in Costet et al.[18]). If brominated species pose greater risk than nonbrominated species and if BIFs are higher in the low exposure referent concentration category, it would be more difficult to discern and interpret differences in risk due to increasing THM4 concentrations. Unrecognized health effects in the low or unexposed reference groups of THM4 levels would bias the derived ORs and attenuate some of the THM4 risk among groups with higher THM4 levels (for example, exposure ranges represented by the shaded rectangles of Figure 3). These data also suggest that the estimates for the populations served by systems having lower THM4 concentrations (i.e., ) may have higher bladder cancer risks on a per-microgram/liter basis than indicated in Table 3. Although we understand the likely direction of this bias (to underestimate the risk of THM4 and associated DBP exposure), gauging its magnitude is appropriate for future research once additional data are available. Regarding changes in the composition of DBP mixtures in time, our observations about relatively little difference in the content of brominated DBPs from the 1998 to 2011 time periods (Figure 5) indicates a lack of bias in the OR vs. THM4 dose–response relationship. However, for changes in natural organic matter, our observation about a slight decrease over time in the ratio of HAA5:THM4 (Figure 6) implies that there may be differences in the nature of natural organic matter over this time period, and those differences may be associated with a different distribution of the mixture of chlorination DBPs. Overall, there is insufficient information at this time to determine whether these findings would lead to any bias (either up or down) of the bladder cancer risks for the U.S. population based on potential changes in the distribution of DBP mixtures over the past few decades. One feature not considered in our study is the relative impact on nitrogenous DBPs (e.g., nitrosamines) as a function of the increasing numbers of systems using chloramination. Several of the nitrosamine compounds [e.g., N-nitrosodimethylamine (NDMA), which is the nitrosamine with the highest observed occurrence in U.S. drinking waters] are recognized human carcinogens, and they have increased occurrence in systems using chloramination, especially those with wastewater impacts on their source waters.[59,60] NDMA has generally been associated with liver, lung, and gastrointestinal cancers but not with bladder cancer, and it was thus not considered further in this study about bladder cancer.

Weight of Evidence

Regli et al. provided a rationale for why the weight of evidence supporting causality has increased since the promulgation of the Stage 2 D/DBPR.[30] Their reasons include an increased understanding of the role of genetically susceptible populations due to specific polymorphisms for THMs and HAAs, and exposure routes for THMs (oral, inhalation, and dermal) that impact risk. For example, they discussed the genotoxicity and mutagenicity of specific DBPs as well as the proportion of the susceptible U.S. population based on specific genotypes. Cantor et al. suggested that the GST theta 1 [GSTT1 ] genotype (found in approximately 80% of the population) could increase susceptibility to brominated THM-induced cancer, due to a greater generation of mutagenic intermediates.[17] More recent information has further strengthened the overall weight of evidence supporting causality.[61,62] Kenyon et al.[61] developed a human physiologically based model to evaluate the impact of DBP exposure on internal dose which showed the relatively large contributions of dermal and inhalation exposure routes to the internal dose reaching the systemic circulation. Pegram et al.[62] provided the first demonstration of brominated THM-induced genotoxicity in human urothelial cells supporting the hypothesis (Pegram et al.[63]) that increased bladder cancer risk from brominated THMs depends on the GSTT1 genotype. Freeman et al. reported that they found suggestive evidence for a multiplicative interaction between THM4 exposure and genotypes of rs907611 in two case–control studies in Spain and New England.[64] We recognize the continued importance of research to develop new information to further inform the question of causality between bladder cancer and exposure to any individual DBP or combinations of DBP.

Conclusion

Our results provide updated estimates of national THM4 exposures and the number of potential attributable annual bladder cancer cases in the United States among specific water system strata and concentration range bins. Our PAR results were developed using data sources relevant to occurrence from public drinking water systems and help to inform an understanding of both post-Stage 1 and post-Stage 2 conditions. Our results have risk management implications as they show the relatively larger number of attributable cases are for people who are served by large surface water systems ( of the cases associated with chlorination DBP, but of the population) than smaller surface water systems or groundwater systems. Despite the increased weight of evidence established in recent years toward inferring a causal relationship between DBP exposure and bladder cancer, more work is needed to understand the possible mechanisms involved in that relationship, clarify different sources of uncertainty, and address the utility of THM4 as a surrogate measure of risk from the most relevant DBP mixtures of toxicological interest. Click here for additional data file. Click here for additional data file. Click here for additional data file.
  34 in total

Review 1.  CHO cell cytotoxicity and genotoxicity analyses of disinfection by-products: An updated review.

Authors:  Elizabeth D Wagner; Michael J Plewa
Journal:  J Environ Sci (China)       Date:  2017-05-04       Impact factor: 5.565

2.  TIC-Tox: A preliminary discussion on identifying the forcing agents of DBP-mediated toxicity of disinfected water.

Authors:  Michael J Plewa; Elizabeth D Wagner; Susan D Richardson
Journal:  J Environ Sci (China)       Date:  2017-05-04       Impact factor: 5.565

3.  Unregulated disinfection By-products in drinking water in Quebec: A meta analysis.

Authors:  Gyan Chhipi-Shrestha; Manuel Rodriguez; Rehan Sadiq
Journal:  J Environ Manage       Date:  2018-07-14       Impact factor: 6.789

4.  Disinfection by-products in drinking water and colorectal cancer: a meta-analysis.

Authors:  Md Bayzidur Rahman; Tim Driscoll; Christine Cowie; Bruce K Armstrong
Journal:  Int J Epidemiol       Date:  2010-02-05       Impact factor: 7.196

5.  Bladder cancer and exposure to water disinfection by-products through ingestion, bathing, showering, and swimming in pools.

Authors:  Cristina M Villanueva; Kenneth P Cantor; Joan O Grimalt; Nuria Malats; Debra Silverman; Adonina Tardon; Reina Garcia-Closas; Consol Serra; Alfredo Carrato; Gemma Castaño-Vinyals; Ricard Marcos; Nathaniel Rothman; Francisco X Real; Mustafa Dosemeci; Manolis Kogevinas
Journal:  Am J Epidemiol       Date:  2006-11-01       Impact factor: 4.897

Review 6.  Occurrence, genotoxicity, and carcinogenicity of regulated and emerging disinfection by-products in drinking water: a review and roadmap for research.

Authors:  Susan D Richardson; Michael J Plewa; Elizabeth D Wagner; Rita Schoeny; David M Demarini
Journal:  Mutat Res       Date:  2007-09-12       Impact factor: 2.433

7.  Factors influencing the formation and relative distribution of haloacetic acids and trihalomethanes in drinking water.

Authors:  Lin Liang; Philip C Singer
Journal:  Environ Sci Technol       Date:  2003-07-01       Impact factor: 9.028

8.  Disinfection byproducts and bladder cancer: a pooled analysis.

Authors:  Cristina M Villanueva; Kenneth P Cantor; Sylvaine Cordier; Jouni J K Jaakkola; Will D King; Charles F Lynch; Stefano Porru; Manolis Kogevinas
Journal:  Epidemiology       Date:  2004-05       Impact factor: 4.822

9.  Analysis of Cumulative Cancer Risk Associated with Disinfection Byproducts in United States Drinking Water.

Authors:  Sydney Evans; Chris Campbell; Olga V Naidenko
Journal:  Int J Environ Res Public Health       Date:  2020-03-24       Impact factor: 3.390

Review 10.  Epidemiology of Bladder Cancer.

Authors:  Kalyan Saginala; Adam Barsouk; John Sukumar Aluru; Prashanth Rawla; Sandeep Anand Padala; Alexander Barsouk
Journal:  Med Sci (Basel)       Date:  2020-03-13
View more
  1 in total

1.  Pomegranate (Punica granatum L.) Peel Extracts as Antimicrobial and Antioxidant Additives Used in Alfalfa Sprouts.

Authors:  Manuel Reynaldo Cruz-Valenzuela; Rosa E Ayala-Soto; Jesus Fernando Ayala-Zavala; Brenda A Espinoza-Silva; Gustavo A González-Aguilar; Olga Martín-Belloso; Robert Soliva-Fortuny; Filomena Nazzaro; Florinda Fratianni; Melvin R Tapia-Rodríguez; Ariadna Thalia Bernal-Mercado
Journal:  Foods       Date:  2022-08-26
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.