Literature DB >> 26914314

Evolution of risk assessment strategies for food and feed uses of stacked GM events.

Catherine Kramer1, Phil Brune1, Justin McDonald1, Monique Nesbitt1, Alaina Sauve1, Sabine Storck-Weyhermueller2.   

Abstract

Data requirements are not harmonized globally for the regulation of food and feed derived from stacked genetically modified (GM) events, produced by combining individual GM events through conventional breeding. The data required by some regulatory agencies have increased despite the absence of substantiated adverse effects to animals or humans from the consumption of GM crops. Data from studies conducted over a 15-year period for several stacked GM event maize (Zea mays L.) products (Bt11 ×  GA21, Bt11 ×  MIR604, MIR604 ×  GA21, Bt11 ×  MIR604 ×  GA21, Bt11 ×  MIR162 ×  GA21 and Bt11 ×  MIR604 ×  MIR162 ×  GA21), together with their component single events, are presented. These data provide evidence that no substantial changes in composition, protein expression or insert stability have occurred after combining the single events through conventional breeding. An alternative food and feed risk assessment strategy for stacked GM events is suggested based on a problem formulation approach that utilizes (i) the outcome of the single event risk assessments, and (ii) the potential for interactions in the stack, based on an understanding of the mode of action of the transgenes and their products.
© 2016 The Authors. Plant Biotechnology Journal published by Society for Experimental Biology and The Association of Applied Biologists and John Wiley & Sons Ltd.

Entities:  

Keywords:  biotechnology; genetically modified; problem formulation; risk assessment; stacks

Mesh:

Year:  2016        PMID: 26914314      PMCID: PMC5071656          DOI: 10.1111/pbi.12551

Source DB:  PubMed          Journal:  Plant Biotechnol J        ISSN: 1467-7644            Impact factor:   9.803


Introduction

Genetically modified (GM) crops have been widely adopted since commercial release more than 20 years ago, with a steady growth each year in biotech hectarage planted globally (James, 2014). The benefits of GM crops were recently documented by Klumper and Qaim (2014) and include an overall increase in yield of almost 22%, a 36.9% reduction in pesticide use and an increase in farmer profit slightly over 68%. GM crops are increasingly being exploited globally, benefiting 18 million farmers in 28 countries in 2014 (James, 2014).

What is a GM stack?

Crop productivity has undergone continuous improvement by conventional plant breeding since crop plants were originally domesticated for agricultural purposes. For example, over 100 genes conferring beneficial traits from wild relatives have been incorporated into the genomes of 19 of the world's major crops by conventional breeding, creating new varieties with disease resistance, abiotic stress resistance and improved quality (Hajjar and Hodgkin, 2007). Conventional breeding techniques can also be used to combine traits from two or more GM events. A GM event is defined as the insertion of DNA into the plant genome as a result of a single transformation process (Pilacinski et al., 2011). Individual events may contain one or more transgenes, and these events are sometimes referred to as molecular stacks (Que et al., 2010). Alternatively, using conventional breeding to combine GM events does not involve insertion of new recombinant DNA sequence into the genome and does not modify the existing genomic DNA, so stacked GM events are, by definition, not a new event (Pilacinski et al., 2011). The data presented in this study include analysis of stacked GM events created by conventional breeding of single events developed by Syngenta and will be referred to as stacked GM events or stacks.

Why are stacked events important?

The ability to offer multiple benefits in a single product have resulted in many GM events being combined by conventional breeding techniques, offering combinations of insect resistance and herbicide tolerance genes. These types of stacks are also referred to as ‘pyramids’, characterized by multiple traits that confer resistance to a specific pest or pest complex. For example, Syngenta's Agrisure Viptera® 3111 stack provides control of 14 insect pests and tolerance to both glyphosate and glufosinate herbicides.1 GM events combining different modes of action for protection against specific insect(s) pests are a valuable strategy for management of insect resistance.

How are single GM events assessed for risk?

The principles underpinning risk assessments of GM events have been well described by the Food and Agricultural Organization/World Health Organization (FAO/WHO 1996, 2000), the Organization for Economic Cooperation and Development (OECD 2010), the Codex Alimentarius (2003, 2009) and by national regulatory agencies (EC 2013, EFSA 2011a, EPA 2014, FDA 1992, Health Canada 2006). Most commercial GM crops express transgenes, which encode proteins that confer the desired traits, for example pest control or herbicide tolerance. Many of these transgenes are derived from other plants or microorganisms ubiquitous and/or abundant in the environment and food and feed chain. Regardless of the nature and origin of the transgenes, newly developed GM events undergo comprehensive safety assessments prior to commercial release. The history of safe use of the conventional crop, which has been consumed for decades, can be used as a baseline for the safety assessment of new GM plant varieties (Kok and Kuiper, 2003). Data generated for a risk assessment of a new GM single event intended for food and feed typically includes (i) molecular characterization of the genetic insertion, (ii) bioinformatic assessment of the inserted sequences for similarity to known allergens or toxins, (iii) protein toxicity studies, (iv) analysis of the physicochemical properties of the introduced proteins as they pertain to stability and activity, (v) quantitation of the proteins expressed by the transgenes in planta, (vi) nutritional equivalence assessed by compositional analysis and animal feeding studies, and (vii) an estimation of human dietary exposure. Although individual regulatory agencies may have different specific requirements, these data meet the requirements of most global regulatory agencies in regions that import food and feed commodities. The molecular characterization of a GM event includes verifying the sequence of the inserted DNA and the host genome flanking sequences and confirmation of the copy number of the inserted sequences. Correct position of the promoter and terminator sequences with respect to the coding sequence(s) confirms that only the intended transcripts(s) and protein(s) are encoded by the transgene(s). The flanking sequence is used to assess the possible disruption of endogenous genes in the host plant and the potential generation of new open reading frames. Proteins are an essential component of both human and animal diets, and most are safe to consume. But all known food allergens are proteins and there are also rare examples of proteins that are toxic to animals, including humans. The potential for proteins expressed by the transgenes to be allergenic or toxic is assessed using comparative bioinformatic data to identify similarities in sequence to known allergens or toxins and by characterization of physicochemical properties consistent with proteinaceous allergens and toxins. Protein expression studies are conducted to generate a profile of transgenic protein expression across the life cycle of the crop produced under field conditions. These data can be used to estimate potential human and livestock exposure to the transgenic protein present in food and feed products and for determining appropriate dose levels for protein toxicity studies. Protein toxicity studies often use rats or mice to evaluate the effects of direct exposure to transgenic proteins administered via gavage, based on the recommended limit dose (OECD 2001) or the theoretical exposure level (OECD 2008). The major objective of compositional equivalence evaluations of new GM crop varieties is to assess whether the new GM event is comparable in nutrient and antinutrient content to the conventional crop that already has an established history of safe consumption. In addition to compositional equivalence studies, some regulatory agencies require animal feeding studies with diets prepared from the raw agricultural commodity originating from the GM crop to further assess nutritional value and wholesomeness.

How are stacked events assessed for safety?

When a GM stack is created by conventional breeding, the inserted DNA from each individual event is transferred from parent to progeny similarly to that for endogenous genes. There is no additional recombinant DNA sequences introduced when stacking GM events by conventional breeding. For the purposes of this discussion on food and feed risk assessment of GM stacks, it is assumed that the single events that comprise the stack have been individually and comprehensively evaluated for food and feed safety, as described above, and that the novel proteins expressed in the GM stack have been shown to pose negligible risk to human and animal health. Currently, there is no global consensus for the regulation of previously approved GM events combined by conventional breeding (Pilacinski et al., 2011). Consequently, some regulatory agencies require no additional safety data, while others require a repeat of studies already conducted for the safety assessments of the individual events. Still others have chosen to regulate only the GM stacks, which are inclusive of the greatest number of events in the stacks under consideration (‘higher‐order stacks’, Pilacinski et al., 2011; Ramjoue, 2008). Countries that have adopted policies whereby approval of a higher‐order stack may cover lower‐order stacks containing the same events include Argentina, Paraguay, Uruguay, Philippines, the European Union and Brazil (e.g. EC 2013, EFSA 2011a, Philippines 2013). For countries that require additional data for food and feed approval of stacked GM events, these requirements may include confirmation of copy number and intactness of the inserted sequence contributed by each of the single events, verification that expression of the introduced genes is consistent with that of the single events, and nutritional equivalence studies. Recently, a new requirement to confirm transgenic insert stability by resequencing of the individual single events in stacked GM events has been implemented for import approval in EU member countries (EC 2013). Compositional equivalence, protein expression and molecular characterization (insert stability and intactness) data generated for food and feed safety assessments of stacked GM events and the component single events are described for stacks containing two, three and four Syngenta events in six stacked event combinations (Bt11 × GA21, Bt11 × MIR604, MIR604 × GA21, Bt11 × MIR604 × GA21, Bt11 × MIR162 × GA21 and Bt11 × MIR604 × MIR162 × GA21). Data from individual studies were compiled to create a compendium representing the range of variation in composition and expression of single events and stacks across many years of agricultural production in different environments and in different germplasm. As expected, both environment and germplasm had an impact on composition and expression, but there were no indications that stacking the events had either an additive or synergestic effect. These data, together with molecular studies demonstrating insert stability, provide compelling evidence that when there is no likely interaction between the single event, extrapolation of single event risk assessment data to the stacked GM events is warranted. An understanding of the modes of action of the individual transgenes, the products they produce and the transgenic protein expression profile can be used with a problem formulation approach to identify potential interactions between the transgenes and transgene products contained in the combined events, on a case‐by‐case basis. When there is a likelihood of interaction, additional studies can be designed to address anticipated interaction(s) and to either confirm or update the existing safety assessments.

Results

Compositional analysis

For each nutritional component, the mean levels for the single events and the stacks were very similar (Table 1). The compositional analysis data for Bt11 was limited, so no comparison with that single event was possible for many of the analytes measured in the stacks. The range of values for each of the six stacked event hybrids were compared to the compiled prediction intervals derived from data of each of the corresponding single events contained in each stack. For example, the range of protein levels in the Bt11 × MIR162 × GA21 stack (10.0–12.7% dry weight) was compared to the range of the prediction intervals for Bt11, MIR162 and GA21 (6.87%–13.5%). Most values of the stacks were within the collective prediction interval ranges for the corresponding singles. When a low or high value for a stack was not within the prediction intervals for the singles, it was often due to only one or a few of the stack values falling outside of the prediction intervals.
Table 1

Levels of nutritional and antinutritional components in grain from single event and stacked event maize

Event or stackBt11GA21MIR604MIR162Bt11 MIR162 MIR604 GA21Bt11 MIR162 GA21Bt11 MIR604 GA21Bt11 MIR604Bt11 GA21MIR604 GA21
N =21a 53b 5234c 181836d 18e 3618f
Protein (%)
Mean8.5910.810.89.8510.710.910.39.8810.511.1
SD0.80551.3361.1110.86630.80520.74921.2790.83261.4460.9609
Min7.306.77.967.509.4010.07.397.507.789.3
Max10.613.713.311.212.512.713.310.813.012.5
Prediction interval6.87–10.38.06–13.58.50–13.08.06–11.6
Fat (%)
Mean3.24.03.93.74.54.24.33.84.44.6
SD0.4330.5400.4200.3400.3040.4230.4360.3350.5380.422
Min2.52.92.93.34.03.23.33.33.23.9
Max4.14.94.74.6 5.2 5.05.14.3 5.4 5.3
Prediction interval2.3–4.12.9–5.13.1–4.83.0–4.4
Carbohydrates (%)
Mean83.883.884.983.383.483.984.983.582.6
SD1.5761.2600.95640.97750.91921.4770.96941.6731.113
Min81.080.583.281.280.780.783.780.981.0
Max87.886.687.185.384.386.8 87.0 86.384.8
Prediction interval80.6–87.081.2–86.483.0–86.9
Acid detergent fibre (%)
Mean3.74.64.43.63.53.64.85.05.8
SD0.5771.161.020.4930.6310.3720.9101.440.756
Min2.62.73.22.72.7 2.4 3.23.34.9
Max5.47.77.04.55.54.46.1 8.4 7.5
Prediction interval2.6–4.92.3–7.02.3–6.5
Neutral detergent fibre (%)
Mean11.012.011.79.7011.210.211.511.413.0
SD1.7611.8611.1480.97732.0611.0430.77100.95031.189
Min7.509.3810.07.708.80 7.20 9.909.6210.9
Max14.415.515.111.9 18.1 12.713.213.415.5
Prediction interval7.47–14.68.19–15.79.34–14.1
Starch (%)
Mean72.761.360.966.362.066.367.865.066.059.6
SD0.95325.1477.2754.3026.2246.1864.9192.0895.3552.906
Min70.846.851.454.848.058.553.861.555.355.1
Max74.371.273.473.169.5 78.4 75.669.2 74.9 64.7
Prediction interval70.6–74.750.9–71.846.1–75.657.4–75.2
Calcium (ppm)
Mean51.147.946.447.744.450.139.754.045.2
SD8.24812.1512.999.3584.2788.7384.46710.004.090
Min37.330.529.434.438.738.731.739.237.5
Max74.485.493.7 76.2 56.671.948.0 85.2 49.8
Prediction interval34.4–67.923.2–72.519.5–73.2
Copper (ppm)
Mean1.311.761.711.411.581.481.271.591.29
SD0.16720.56280.47600.18130.10630.36160.39690.24360.09364
Min0.9801.000.9601.011.401.050.9501.211.17
Max1.814.302.901.721.802.652.70 2.20 1.45
Prediction interval0.971–1.650.623–2.900.732–2.70
Iron (ppm)
Mean22.426.321.622.128.322.320.422.623.1
SD4.1494.7582.9261.7081.7393.5681.9713.9042.440
Min15.717.417.318.624.315.517.516.318.9
Max42.344.533.425.5 32.2 36.8 24.0 38.0 27.2
Prediction interval14.0–30.816.6–35.915.5–27.6
Magnesium (ppm)
Mean123312201290128313231232125213511503
SD117.97125.00102.6294.98096.881126.60117.39195.7585.392
Min896919109010601150 966 108010301380
Max1510148015301420 1540 1520 1490 1790 1660
Prediction interval994–1472967–14731078–1502
Manganese (ppm)
Mean6.685.636.386.306.615.646.206.557.40
SD1.0481.0021.9720.94410.83530.98271.0931.6071.413
Min3.863.354.144.695.023.814.39 4.48 4.98
Max8.877.9316.28.228.137.57 8.53 9.88 9.62
Prediction interval4.56–8.813.60–7.662.31–10.5
Phosphorus (ppm)
Mean329530923034345935433116312733833993
SD405.24501.26261.05318.63256.49523.95185.88741.71269.09
Min21801660243026102940 1740 2790 1880 3560
Max4170371035503850400039803470 4760 4400
Prediction interval2474–41152076–41082496–3573
Potassium (ppm)
Mean374338793694398839943967337341824399
SD380.36360.00474.25215.39236.47305.74162.62340.87149.96
Min292030603160357035703350 3010 36504120
Max47204650493043404400 4670 3610 5020 4650
Prediction interval2973–45143150–46092715–4672
Selenium (ppm)
Mean0.1780.1880.2920.2060.1450.1750.2160.2060.271
SD0.090440.081530.18620.12480.10290.11570.13670.15090.1857
Min<LOQ<LOQ<LOQ0.0718<LOQ<LOQ0.0569<LOQ<LOQ
Max0.3370.3600.6550.4920.399 0.501 0.444 0.625 0.607
Predictioninterval<LOQ–0.368<LOQ–0.363<LOQ–0.683
Zinc (ppm)
Mean24.123.220.925.125.622.321.522.322.1
SD3.1633.7022.3543.0843.5983.8681.8993.1501.708
Min17.916.915.920.319.916.118.2 17.2 19.1
Max31.031.224.4 31.8 32.9 29.725.428.525.4
Predictioninterval17.7–30.515.7–30.716.0–25.8
β–Carotene (mg/100 g)
Mean0.1120.1230.2170.09500.1130.09920.3440.1700.222
SD0.040160.023620.070100.017920.011640.018820.025760.065400.01144
Min0.05760.08410.1200.07100.09120.06130.3110.06920.201
Max0.2080.1950.3160.1230.1400.130 0.409 0.257 0.241
Prediction interval0.0307–0.1930.0723–0.3620.0755–0.171
Thiamine HCl (mg/100 g)
Mean0.380.450.420.430.460.430.410.420.42
SD0.06430.05530.03880.03550.03540.03060.02550.03200.0321
Min0.240.370.350.340.400.370.360.350.35
Max0.480.590.490.490.530.490.470.480.48
Prediction interval0.251–0.5110.337–0.4970.342–0.566
Riboflavin (mg/100 g)
Mean0.1930.1570.1830.2250.2030.2290.1640.2150.223
SD0.033310.034300.035710.036290.037840.037930.029420.048880.04291
Min0.1370.1110.1120.1680.1570.1620.111 0.107 0.144
Max0.3390.2450.257 0.292 0.307 0.365 0.228 0.330 0.291
Prediction interval0.126–0.2610.109–0.2560.0875–0.227
Niacin (mg/100 g)
Mean2.652.812.542.252.862.642.283.193.29
SD0.76510.40870.28960.33580.36040.52900.16610.41570.6157
Min1.552.182.111.452.131.582.022.232.53
Max4.253.793.312.853.453.672.743.99 4.54
Prediction interval1.10–4.201.94–3.141.98–3.64
Pyridoxine HCl (mg/100 g)
Mean0.6820.4320.5290.6230.6490.6790.5220.7180.692
SD0.092750.25570.077690.068520.081770.10390.059420.098090.05853
Min0.5080.2180.3850.4800.5540.5030.4360.5180.586
Max0.9521.110.6940.7180.831 0.927 0.636 0.902 0.848
Prediction interval0.494–0.8700.369–0.690<LOQ–0.950
Folic acid (mg/100 g)
Mean0.02770.04840.03430.02880.02970.03280.02580.04000.0455
SD0.0046760.015490.010560.007150.0095040.008720.0061840.015480.01975
Min0.01780.02320.02100.02090.02090.02060.01790.02170.0273
Max0.04030.08130.06240.04370.0525 0.0626 0.0456 0.0797 0.0821
Prediction interval0.0182–0.03720.0125–0.05610.0170–0.0798
α–Tocopherol (mg/100 g)
Mean0.8000.9931.020.8140.8011.191.271.261.03
SD0.19460.25360.28090.14710.17910.47410.13390.33600.1499
Min0.436<LOQ0.619<LOQ0.504<LOQ1.060.8500.838
Max1.271.861.541.071.11 2.18 1.59 2.06 1.32
Prediction interval0.406–1.19<LOQ–1.600.472–1.51
16:0 Palmitic (% of total)
Mean11.613.214.014.014.014.014.312.515.015.4
SD0.91100.7260.89471.4030.41330.25780.63630.31230.52310.3634
Min10.911.212.512.212.913.613.011.913.615.0
Max13.514.515.916.614.514.715.512.9 15.7 16.1
Prediction interval9.39–13.811.8–14.711.1–16.912.2–15.8
18:0 Stearic (% of total)
Mean2.322.362.081.751.711.682.031.932.162.19
SD0.23280.22480.27640.15070.12190.099120.40060.16710.25260.07253
Min2.021.891.721.44 1.47 1.471.511.681.782.08
Max2.702.902.771.991.881.82 3.20 2.262.792.30
Prediction interval1.75–2.891.91–2.821.44–2.061.52–2.64
Oleic (% of total)
Mean27.225.425.723.826.025.828.425.427.424.7
SD1.2772.5952.5022.1511.9722.1082.4870.99342.1630.4615
Min26.321.121.619.222.321.522.923.625.223.3
Max30.329.130.626.628.928.8 33.2 26.5 32.3 25.3
Prediction interval24.1–30.320.2–30.719.4–28.320.6–30.8
18:2 Linoleic (% of total)
Mean57.756.456.357.655.855.952.657.352.755.0
SD1.7592.9283.6331.2262.0512.0413.1550.91542.4220.5780
Min53.252.148.855.952.552.6 46.4 56.3 46.5 54.1
Max59.162.960.759.759.459.758.459.355.956.5
Prediction interval53.4–62.050.4–62.355.1–60.148.9–63.6
18:3 Linolenic (% of total)
Mean1.321.581.621.871.591.671.701.711.701.64
SD0.28050.085450.12970.13230.12890.12730.11600.050980.080480.06526
Min0.9141.311.421.661.461.541.541.641.581.53
Max1.691.791.872.261.95 2.06 2.061.821.851.76
Prediction interval0.635–2.001.41–1.751.59–2.141.35–1.88
Ferulic acid (ppm)
Mean199319372663184618662005233621772285
SD242.38252.44157.72160.78169.91259.01155.95229.02148.53
Min131013402380156015601530 2010 15401990
Max2440251029902280212025102590 2620 2520
Prediction interval1502–24842337–29891425–2449
p–Coumaric acid (ppm)
Mean189170224136123201124239214
SD27.5181.3158.0620.3915.1670.8512.1352.2214.75
Min14063.314887.3 96.1 82.7104178193
Max259371354167157 338 139 363 246
Prediction interval133–2445.05–335104–344
Inositol (ppm)
Mean289627282642274226782664285930243766
SD651.93490.63479.75420.43441.2432.94402.21751.4382.32
Min194015801600217016601830219017203320
Max5540403035303710324035203400 4900 4570
Prediction interval1576–42171652–36321733–3722
Phytic acid (%)
Mean0.7950.7140.7440.8610.7590.8600.7140.9320.940
SD0.12300.25970.081780.10890.18050.17530.07670.15620.1105
Min0.491<LOQ0.5560.6310.2080.5120.5460.6000.750
Max1.021.210.8801.140.969 1.15 0.837 1.19 1.20
Prediction interval0.546–1.04<LOQ–0.9130.187–1.24
Trypsin inhibitor (TIUg/mg)
Mean2.802.813.461.961.792.592.903.103.11
SD1.2530.44110.94290.27960.32140.6960.49310.2970.2416
Min<LOQ2.062.271.501.341.422.182.512.62
Max5.413.835.032.552.383.993.633.693.54
Prediction interval0.259–5.341.51–5.411.91–3.70

All values are on a dry weight basis. Each event and stack was grown in separate field trials. N = total number of observations, but the mean and standard deviation (SD) do not include observations below the level of quantitation (

For starch, N = 18 and for each fatty acid, N = 9;

For starch N = 5;

For iron N = 33;

For copper, N = 35;

For selenium, N = 16;

For selenium, N = 12.

TIU = trypsin inhibitor unit.

Levels of nutritional and antinutritional components in grain from single event and stacked event maize All values are on a dry weight basis. Each event and stack was grown in separate field trials. N = total number of observations, but the mean and standard deviation (SD) do not include observations below the level of quantitation ( For starch, N = 18 and for each fatty acid, N = 9; For starch N = 5; For iron N = 33; For copper, N = 35; For selenium, N = 16; For selenium, N = 12. TIU = trypsin inhibitor unit. About half of the stack ranges with values outside of the prediction intervals occurred among the minerals, which are not metabolized by the plant but are instead absorbed from the surrounding environment and thus are heavily influenced by such environmental parameters as soil type, soil cation exchange capacity and fertilization regimes. Across all nutritional components, the Bt11 × GA21 stack had the greatest number of values outside of the prediction intervals. The Bt11 and the GA21 events were both present in four other stacks, yet the occurrence of values outside of the prediction intervals was inconsistent compared to the Bt11 × GA21 stack (see highlighted range values, Table 3). If two events in a stack were interacting with one another to cause changes in composition, then that interaction should occur whenever those specific events were combined in a stack. However, examination of the means and ranges of other stacks containing these events showed no such pattern. All values within the data set fell within the ranges of the International Life Sciences Crop Composition Database (ILSI 2014), which reports nutritional component levels for conventional crops. The data for the single events and stacks were generated from plants grown in multiple environments (years, location and germplasm). The observed variability in grain composition can be attributed to these differences. It is well documented that both growing environment and germplasm have a strong influence on the composition of maize (Harrigan et al., 2007; Reynolds et al., 2005; Skogerson et al., 2010; Venkatesh et al., 2014). These results are consistent with the expectation that these events have little effect on composition, whether as single events or stacked with one another, and are a good representation of the variability in composition inherent in maize.

Protein expression

The ranges of concentration for each of the transgenic proteins in maize grain for all stacks were within the range of those for the corresponding single events (Figures 1, 2, 3, 4, 5) except for Cry1Ab in two Bt11 × MIR604 × GA21 samples, which were very slightly lower than the range in Bt11 (Figure 1). As expected, PMI concentrations in Bt11 × MIR162 × MIR604 × GA21 maize grain were higher than those in MIR162 or MIR604 due to the expression of two pmi genes, each contributed by MIR162 and MIR604 (Figure 5). The concentrations of Cry1Ab in Bt11 × MIR162 × GA21 and Vip3Aa20 in Bt11 × MIR162× MIR604 × GA21 were generally higher than in the other stacks (Figures 1 and 4) but were still within the ranges of expression for the single events (Bt11 and MIR162) grown in the same trials and in the same germplasm. Concentrations of PAT in event Bt11 and stacks containing Bt11 are not included because PAT concentrations were typically less than the limit of quantitation in grain. While these results do not indicate a difference in expression levels due to stacking of GM events, they do illustrate how environment and germplasm can affect protein expression levels.
Figure 1

Cry1Ab concentrations in grain of event Bt11 (dark grey) and stacks containing event Bt11. N = 170 (Bt11), 32 (Bt11 × GA21), 5 (Bt11 × MIR604), 29 (Bt11 × MIR604 × GA21), 10 (Bt11 × MIR162 × GA21) and 9 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 11 (Bt11), 4 (Bt11 × GA21), 1 (Bt11 × MIR604), 3 (Bt11 × MIR604 × GA21), 1 (Bt11 × MIR162 × GA21), 1 (Bt11 × MIR162 × MIR604 × GA21); × = individual datapoints for Cry1Ab in event Bt11 and Bt11 × MIR162 × GA21 grown together in one field trial.

Figure 2

mCry3A concentrations in grain of event MIR604 (dark grey) and stacks containing event MIR604. N = 101 (MIR604), 5 (MIR604 × GA21), 5 (Bt11 × MIR604), 19 (Bt11 × MIR604 × GA21) and 8 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 7 (MIR604), 1 (MIR604 × GA21), 1 (Bt11 × MIR604), 3 (Bt11 × MIR604 × GA21) and 1 (Bt11 × MIR162 × MIR604 × GA21).

Figure 3

mEPSPS concentrations in grain of event GA21(dark grey) and stacks containing event GA21. N = 208 (GA21), 5 (MIR604 × GA21), 30 (Bt11 × GA21), 29 (Bt11 × MIR604 × GA21), 10 (Bt11 × MIR162 × GA21) and 8 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 12 (GA21), 1 (MIR604 × GA21), 4 (Bt11 × GA21), 3 (Bt11 × MIR604 × GA21), 1 (Bt11 × MIR162 × GA21) and 1 (Bt11 × MIR162 × MIR604 × GA21).

Figure 4

Vip3Aa20 concentrations in event MIR162 (dark grey) and stacks containing event MIR162. N = 52 (MIR162), 10 (Bt11 × MIR162 × GA21) and 9 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 6 (MIR162), 1 (Bt11 × MIR162 × GA21), 1 (Bt11 × MIR162 × MIR604 × GA21); × = individual datapoints for Vip3Aa20 in MIR162 maize and Bt11 × MIR162 × MIR604 × GA21 maize grown together in one field trial.

Figure 5

Phosphomannose isomerase concentrations in event MIR604, event MIR162 (both dark grey) and stacks containing events MIR604 and MIR162. N = 101 (MIR604), 52 (MIR162), 5 (MIR604 × GA21), 5 (Bt11 × MIR604), 29 (Bt11 × MIR604 × GA21), 10 (Bt11 × MIR162 × GA21) and 17 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 7 (MIR604), 6 (MIR162), 1 (MIR604 × GA21), 1 (Bt11 × MIR604), 3 (Bt11 × MIR604 × GA21), 1 (Bt11 × MIR162 × GA21) and 1 (Bt11 × MIR162 × MIR604 × GA21).

Cry1Ab concentrations in grain of event Bt11 (dark grey) and stacks containing event Bt11. N = 170 (Bt11), 32 (Bt11 × GA21), 5 (Bt11 × MIR604), 29 (Bt11 × MIR604 × GA21), 10 (Bt11 × MIR162 × GA21) and 9 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 11 (Bt11), 4 (Bt11 × GA21), 1 (Bt11 × MIR604), 3 (Bt11 × MIR604 × GA21), 1 (Bt11 × MIR162 × GA21), 1 (Bt11 × MIR162 × MIR604 × GA21); × = individual datapoints for Cry1Ab in event Bt11 and Bt11 × MIR162 × GA21 grown together in one field trial. mCry3A concentrations in grain of event MIR604 (dark grey) and stacks containing event MIR604. N = 101 (MIR604), 5 (MIR604 × GA21), 5 (Bt11 × MIR604), 19 (Bt11 × MIR604 × GA21) and 8 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 7 (MIR604), 1 (MIR604 × GA21), 1 (Bt11 × MIR604), 3 (Bt11 × MIR604 × GA21) and 1 (Bt11 × MIR162 × MIR604 × GA21). mEPSPS concentrations in grain of event GA21(dark grey) and stacks containing event GA21. N = 208 (GA21), 5 (MIR604 × GA21), 30 (Bt11 × GA21), 29 (Bt11 × MIR604 × GA21), 10 (Bt11 × MIR162 × GA21) and 8 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 12 (GA21), 1 (MIR604 × GA21), 4 (Bt11 × GA21), 3 (Bt11 × MIR604 × GA21), 1 (Bt11 × MIR162 × GA21) and 1 (Bt11 × MIR162 × MIR604 × GA21). Vip3Aa20 concentrations in event MIR162 (dark grey) and stacks containing event MIR162. N = 52 (MIR162), 10 (Bt11 × MIR162 × GA21) and 9 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 6 (MIR162), 1 (Bt11 × MIR162 × GA21), 1 (Bt11 × MIR162 × MIR604 × GA21); × = individual datapoints for Vip3Aa20 in MIR162 maize and Bt11 × MIR162 × MIR604 × GA21 maize grown together in one field trial. Phosphomannose isomerase concentrations in event MIR604, event MIR162 (both dark grey) and stacks containing events MIR604 and MIR162. N = 101 (MIR604), 52 (MIR162), 5 (MIR604 × GA21), 5 (Bt11 × MIR604), 29 (Bt11 × MIR604 × GA21), 10 (Bt11 × MIR162 × GA21) and 17 (Bt11 × MIR162 × MIR604 × GA21); Number of environments (combination of germplasm, year grown and location) = 7 (MIR604), 6 (MIR162), 1 (MIR604 × GA21), 1 (Bt11 × MIR604), 3 (Bt11 × MIR604 × GA21), 1 (Bt11 × MIR162 × GA21) and 1 (Bt11 × MIR162 × MIR604 × GA21).

Molecular characterization

The Southern analyses had the expected hybridization patterns of the cry1Ab and pat genes from Bt11, the vip3Aa20 and pmi genes from MIR162, the mcry3A and pmi genes from MIR604 and the mepsps gene from GA21 contained in the stacks. An example Southern blot analysis for pmi is shown in Figure 6. These results demonstrated that inheritance and integrity of the transgenic inserts were preserved during conventional breeding for production of the stacks Bt11 × GA21, Bt11 × MIR604, MIR604 × GA21, Bt11 × MIR604 × GA21, Bt11 × MIR162× GA21 and Bt11 × MIR162 × MIR604 × GA21 maize.
Figure 6

Southern blot analysis confirming presence of pmi in event MIR162, event MIR604 and in Bt11 × MIR162 × MIR604 × GA21.

Southern blot analysis confirming presence of pmi in event MIR162, event MIR604 and in Bt11 × MIR162 × MIR604 × GA21.

Discussion

The World Health Organization (WHO 1995) has stated that when two plants, which are substantially equivalent to conventional varieties are crossed by conventional breeding, the combined event product is expected to be substantially equivalent to the individual events. The composition, protein expression and molecular characterization data reported herein for several stacked GM event combinations and the component single events supported the position of the World Health Organization. Additionally, these results were consistent with the conclusions of EFSA following review of applications submitted for import approval of these single events and stacked GM event combinations (EFSA 2005, 2009a,b,c, 2010a,b,c, 2011b, 2012, EFSA, GMO Panel, 2015). More than 20 different GM crops with stacked events have been evaluated by EFSA and other regulatory agencies and in all cases EFSA concluded that there were no compositional, agronomic or phenotypic changes that would raise safety concerns (Kok et al., 2014). In considering the safety of stacked GM events for food and feed use, Steiner et al. (2013) posed two questions: (i) Is genomic instability increased in stacked GM events, and (ii) Can potential interactions between the transgenes and their products impact safety? An overview of genome plasticity and the mechanisms known to contribute to changes in plant genomes are well described by Weber et al. (2012). These molecular mechanisms naturally occur in plants, and as conventional breeding to combine GM events does not introduce additional recombinant DNA into the genome or modify the existing genomic DNA (Pilacinski et al., 2011), there is no biological reason for the frequency or nature of genomic instability to differ in stacked GM events. If genomic instability does occur that affects the GM sequences contributed by the individual events, the likely outcome would be a reversion to the parental phenotype. The molecular characterization data for the GM stacks described herein confirmed stable inheritance and intactness of the inserted DNA, and supports the view that combining events through conventional breeding does not increase genetic instability. Taken together, these data provide a strong rationale for revision of the current practices for food and feed safety assessments of stacked GM events through problem formulation focused on potential interactions resulting from the specific combination of GM events (Kok et al., 2014; Steiner et al., 2013; Weber et al., 2012). Problem formulation approaches to risk assessment maximize the possibility of detecting effects that indicate potential risk (Raybould, 2006). The identification and assessment of potential interactions between stacked GM events can be undertaken on a case‐by‐case basis, taking into consideration any metabolic pathways that could be influenced by the expression of the transgenes in the single events, and whether such interactions could result in changes in the plant that would impact food and feed safety. Based on each transgene's mode of action, it is possible to make predictions concerning potential interactions in the resulting GM stack. An interaction in the plant is not expected when the transgene products are not part of, or do not interact with, common metabolic pathways. Combinations of insect resistance traits fall into this category, as most insecticidal proteins have no known metabolic activity in planta. Herbicide tolerance is typically conferred by an herbicide‐insensitive version of the targeted enzyme or by an enzyme that metabolizes the herbicide, rendering it inactive, so it is also unlikely that a plant interaction could occur between proteins engineered for insect resistance and proteins expressed for herbicide tolerance. There are proteins that are known to act synergistically, and the potential for synergism between proteins combined by stacking of GM events should be evaluated. Although the scope of this manuscript is limited to food and feed safety, problem formulation can and should be applied to potential synergism of insect and herbicide resistance genes in assessments related to environmental safety. A diagram representing a decision‐making process for stacked GM event safety assessment data is shown in Figure 7.
Figure 7

Decision process for generation of risk assessment data for stacked events.

Decision process for generation of risk assessment data for stacked events. Conventional breeding has a history of safe use for combining genetic information for the improvement of crop plant varieties (CLI 2011). As described herein, all new GM events undergo extensive characterization and risk assessment prior to their commercial release. Because there is no evidence of increased genome instability when GM events are stacked through conventional breeding, if there is also no plausible interaction of the transgenes or their products, then stacked GM events can be considered as safe as their component single events (CLI 2015).

Experimental procedures

The events and stacked GM events described herein consisted of the maize events Bt11, MIR162, MIR604 and GA21, and several stacks created by combining these events through conventional breeding. Maize plants derived from event Bt11 express a truncated Cry1Ab protein for control of certain lepidopteran pests and a phosphinothricin acetyltransferase (PAT) protein that confers tolerance to glufosinate herbicide. Maize event MIR162 expresses a Vip3Aa20 protein for control of lepidopteran insect pests and a phosphomannose isomerase (PMI) protein that was used as a selectable marker. Event MIR604 expresses a modified Cry3A (mCry3A) protein for control of corn root worm and phosphomannose isomerase (PMI). Maize event GA21 expresses a modified 5‐enol pyruvylshikimate‐3‐phosphate synthase (mEPSPS) protein that confers tolerance to glyphosate herbicide. Stacked GM events were produced by combining the individual events Bt11, MIR162, MIR604 and GA21 through conventional breeding. The single events and stacks evaluated in this study were in several different genetic backgrounds. The single events and stacked GM events were grown in field trials to generate grain samples for compositional analysis. The field trials were conducted between 1995 and 2009 in the United States' Corn Belt, and in Europe, in agricultural regions suitable for the specific hybrids being grown. Each single event or stack was grown in separate field trials at multiple locations (Table 2). Some were grown in the same location and year, but in a different trial and in different genetic backgrounds. The field trials at each location were randomized in a complete block experimental design with three or four replicate plots at each location, except for the Bt11 trials, which consisted of a single plot at multiple locations. Developing maize ears were bagged before silk emergence to avoid pollen contamination and then self‐pollinated by hand and rebagged. The trials were maintained according to agricultural practices normally employed in the particular regions, including the use of pesticides needed to maintain plant health. Fifteen self‐pollinated ears per plot were harvested at maturity and dried to not more than 18% moisture, the grain was removed from the ears, and a well‐mixed sample from each plot of approximately 500 g was retained. The samples were stored at −20 °C ± 10 °C until they were analysed.
Table 2

Composition field trial years and locations

Event or stackYearsLocationsTotal no. of environmentsa
Bt11 × MIR162 × MIR604 × GA212006Illinois (2), Indiana, Iowa, Minnesota, Nebraska6
Bt11 × MIR162 × GA212006Illinois (2), Indiana, Iowa, Minnesota, Nebraska6
Bt11 × MIR604 × GA212006Illinois (2), Indiana, Iowa, Minnesota, Nebraska12
2008Spain (3), Romania (3)
Bt11 × MIR6042005Illinois (2), Iowa, Minnesota, Nebraska, Wisconsin6
Bt11 × GA212005Illinois (3), Iowa, Nebraska, Wisconsin12
2008Spain (3), Romania (3)
MIR604 × GA212005Illinois (2), Iowa, Nebraska, Wisconsin5
MIR1622005Illinois (2), Iowa, Nebraska, Wisconsin9
2009Illinois, Iowa, Nebraska (2)
MIR6042003b Illinois (2), Iowa (3), Minnesota (2)18
2003b Illinois (2), Iowa (3)
2008Spain (3), Romania (3)
GA212005Illinois (3), Iowa, Minnesota, Nebraska18
2006Spain (3), Romania (3)
2007Spain (3), Romania (3)
Bt11c 1995b Iowa (2), Ohio (2), Wisconsin (2)15
1995b Iowa (2), Ohio (2), Wisconsin (2)
1998d France (3)

Environment = combination of location, year, and dgenetic background.

The event was in two genetic backgrounds but grown at all or most of the same locations in separate field trials.

Only one plot at each location.

The event was in two different genetic backgrounds at one site and in a third genetic background at another site.

Composition field trial years and locations Environment = combination of location, year, and dgenetic background. The event was in two genetic backgrounds but grown at all or most of the same locations in separate field trials. Only one plot at each location. The event was in two different genetic backgrounds at one site and in a third genetic background at another site. Levels of key nutritional components recommended by the Organization for Economic Cooperation and Development (OECD 2002) were measured in maize grain. The components measured were crude protein, fat, carbohydrates (by subtraction), acid detergent fibre, neutral detergent fibre, starch, minerals (calcium, copper, iron, magnesium, manganese, phosphorus, potassium, selenium and zinc), fatty acids (five most abundant in maize), vitamins (β‐carotene, thiamine, riboflavin, niacin, pyridoxine, folic acid and α‐tocopherol), important nutritional secondary metabolites (ferulic acid, inositol and ρ‐coumaric acid) and antinutrients (phytic acid, trypsin inhibitor and furfural). All samples were analysed by Covance Laboratories, Inc. (Madison, WI) using published industry‐standard analytical methods (e.g. AOAC International 2005) or methods developed and validated by Covance Laboratories. The component levels were converted to equivalent units of dry weight (DW) based on the moisture content of each sample. Means, standard deviations (SD) and ranges were calculated across trials for each event or stack. Based on the compiled data for each single event, prediction intervals were calculated for the single events as a means of assessing the consistency of the data from stacks containing that single event. These prediction intervals predict with 95% confidence the range within which an additional observation would fall. Protein expression data were compiled from 26 studies including eight different field trial locations in four different countries over an eight‐year period (2002–2010) (Table 3). Comparative protein expression studies included both the stacked GM event and component single events in the same genetic background, grown in five replicate plots arranged in a randomized complete block design. In addition to the comparative protein expression studies, the single events were also grown in trials at different locations in different seasons and in different germplasm.
Table 3

Protein expression field trial years and locations

Event or StackLocations (year)
Bt11 × MIR162 × MIR604 × GA21Illinois (2006)
Bt11
MIR162
MIR604
GA21
Bt11 × MIR162 × GA21Illinois (2006)
Bt11
MIR162
GA21
Bt11 × MIR604 × GA21Illinois (2006), Spain (2008), Romania (2008)
Bt11
MIR604
GA21
Bt11 × MIR604Illinois (2005)
Bt11
MIR604
Bt11 × GA21Illinois (2005), Spain (2008), Romania (2008), Republic of South Africa (2009)
Bt11
GA21
MIR604 × GA21Illinois (2005)
MIR604
GA21
MIR162Illinois (2005), Nebraska (2005), Hawaii (2008), Iowa (2009), Nebraska (2010)
MIR604Illinois (2002), Illinois (2007), Iowa (2009)
GA21Illinois (2004), Spain (2007 & 2008), Illinois (2007), Hawaii (2008), Florida (2006), Iowa (2009), Nebraska (2010)
Bt11Illinois (2002), Illinois (2007), Hawaii (2008), Florida (2006), Iowa (2009), Nebraska (2010)

Each location represents a separate field trial that included all the event(s) and the stack listed in the corresponding table row.

Protein expression field trial years and locations Each location represents a separate field trial that included all the event(s) and the stack listed in the corresponding table row. For all protein expression studies, each grain sample consisted of all the kernels from a single ear collected at reproductive growth stage six (Abendroth et al., 2011). Each sample was placed immediately on dry ice upon removal from the cob and stored frozen. Grain samples were ground to a powder in the presence of dry ice, using a commercial food processor. Proteins were extracted by homogenization in an appropriate buffer and each extract was analysed by an enzyme‐linked immunosorbent assay (ELISA) specific to the transgenic protein of interest. Concentrations of the target protein were interpolated from a standard curve then converted to μg of protein per gram of sample. Data for each transgenic protein in each single event or stack were combined across germplasm, season and location, and means, medians and ranges, displayed in box plots. Southern analyses were performed using standard molecular biology techniques (Chomczynski, 1992). Genomic DNA samples from each of the individual events, the stacks and nontransgenic controls were digested with restriction enzymes that resulted in a characteristic DNA hybridization pattern for each probe. For analysis of Bt11, MIR162 and MIR604 inserts, plasmid DNA representing one copy per maize genome, based on plasmid size, was included to serve as a positive control for each of the genes of interest. For the GA21 maize insert analysis, a portion of a restriction enzyme‐generated fragment containing the mepsps gene, representing one copy per maize genome, was used as a positive control for the mepsps‐specific probe. A nontransgenic control was included on each Southern blot to identify any endogenous maize sequences that could cross‐hybridize with the element‐specific probes.
  13 in total

Review 1.  Comparative safety assessment for biotech crops.

Authors:  Esther J Kok; Harry A Kuiper
Journal:  Trends Biotechnol       Date:  2003-10       Impact factor: 19.536

Review 2.  Plants with genetically modified events combined by conventional breeding: an assessment of the need for additional regulatory data.

Authors:  W Pilacinski; A Crawford; R Downey; B Harvey; S Huber; P Hunst; L K Lahman; S MacIntosh; M Pohl; C Rickard; L Tagliani; N Weber
Journal:  Food Chem Toxicol       Date:  2010-11-11       Impact factor: 6.023

3.  One-hour downward alkaline capillary transfer for blotting of DNA and RNA.

Authors:  P Chomczynski
Journal:  Anal Biochem       Date:  1992-02-14       Impact factor: 3.365

4.  Problem formulation and hypothesis testing for environmental risk assessments of genetically modified crops.

Authors:  Alan Raybould
Journal:  Environ Biosafety Res       Date:  2007-03-17

Review 5.  Trait stacking in transgenic crops: challenges and opportunities.

Authors:  Qiudeng Que; Mary-Dell M Chilton; Cheryl M de Fontes; Chengkun He; Michael Nuccio; Tong Zhu; Yuexuan Wu; Jeng S Chen; Liang Shi
Journal:  GM Crops       Date:  2010 Jul-Sep

6.  Editor's choice: Evaluating the potential for adverse interactions within genetically engineered breeding stacks.

Authors:  Henry-York Steiner; Claire Halpin; Joseph M Jez; John Kough; Wayne Parrott; Lynne Underhill; Natalie Weber; L Curtis Hannah
Journal:  Plant Physiol       Date:  2013-03-04       Impact factor: 8.340

7.  Compositional differences between near-isogenic GM and conventional maize hybrids are associated with backcrossing practices in conventional breeding.

Authors:  Tyamagondlu V Venkatesh; Kevin Cook; Bing Liu; Timothy Perez; Alan Willse; Ryan Tichich; Ping Feng; George G Harrigan
Journal:  Plant Biotechnol J       Date:  2014-09-04       Impact factor: 9.803

8.  Impact of genetics and environment on the metabolite composition of maize grain.

Authors:  Kirsten Skogerson; George G Harrigan; Tracey L Reynolds; Steven C Halls; Martin Ruebelt; Alberto Iandolino; Anand Pandravada; Kevin C Glenn; Oliver Fiehn
Journal:  J Agric Food Chem       Date:  2010-03-24       Impact factor: 5.279

9.  Impact of genetics and environment on nutritional and metabolite components of maize grain.

Authors:  George G Harrigan; Leanna G Stork; Susan G Riordan; Tracey L Reynolds; William P Ridley; James D Masucci; Susan Macisaac; Steven C Halls; Robert Orth; Ronald G Smith; Li Wen; Wayne E Brown; Michael Welsch; Rochelle Riley; David McFarland; Anand Pandravada; Kevin C Glenn
Journal:  J Agric Food Chem       Date:  2007-07-03       Impact factor: 5.279

Review 10.  A meta-analysis of the impacts of genetically modified crops.

Authors:  Wilhelm Klümper; Matin Qaim
Journal:  PLoS One       Date:  2014-11-03       Impact factor: 3.240

View more
  5 in total

Review 1.  Regulatory policy on genetically modified breeding stack in key countries and the current status in Korea.

Authors:  Su-Yeon Sul; Seung-Man Suh; Saet-Byul Park; Hae-Yeong Kim
Journal:  Food Sci Biotechnol       Date:  2021-11-21       Impact factor: 2.391

2.  Long-term T-DNA insert stability and transgene expression consistency in field propagated sugarcane.

Authors:  Kerry Hosmer Caffall; Chengkun He; Michele Smith-Jones; Kristin Mayo; Pearl Mai; Shujie Dong; John Ke; Erik Dunder; Michele Yarnall; Rachel Whinna; Joe DeMaio; Weining Gu; Judith Sheldon; Martin Allen; Tricia Costello; Kristin Setliff; Rakesh Jain; Ada Snyder; Clark Lovelady; Eric Rawls; Eric Palmer; Yan Zhang; Nicholas Bate; Liang Shi; Ian Jepson
Journal:  Plant Mol Biol       Date:  2016-12-28       Impact factor: 4.076

3.  How biological background assumptions influence scientific risk evaluation of stacked genetically modified plants: an analysis of research hypotheses and argumentations.

Authors:  Elena Rocca; Fredrik Andersen
Journal:  Life Sci Soc Policy       Date:  2017-08-14

4.  Update of Argentina's Regulatory Policies on the Environmental Risk Assessment.

Authors:  Facundo Vesprini; Agustina Ines Whelan; María Florencia Goberna; Mariana Lucía Murrone; Gabriela Evangelina Barros; Andrés Frankow; Perla Godoy; Dalia Marcela Lewi
Journal:  Front Bioeng Biotechnol       Date:  2022-01-31

5.  Comparing agronomic and phenotypic plant characteristics between single and stacked events in soybean, maize, and cotton.

Authors:  Marcia Jose; Hallison Vertuan; Daniel Soares; Daniel Sordi; Luiz F Bellini; Rafael Kotsubo; Geraldo U Berger
Journal:  PLoS One       Date:  2020-04-27       Impact factor: 3.240

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.