Literature DB >> 27066013

Predicting In vitro Culture Medium Macro-Nutrients Composition for Pear Rootstocks Using Regression Analysis and Neural Network Models.

S Jamshidi1, A Yadollahi1, H Ahmadi2, M M Arab1, M Eftekhari1.   

Abstract

Two modeling techniques [artificial neural network-genetic algorithm (ANN-GA) and stepwise regression analysis] were used to predict the effect of medium macro-nutrients on in vitro performance of pear rootstocks (OHF and Pyrodwarf). The ANN-GA described associations between investigating eight macronutrients (NO[Formula: see text], NH[Formula: see text], Ca(2+), K(+), Mg(2+), PO[Formula: see text], SO[Formula: see text], and Cl(-)) and explant growth parameters [proliferation rate (PR), shoot length (SL), shoot tip necrosis (STN), chlorosis (Chl), and vitrification (Vitri)]. ANN-GA revealed a substantially higher accuracy of prediction than for regression models. According to the ANN-GA results, among the input variables concentrations (mM), NH[Formula: see text] (301.7), and NO[Formula: see text], NH[Formula: see text] (64), SO[Formula: see text] (54.1), K(+) (40.4), and NO[Formula: see text] (35.1) in OHF and Ca(2+) (23.7), NH[Formula: see text] (10.7), NO[Formula: see text] (9.1), NH[Formula: see text] (317.6), and NH[Formula: see text] (79.6) in Pyrodwarf had the highest values of VSR in data set, respectively, for PR, SL, STN, Chl, and Vitri. The ANN-GA showed that media containing (mM) 62.5 NO[Formula: see text], 5.7 NH[Formula: see text], 2.7 Ca(2+), 31.5 K(+), 3.3 Mg(2+), 2.6 PO[Formula: see text], 5.6 SO[Formula: see text], and 3.5 Cl(-) could lead to optimal PR for OHF and optimal PR for Pyrodwarf may be obtained with media containing 25.6 NO[Formula: see text], 13.1 NH[Formula: see text], 5.5 Ca(2+), 35.7 K(+), 1.5 Mg(2+), 2.1 PO[Formula: see text], 3.6 SO[Formula: see text], and 3 Cl(-).

Entities:  

Keywords:  in vitro culture medium; macro nutrients; neural network model; optimized medium; regression analysis

Year:  2016        PMID: 27066013      PMCID: PMC4809900          DOI: 10.3389/fpls.2016.00274

Source DB:  PubMed          Journal:  Front Plant Sci        ISSN: 1664-462X            Impact factor:   5.753


Introduction

From the inception of plant tissue culture (leaf mesophyll and hair cells) by Austrian botanist Gottlieb Haberlandt (1902) in nutritive media, numerous researches have been done on the optimization of various culture media to provide explants favorite propagation conditions. Study on the relationship between media nutrients and explant proliferation may result to design a more effective medium. Hence, statistical and mathematical tools such as linear regression, logistic regression, and mixed models are used. Artificial neural network (ANN) is an operative substitute used for trustworthy assessments of the biological systems. Neural network technology estimates different complex mathematical functions to process and infer various sets of irregular data. This technology simulates the structure of the human neuron network as it includes information processing and decision making abilities. They can recognize and model complex non-linear relationships between the input and output of a biological process owing to their high learning aptitude, (Hashimota, 1997; Nazmul Karim et al., 1997; Patnaik, 1999). There are three kinds of layers in ANN including input layer, one or more hidden layers, and output layer. The neurons are linked together with different connection strength. The connections are entitled synaptic weights, in which, all data on the network is encoded as those weights are actually the numbers that regulate the strength of the impulses coming to the neurons. The most critical characteristic of ANN, which specifies that computational method, is the process of training. Training of the networks is recognized with the variations of the values for all synaptic weights using a specific algorithm (Haykin, 1999). The most well-known learning algorithm is back-propagation procedure. In which, the error made because of inconsistencies between the system output (observed) and the expected outcome is propagated back to simplify readjustments of the weights allocated to the connections up to the network attains an appropriate generality (Dayhoff and DeLeo, 2001). Currently, the ANN has been used in many fields to model and anticipate the performances of systems, based on certain input–output data. Whereas, neural networks have presented considerable advances in the field of computer-generated adjustment of bioprocesses, their applications to complex in vitro plant culture systems are relatively new and limited only to a small number of cases (Prasad and Dutta Gupta, 2006). It is essential to optimize the factors influencing plant tissue culture systems. Acquired optimized models represent appropriate resolutions when trained with a set of special constraints. These constraints weights are saved in the connections so that feeding with independent variables causes the network predicts the relationship of variables which results in optimum solution (Prasad and Dutta Gupta, 2006). In this study, we demonstrated a use of statistical method of experimental design, Taguchi method, in inspecting the optimum macronutrientś concentrations for explant proliferation and ANN to evaluate the effect and importance of several essential mineral elements' concentration on explant proliferation to: (1) develop an ANN-based model to answer questions relating to the appropriate macronutrient concentrations for achieving the most suitable results for the parameters studied, (2) apply the developed ANN-model to evaluate the relative importance of the studied ions, on proliferation, and (3) optimize ANN-model to find the optimum values of input variable for maximizing PR. This could be used to carry out proper culture media optimization studies, in this case, for these Pyrus rootstocks' micro-propagation. The genetic algorithm (GA) is an optimization technique based on the biological principles of genetic variation and natural selection. It evolves finding the best solution for a specific problem. So, our main research objective was to analyze the ANN-GA models to address the question of how to get maximum PR, SL, and minimum STN, Chl, and Vitri (Figure 1).
Figure 1

Schematic describing the relationship between ANN and GA.

Schematic describing the relationship between ANN and GA. Besides, ANN-GA can also be used in relation to other techniques such as stepwise regression modeling to achieve accurate results. To evaluate an appropriate model for nutrient medium both stepwise regression analysis and ANN-GA models were studied on a comparative base.

Materials and methods

Plant material and in vitro culture conditions

The experiments were carried out using micro-shoots of Pyrodwarf (“Old Home” × “Gute Luise”) and OHF (“Old Home” × “Farmingdel”) rootstocks from in vitro cultures. Briefly, micro-shoots were proliferated in MS (Murashige and Skoog, 1962) medium containing 2.5 mg/l BAP (6-benzylaminopurine), 0.2 mg/l IBA (indole-3-butric acid), 30 g/l sucrose, and 8 g/l agar (DuchefaH). Media pH was set to 5.7 and was placed into in 250- ml glass bottles with autoclave-resistant plastic caps (5.5 cm in diameter, 8 cm in height) prior autoclaving (121°C, 1 kg cm−2 s−1 for 15 min). The cultures were maintained under a 16 h-photoperiod at 80 μmol m−2 s−1 with a 16- h photoperiod of fluorescent bulbs light and at temperatures of 25 ± 2°C. For pyrodwarf rootstock, each treatment in each set of experiments consisted of 15 replicates and for OHF rootstock it consisted of 10 replicates. Each replication consisted of five jam jars of four explants each.

Stepwise regression procedure

Regression analysis is one of the most common procedures for predictive modeling. A multiple regression model with more than one explanatory variable may be written as y = b0 + b1x1 + b2x2 +…+ bpxp, where y is the output variable, bi the regression parameters (i = 0,1,2,…,p), xi the input variables (i = 1,2,…,p). When regression coefficients are obtained, a prediction equation can then be used to predict the value of a continuous output as a linear function of one or more independent inputs. The popularity of the regression models may be attributed to the interpretability of model parameters and ease of use. In our application to the prediction of culture medium macro-nutrients composition, stepwise regression models are used, with both the entry and stay points for the models set to 0.05. The stepwise regression analysis was carried out for the data obtained to test significance of the independent variables of KNO3, NH4NO3, CaCl2, MgSO4, and KH2PO4 affecting proliferation rate (PR; number of new regenerated micro-shoots), shoot length (SL; length of new regenerated micro-shoots in cm), shoot tip necrosis (STN) percentage, chlorosis (Chl) percentage, and vitrification (Vitri) percentage of pear rootstock explants as dependent variables.

Optimization of explant growth parameters via Taguchi method

Taguchi design is a powerful and efficient tool for optimizing process that functions consistently and optimally over various conditions. Taguchi designs (orthogonal arrays) allow analyzing many factors with few runs. In such a design, no factor is weighted more or less in an experiment and thus allowing factors to be analyzed independently over each other. There are some noise factors which cause deviation of the functional characteristics of a product from their target values (e.g., human errors). According to Taguchi's OA, a standard orthogonal array L27 (35) 27 experiments with 26° of freedom were used to evaluate the effect of five factors (KNO3, NH4NO3, CaCl2, MgSO4, and KH2PO4) on SL, PR, Vitri, Chl, and STN. To all experiments, the three levels of factor variations were 1.25, 1.75, and 2.25 × MS medium concentrations and the designing of the L27 orthogonal array of Taguchi experimental design was illustrated as in Tables 1, 2. Each mineral concentration treatment consisted of at least 15 replicates of three explants each.
Table 1

Ion concentrations of the various media types used for OHF and pyrodwarf rootstocks micropropagation and mean values of the parameters used to characterize it.

RootstockCulture mediumIon Composition (mM)PRSL (cm)STNChlovitri
NO3-NH4-Ca2+K+Mg2+PO42-SO42-Cl
OHF149.2725.783.7425.061.871.562.113.743.642.81000
249.2725.783.7425.671.872.182.113.743.252.971.2500
349.2725.783.7426.31.872.812.113.743.212.991.2500
459.5836.095.2425.062.631.562.875.242.743.382.380.750
559.5836.095.2425.672.632.182.875.242.433.573.631.500
659.5836.095.2426.32.632.812.875.242.064.031.750.500
769.946.416.7425.063.381.563.626.741.604.550.500.880
869.946.416.7425.673.382.183.626.742.603.471.0000
969.946.416.7426.33.382.813.626.742.333.691.632.630
1058.6625.785.2434.443.381.563.625.243.792.475.751.130
1158.6625.785.2435.063.382.183.625.245.621.517.131.130
1258.6625.785.2435.693.382.813.625.247.381.078.881.000
1368.9736.096.7434.441.871.562.116.743.742.6410.007.755.63
1468.9736.096.7435.061.872.182.116.743.512.8414.0011.136.13
1568.9736.096.7435.691.872.812.116.742.423.6720.259.709.50
1679.2946.413.7434.442.631.562.873.742.233.7820.885.6311.50
1779.2946.413.7435.062.632.182.873.742.853.177.887.6315.38
1879.2946.413.7435.692.632.812.873.743.762.537.257.1319.38
1968.0625.786.7443.842.631.562.876.743.262.967.259.007.75
2068.0625.786.7444.462.632.182.876.742.673.464.6310.381.00
2168.0625.786.7445.092.632.812.876.743.123.0811.0012.001.38
2278.3736.093.7443.843.381.563.623.743.702.5730.7514.252.63
2378.3736.093.7444.463.382.183.623.743.472.7140.7513.885.75
2478.3736.093.7445.093.382.813.623.741.644.5619.6314.2511.00
2588.6946.415.2443.841.871.562.115.241.345.0350.5016.134.38
2688.6946.415.2444.461.872.182.115.241.005.4155.5019.004.63
2788.6946.415.2445.091.872.812.115.241.085.3168.1323.0011.00
MS39.4120.622.9920.041.51.251.742.993.492.7613.7513.503.63
QL27.8852.5419.790.711.980.9503.462.733.007.0012.50
WPM9.7153.016.931.51.257.420.652.583.526.1312.135.50
PYRODWARF
149.2725.783.7425.061.871.562.113.7411.233.430.1700
249.2725.783.7425.671.872.182.113.7411.213.310.5000
349.2725.783.7426.31.872.812.113.7410.913.380.5000
459.5836.095.2425.062.631.562.875.249.733.7415.330.831.00
559.5836.095.2425.672.632.182.875.249.474.1318.671.500.17
659.5836.095.2426.32.632.812.875.248.214.3518.670.001.00
769.946.416.7425.063.381.563.626.746.994.8320.172.335.33
869.946.416.7425.673.382.183.626.746.645.2620.670.835.83
969.946.416.7426.33.382.813.626.746.025.0921.830.008.67
1058.6625.785.2434.443.381.563.625.244.593.1711.502.503.33
1158.6625.785.2435.063.382.183.625.244.733.2711.8310.501.17
1258.6625.785.2435.693.382.813.625.244.622.9912.6703.67
1368.9736.096.7434.441.871.562.116.744.923.4927.3303.83
1468.9736.096.7435.061.872.182.116.744.492.7526.507.506.17
1568.9736.096.7435.691.872.812.116.744.533.3926.173.506.33
1679.2946.413.7434.442.631.562.873.743.653.639.671.5010.83
1779.2946.413.7435.062.632.182.873.743.474.1210.5019.3313.33
1879.2946.413.7435.692.632.812.873.743.735.0712.3312.5013.50
1968.0625.786.7443.842.631.562.876.746.314.9025.006.334.50
2068.0625.786.7444.462.632.182.876.747.163.4725.570.835.83
2168.0625.786.7445.092.632.812.876.746.053.4726.333.173.50
2278.3736.093.7443.843.381.563.623.743.933.0812.000.838.50
2378.3736.093.7444.463.382.183.623.743.883.0713.173.6710.17
2478.3736.093.7445.093.382.813.623.743.564.3415.830.5011.50
2588.6946.415.2443.841.871.562.115.242.314.0120.671.1721.67
2688.6946.415.2444.461.872.182.115.241.522.4922.507.0026.00
2788.6946.415.2445.091.872.812.115.241.053.2922.1712.0030.00
MS39.4120.622.9920.041.51.251.742.993.773.290.508.677.33
QL27.8852.5419.790.711.980.9503.062.4712.507.330.50
WPM9.7153.016.931.51.257.420.652.232.012.335.830.50

Only ions with different concentration among media have been included.

Table 2

Levels of variables according to Taguchi—L.

RunLevels of factors used in each trial*
KNO3NH4NO3CaCl2MgSO4KH2PO4
11.251.251.251.251.25
21.251.251.251.251.75
31.251.251.251.252.25
41.251.751.751.751.25
51.251.751.751.751.75
61.251.751.751.752.25
71.252.252.252.251.25
81.252.252.252.251.75
91.252.252.252.252.25
101.751.251.752.251.25
111.751.251.752.251.75
121.751.251.752.252.25
131.751.752.251.251.25
141.751.752.251.251.75
151.751.752.251.252.25
161.752.251.251.751.25
171.752.251.251.751.75
181.752.251.251.752.25
192.251.252.251.751.25
202.251.252.251.751.75
212.251.252.251.752.25
222.251.751.252.251.25
232.251.751.252.251.75
242.251.751.252.252.25
252.252.251.751.251.25
262.252.251.751.251.75
272.252.251.751.252.25

The numbers are coefficients to product to the amounts in Table .

Ion concentrations of the various media types used for OHF and pyrodwarf rootstocks micropropagation and mean values of the parameters used to characterize it. Only ions with different concentration among media have been included. Levels of variables according to Taguchi—L. The numbers are coefficients to product to the amounts in Table .

Artificial neural network model development, evaluation, and optimization

Here, we used one of the most famous network algorithms, i.e., the feed forward back-propagation (three-layer back-propagation network) consisted of input, output, and hidden layers and considered in making the ANN model (Demuth et al., 2006). The transfer functions used for the hidden and output layers were hyperbolic tangent sigmoid (tansig) and linear (purelin) functions, respectively. For training the network, a Levenberg-Marquardt algorithm for back-propagation with a gradient descent and momentum weight and bias learning function was used (Demuth et al., 2006). Used performance function was MS error with 0.01 level and training was terminated after 800 epochs or iterations of the network. Four input variables of KNO3, NH4NO3, CaCl2, MgSO4, and KH2PO4 with different levels were used as units in the input layer of the ANN model. Five models were developed separately for SL, PR and Vitri, Chl, and STN. 600 and 450 data lines were used to train and test the network. Before training, the data set (input and output data) was normalized in the range of −1 to 1 so as to make simpler the problem for the network, to attain fast conjunction minimum mean square error, and to make sure that the fall of targets (output data) into the particular range of the new feed forward network can be recreated (Demuth et al., 2006; Gulati et al., 2010; Ahmadi and Golian, 2011). The fitness of the ANN-model was evaluated using R2, MSerror, and MBE (Ahmadi et al., 2007). In order to determine the optimal values of input variables (KNO3, NH4NO3, CaCl2, MgSO4, and KH2PO4requirements) and maximize SL and PR and minimize Vitri, Chl, and STN, the raised ANN models were exposed to a further process using GA, after the training practice. Thus, the ANN models were used as the fitness function for GA. A roulette wheel selection method was used for selecting elite populations for crossover. Initial population of 50, generation number of 500, mutation rate of 0.1, and crossover rate of 0.85 has been set to achieve the best fitness (Haupt and Haupt, 1998; The MathWorks., 2009). The generational practice was frequently performed to reach the number of generations. Through performing GA, the search for the optimal solutions was restricted between the input variable limits determined in the Taguchi design (Table 2). To recognize which input variable is more important in the model, the constructed ANN models were subjected to the process of the sensitivity analysis. This analysis shows which KNO3, NH4NO3, CaCl2, MgSO4, and KH2PO4 concentration is more important than the other to reach optimal SL, PR, Vitri, Chl, and STN of pear rootstock explants. The sensitivity of SL, PR, Vitri, Chl, and STN against the investigating media nutrients was determined using the criteria (Lou and Nakai, 2001; Ahmadi and Golian, 2010a,b) as follows: The variable sensitivity error (VSE) value: which indicates the performance of the developed ANN model if that variable is unavailable, The value of variable sensitivity ratio (VSR): indicates the relative ratio between the VSE and the error of ANN model when all variables are available. A more important variable has a higher VSR value. Thus, based on the obtained VSR value, the input variables may be ranked in the order of importance. Matlab R2010a (Matlab., 2010) software was used to write mathematical code to develop and evaluate the ANN-GA model. In point of fact, the developed program is a modified source code of an ANN algorithm which was formerly used by Ahmadi and Golian (2011).

Results and discussion

The growth of in vitro plant tissues can be controlled by altering the culture media nutrients. Optimization of the media mineral contents is very laborious and time-consuming, and therefore predicting the favorable composition of the growth media and the culture conditions is very useful in order to achieve maximum productivity.

Stepwise regression analysis

The stepwise selection method described here was used to evaluate the contributions of five minerals of culture media in the growth of in vitro pear rootstocks explants. These data were not previously analyzed by researchers in this area.

OHF rootstock

The stepwise regression model results are given in Table 3 (number of observations = 600). NH, Mg2+, and SO are important macro-nutrients influencing the Proliferation and NO, NH, Ca2+, K+, Mg2+, PO, and SOare important macro-nutrients for obtaining optimum SL. On the other hand, NO, K+, Mg2+, SO, and Cl− are important factors affecting STN, NO, NH, Ca2+, K+, Mg2+, PO, SO, and Cl− are important macro-nutrients influencing Chl and NO, Mg2+, PO, SO, and Cl− are important for explant Vitri phenomenon. As it is evident, Cl− is the only macro-nutrient that just plays role in features which decrease the quality of the obtained plantlet. So, Cl− plays a critical role in the culture medium and its appropriate amount should be further searched.
Table 3

Stepwise regression model of optimized nutrient media for different measured .

Measured factorVariableaParameter estimationStandard error
PROLIFERATION
Intercept13.550.19
NH4+–0.080.00
Mg2+0.990.07
SO42-–0.160.05
R20.39
RMSE1.02
MBE0.13
SL
Intercept1.160.26
NO3-0.350.05
NH4+–0.280.05
Ca2+0.070.03
K+–0.330.05
Mg2+–0.900.06
PO42-0.350.08
SO42-0.350.05
R20.44
RMSE0.79
MBE–0.04
STN
Intercept–24.182.35
NO3-0.780.05
K+0.710.08
Mg2+–14.530.86
SO42-5.180.52
Cl–3.010.31
R20.67
RMSE10.22
MBE0.05
CHL
Intercept–78.0514.97
NO3-313.3264.45
NH4+–313.1764.46
Ca2+–622.62128.76
K+–312.7164.46
Mg2+–318.5664.46
PO42-312.1064.38
SO42-314.4364.44
Cl621.96128.75
R20.72
RMSE3.53
MBE0.39
VITRI
Intercept–4.640.97
NO3-0.270.01
Mg2+–4.850.31
PO42-1.430.30
SO42-2.830.19
Cl–1.500.11
R20.54
RMSE3.67
MBE–0.15

Significant variable entered in the model. All variables left in the model are significant (p < 0.05).

Stepwise regression model of optimized nutrient media for different measured . Significant variable entered in the model. All variables left in the model are significant (p < 0.05).

Pyrodwarf rootstock

The stepwise regression model results are given in Table 4 (number of observations = 450). NH, Ca2+, K+, PO, and Cl−, are found to be important factors influencing proliferation and NO, NH, Mg2+, and Cl− are important for SL. NO, NH, Ca2+, K+, Mg2+, PO, and Cl−; NO, Mg2+, SO and Cl−; and NO, Mg2+, SO, and Cl− are important in the occurrence of STN, Chl, and Vitri phenomenon, respectively. Now, SO is the macro-nutrient that plays role in features of STN, Chl, and Vitri of plantlets. So here, SO plays a critical role in the culture medium and its appropriate amount should be further searched.
Table 4

Stepwise regression model of optimized nutrient media for different measured in vitro factors of Pyrodwarf pear rootstock.

Measured factorVariableaParameter estimationStandard error
PROLIFERATION
Intercept15.000.66
NO3-0.400.12
NH4+–0.520.12
Ca2+–4.360.28
K+–0.610.13
PO42-0.940.20
Cl4.590.25
R20.56
RMSE1.88
MBE1.41
SL
Intercept2.080.13
NO3-–0.030.00
NH4+0.060.01
Mg2+0.370.05
Cl0.100.02
R20.46
RMSE0.64
MBE0.49
STN
Intercept–29.691.10
NO3-–2.500.19
NH4+2.720.19
Ca2+14.200.43
K+2.860.20
Mg2+–0.870.23
PO42-–2.010.31
Cl–9.050.40
R20.89
RMSE2.91
MBE2.38
CHL
Intercept2.601.17
NO3-0.130.02
Mg2+–2.390.43
SO42-1.020.26
Cl–0.840.16
R20.17
RMSE4.48
MBE3.48
VITRI
Intercept–12.830.96
NO3-0.520.01
Mg2+–6.130.36
SO42-2.460.22
Cl–1.200.13
R20.77
RMSE3.69
MBE2.88

Significant variable entered in the model. All variables left in the model are significant (p < 0.05).

Stepwise regression model of optimized nutrient media for different measured in vitro factors of Pyrodwarf pear rootstock. Significant variable entered in the model. All variables left in the model are significant (p < 0.05).

Artificial neural network analysis

Neural network software recently has been successfully applied for finding the optimal plant culture conditions (Zielinska and Kepczynska, 2013). ANNs are progressively applied in elucidation and analysis of the data in plant tissue culture experiments. Gago et al. (2010) developed a neural model to analyze the effect of two variables of sucrose and light on the proliferation of kiwifruit micro-shoots (Actinidia deliciosa). Nezami Alanagh et al. (2014) suggested that the macronutrients content of the culture media cause differences in GF677 explant growth. So, we used the optimal architecture of the multi-layer perceptron neural network to model the effect of the ion concentrations on the growth parameters of Pyrus rootstocks. The predicted values and the optimization of explant growth parameters by the ANN-model are shown in Table 5. The comparison of observed and predicted outputs describes the behavior of the ANN-model from investigating inputs. The results revealed good agreements between the observed and the predicted values of explant growth parameters for training and testing sets (Table 6). The calculated statistics on the ANN-models are in close agreement to the two subsets in prediction of each output (statistics for both training and testing sets in Table 5). A well-trained ANN-model has a balance statistics values for these two subsets. This may suggest that over fitting has not occurred during the training process (Ahmadi and Golian, 2010b). The main advantage of ANN-model is that it does not require a prior specification of suitable fitting function thus; it has a universal approximation ability to approximate almost all kinds of non-linear functions. This flexibility feature may help the modeler to make a model with almost highest possible prediction accuracy.
Table 5

Optimization analysis on artificial neural network (ANN) model to reach maximum PR and SL and minimum STN, Chl, and Vitri in OHF and Pyrodwarf pear rootstocks.

ItemInput variable [Ion concentrations (mM)]Predicted output variable at optimal point
NO3-NH4+Ca2+K+Mg2+PO42-SO42-Cl
OHF
PR62.55.72.731.53.32.65.63.57.3
SL88.142.86.3402.32.24.64.95.5
STN13.312.35.522.82.41.61.32.50
Chl54.416.85.312.322.13.31.80
Vitri48.933.94.89.42.12.17.14.90
PYRODWARF
PR25.613.15.535.71.52.13.6311.4
SL86.537.54.225.93.22.71.25.25.04
STN20.9223.528.12.11.32.76.10.2
Chl54.814.72.545.10.72.80.96.70
Vitri24.56.66.118.82.31.84.11.20
Table 6

Statistics and information on artificial neural network models for number of shoots, SL, STN, Chl, and quality index of OHF and pyrodwarf rootstock during .

RootstockStatistics1Number of shootsSLSTNChlVitri
OHFTrainingTestingTrainingTestingTrainingTestingTrainingTestingTrainingTesting
R20.950.940.830.850.940.970.930.940.960.97
RMSE0.320.290.430.424.543.081.751.631.050.99
MBE–0.0009–0.025–0.00020.0070.0003–0.0750.00002–0.182–0.0002–0.067
PYRODWARF
R20.970.950.870.850.960.960.910.920.960.96
RMSE0.510.670.320.341.821.721.391.481.461.50
MBE0.00007–0.050.00040.0060.0002–0.203–0.00030.11–0.00020.27
Optimization analysis on artificial neural network (ANN) model to reach maximum PR and SL and minimum STN, Chl, and Vitri in OHF and Pyrodwarf pear rootstocks. Statistics and information on artificial neural network models for number of shoots, SL, STN, Chl, and quality index of OHF and pyrodwarf rootstock during .

Sensitivity analysis of the models

To determine the relative importance of input variables, the entire 27 data lines (training and testing) utilized to calculate the overall VSR for each plant growth parameter. The obtained VSR for the model output variables with respect to eight input variable are shown in Tables 7, 8.
Table 7

Importance of ion concentrations (mM) of the different culture media used for Pyrodwarf rootstock micro-propagation according to the sensitivity analysis on the developed neural network model to rank the importance of ion concentrations.

ElementVSRa
NO3-NH4+Ca2+K+Mg2+PO42-SO42-Cl
PR20.712.623.76.57.11.83.218.8
Rank24165873
SL7.110.77.73.57.945.96
Rank41382765
STN9.188.55.65.31.92.95
Rank13245876
Chl91.2317.650.190.999.271.820.4180.2
Rank41753682
Vitri49.779.614.625.97.911.315.512.8
Rank21538746

Relative indication of the ratio between the variable sensitivity error and the error of the model when all variables are available.

Table 8

Importance of ion concentrations (mM) of the different culture media used for OHF rootstock micropropagation according to the sensitivity analysis on the developed neural network model to rank the importance of ion concentrations.

ElementVSRa
NO3-NH4+Ca2+K+Mg2+PO42-SO42-Cl
PR90.5301.7127.9197.5150.418.5149.1113
Rank71623845
SL646428.432.517.82.710.214.6
Rank11324765
STN6.215.222.619.617.110.254.124.8
Rank86345712
Chl16.819.115.940.45.79.42737.3
Rank54618732
Vitri35.130.322.312.111.68.11.93.9
Rank12345687

Relative indication of the ratio between the variable sensitivity error and the error of the model when all variables are available.

Importance of ion concentrations (mM) of the different culture media used for Pyrodwarf rootstock micro-propagation according to the sensitivity analysis on the developed neural network model to rank the importance of ion concentrations. Relative indication of the ratio between the variable sensitivity error and the error of the model when all variables are available. Importance of ion concentrations (mM) of the different culture media used for OHF rootstock micropropagation according to the sensitivity analysis on the developed neural network model to rank the importance of ion concentrations. Relative indication of the ratio between the variable sensitivity error and the error of the model when all variables are available. A more important input variable has a higher VSR value. Thus, the investigating inputs can be ranked according to their importance of effect on outputs using VSR values (Tables 7, 8). Among the input variables, NH (301.7) and NO, NH (64), SO (54.1), K+ (40.4), and NO (35.1) in OHF and Ca2+ (23.7), NH (10.7), NO (9.1), NH (317.6), and NH (79.6) in Pyrodwarf had the highest values of VSR in data set, respectively, for PR, SL, STN, Chl, and Vitri. According to the obtained VSR values, SL was more sensitive to NO (64) and NH (64) followed by K+ (32.5), Ca2+ (28.4), Mg2+ (17.8), Cl− (14.6), SO (10.2), and PO (2.7) in OHF and NH (10.7) followed by Mg2+ (7.9), Ca2+ (7.7), NO (7.1), Cl− (6), SO (5.9), PO (4), and K+ (3.5) in Pyrodwarf.

Model optimization

The optimization analysis on the ANN model to maximize PR exhibited that media containing 62.5 mM NO, 5.7 mM NH, 2.7 mM Ca2+, 31.5 mM K+, 3.3 mM Mg2+, 2.6 mM PO, 5.6 mM SO, and 3.5 mM Cl could lead to optimal PR for OHF and optimal PR for Pyrodwarf may be obtained with media containing containing 25.6 mM NO, 13.1 mM NH, 5.5 mM Ca2+, 35.7 mM K+, 1.5/, mM Mg2+, 2.1 mM PO, 3.6 mM SO, and 3 mM Cl−. The optimal point for SL may be acquired with media containing 88.1 mM NO, 42.8 mM NH, 6.3 mM Ca2+, 40 mM K+, 2.3 mM Mg2+, 2.2 mM PO, 4.6 mM SO, and 4.9 mM Cl− for OHF rootstock and 86.5 mM NO, 37.5 mM NH, 4.2 mM Ca2+, 25.9 mM K+, 3.2 mM Mg2+, 2.7 mM PO, 1.2 mM SO, and 5.2 mM Cl− for Pyrodwarf rootstock. Results of our investigations showed that media including 13.2 mM NO, 12.3 mM NH, 5.5 mM Ca2+, 22.8 mM K+, 2.4 mM Mg2+, 1.6 mM PO, 1.3 mM SO, and 2.5 mM Cl− required for minimum STN in OHF and 20.9 mM NO, 22 mM NH, 3.5 mM Ca2+, 28.1 mM K+, 2.1 mM Mg2+, 1.3 mM PO, 2.7 mM SO, and 6.1 mM Cl− in Pyrodwarf. In OHF rootstock, media with 54.4 mM NO, 16.8 mM NH, 5.3 mM Ca2+, 12.3 mM K+, 2 mM Mg2+, 2.1 mM PO, 3.3 mM SO, and 1.8 mM Cl− could lead to the optimal point for Chl, whereas in Pyrodwarf rootstock the optimal point for Chl could be achieved with media supplemented with 54.8 mM NO, 14.7 mM NH, 2.5 mM Ca2+, 45.1 mM K+, 0.7 mM Mg2+, 2.8 mM PO, 0.9 mM SO, and 6.7 mM Cl−. Finally, The optimization results of ANN-GA models revealed that media containing 48.9 mM NO, 33.9 mM NH, 4.8 mM Ca2+, 9.4 mM K+, 2.1 mM Mg2+, 2.1 mM PO, 7.1 mM SO, and 4.9 mM Cl− in OHF and 24.5 mM NO, 6.6 mM NH, 6.1 mM Ca2+, 18.8 mM K+, 2.3 mM Mg2+, 1.8 mM PO, 4.1 mM SO, and 1.2 mM Cl− in Pyrodwarf could lead to optimal Vitri. Gago et al. (2010) developed a neural model to analyze the effect of two variables: sucrose and light on the proliferation of kiwi fruit microshoots (Actinidia deliciosa). Nezami Alanagh et al. (2014) found that the macronutrients content seems to be responsible for the observed differences in GF677 explant growth. So we used the optimal architecture of the multi-layer perceptron neural network to model the effect of the ion concentrations on the growth parameters of Pyrus rootstocks that was suggested by “intelligent problem solver” was found with eight inputs, five outputs (with linear activation function), and 10 hidden neurons (with hyperbolic tangent activation function). A training algorithm of Quasi–Newton was used to train the network (Lou and Nakai, 2001). The optimization of the architecture by the intelligent problem solver was performed on the basis of the “balance error against diversity” option. This option tries to produce a structure with a balance performance value against type and diversity. It will preserve networks with a range of types and performance/ complexity trade-offs. This may led to obtain an optimized ANN-model with less complexity and more accuracy (Tahmoorespur and Ahmadi, 2012). The ANN-model was successfully used to describe associations between investigating 8 macronutrients and explant growth parameters. The sensitivity analysis on the ANN-model indicated that NH and NO in OHF and Ca2+ and NH in Pyrodwarf are the most important variables respectively in the PR and SL. SO, K+ and NO in OHF and NO, NH, and again NH in Pyrodwarf are the most important variables respectively in STN, Chl, and Vitri. Our results indicated that there are differences in explant responses to macronutrient concentrations in different pear rootstock genotypes. Improved explant growth in OHF required increased NH in combination with low SO and K+. NO is critical for OHF since despite increasing its concentration can improve SL but it causes Vitri disorder if it increases more than a critical point (Table 5). High Ca2+ and low NO are required for improved explant growth in Pyrodwarf but now, NH concentration is critical which increasing can cause explant Chl and Vitri. So, it can be suggested that the use of ANN-base model analyses allows us to realize the best macronutrient concentrations required to maximize the explant growth parameters like PR and SL and minimize the explant physiological disorders like STN, Chl, and Vitri which were investigated in the present study.

Comparison of ANN-GA and stepwise regression models

For output variables (PR, SL, STN, Chl, and Vitri) the calculated statistical values corresponding to the ANN-GA revealed a substantially higher accuracy of prediction than for regression models (as calculated R2 for ANN-GA vs. regression models were: PR = 0.94 vs. 0.39, SL = 0.85 vs. 0.44, STN = 0.97 vs. 0.67, Chl = 0.94 vs. 0.72, Vitri = 0.96 vs. 0.54 for OHF, and PR = 0.95 vs. 0.56, SL = 0.85 vs. 0.46, STN = 0.96 vs. 0.89, Chl = 0.92 vs. 0.17, Vitri = 0.96 vs. 0.77 for Pyrodwarf). According to the ANN-GA results, among the input variables, NH (301.7) and NO, NH (64), SO (54.1), K+ (40.4), and NO (35.1) in OHF and Ca2+ (23.7), NH (10.7), NO (9.1), NH (317.6), and NH (79.6) in Pyrodwarf have the highest values of VSR in data set, respectively, for PR, SL, STN, Chl, and Vitri. The ANN-GA showed that media containing 62.5 NO, 5.7 NH, 2.7 Ca, 31.5 K+, 3.3 Mg2+, 2.6 PO, 5.6 SO, and 3.5 Cl− could lead to optimal PR for OHF and optimal PR for Pyrodwarf may be obtained with media containing containing 25.6 NO, 13.1 NH, 5.5 Ca2+, 35.7 K+, 1.5 Mg2+, 2.1 PO, 3.6 SO, and 3 Cl−. In order to develop an optimized protocol, it is important to use a reliable modeling system to reach optimal growth and productivity. There is much statistical software for optimizing the growth medium for in vitro plant culture (Gago et al., 2010; Gallego et al., 2011). Response surface method (RSM) is one of the software that has been repeatedly used to optimize growth medium for in vitro culture of pear genotypes (Reed et al., 2013a,b; Wada et al., 2013, 2015). Previous studies detected that ANN-GA models had a substantially higher accuracy of prediction than RSM models (Sedghi et al., 2012). Moghri et al. (2015) indicated that RSM alone is not trustworthy for approximation of non-polynomial or non-linear variables. Additionally, it has been shown that GA is easy, precise and efficient method (Moghri et al., 2015), which can be helpful for establishing an optimized culture medium. Neural models have been developed for modeling the effect of different culture conditions of plant tissue culture on explant growth such as sucrose and light (Gago et al., 2010) and macro-nutrients content (Nezami Alanagh et al., 2014). Several investigations have revealed that high concentrations of plant growth regulators (PGRs) cause somatic variations (Karp, 1992; Martin et al., 2006). Additionally, some authors have reported that PGRs (especially cytokinins) can cause STN in several woody plant species (Kataeva et al., 1991; Piagnani et al., 1996). The effectiveness of the media optimization for the reduction of essential PGRs was investigated in several studies (Preece, 1995). Optimal nutrient media is required for appropriate explant growth. N is considered of the critical nutrients for explant growth which is mainly supplied as nitrate or ammonium in the culture media (Engelsberger and Schulze, 2012). The type and amount of supplied N may be genotype dependent. Clearly, nitrate is the suitable kind of supplied N for most plant species, and it is the accessible form of N in most in vitro media (Sathyanarayana and Blake, 1994; Ivanova and Van Staden, 2009; Nezami Alanagh et al., 2014). The optimization analysis on the ANN model showed that NO is important for OHF explant growth since regardless of increasing its concentration it can improve growth parameters (Reed et al., 2013a,b). This indicates that NO is needed in amounts higher than its content in MS medium for the best growth of OHF explant. Similarly, some investigations showed that high amounts of NO are required for improving shoot multiplication and length (Shirdel et al., 2011; Hand et al., 2014). Also, Bell et al. (2009) and Mamaghani et al. (2010) both reported that low N content in culture media caused some physiological disorders in several pears. On the contrary, low NO improves some growth factors in Pyrodwarf but pear genotypes react differentially in this regard (Wada et al., 2015). In both studied rootstocks, increase in NO more than a critical range will cause STN disorder (Tables 7, 8). This finding corresponds to those studies which suggested that reducing salts concentrations by changing culture medium from MS to WPM or half-strength MS (1/2MS), decreased STN (Grigoriadou et al., 2000; Bairu et al., 2009; Jain et al., 2009). Conversely, Reed et al. (2013a,b) noted that high amounts of N compounds improved STN in some pear species. The sensitivity analysis on the ANN-GA model revealed that NH is a key nutrient in the propagation of pear genotypes. Results showed that shooting is sensitive to high NH concentrations. High NH concentrations significantly diminished the mean number of shoot per explant. This may be due to the significant inhibitory effects of NH on other ionś uptake (Gerendás et al., 1997; Lorenzo et al., 2000). Moreover, some investigations suggested that high amounts of NH adversely effect on plant metabolism causing to physiological and morphological disorders. Previously, negative effect of high NH on shoot elongation has been reported in few studies (Gamborg and Shyluk, 1970). Conversely, in our study, the high NH was not associated with shoot length reduction. It has been proved that high concentrations of NH induce Vitri in some plant species (Ivanova and Van Staden, 2008; Gago et al., 2011; Reed et al., 2013a,b). This may be due to the fact that high amount of NH induces ethylene production in the culture media (George, 1993). (Gaspar, 1991) concluded that increasing the ethylene owing to raising the concentration of NH could prompt a series of events leading to Vitri. It has been believed that the toxic effects of high NH concentrations increase the activity of glutamate dehydrogenase which in turn, cause a shift in carbohydrate pool from lignin synthesis to amino acid synthesis (Beauchesne, 1981), leading to Vitri (Letouzé and Daguin, 1983; Brand, 1993). The opposite response was found for Pyrodwarf as several investigations reported no Vitri on shoots grown on high levels of NH in culture media (Nezami Alanagh et al., 2014; Wada et al., 2015). Our results showed that high concentrations of NH and amounts of Cl− and K+ in the culture medium were the most important factors influencing explant Chl of studied pear rootstocks. This conclusion is in agreement with Perez-Tornero et al. (2001) who found that Chl could be the result of high NH concentrations. From these results, it is confirmed that NH concentrations has a strong effect on micro-propagation of pear rootstocks. Ca2+ is a relatively large essential cation for cation-anion balance in plant tissues (Martin et al., 2007). Shacklock et al. (1992) and Hepler (2005) both concluded that Ca2+ has a significant role on physiological and developmental processes. It is clearly evident that Ca2+ is a key element in the structure and physiological properties of cell membranes (Sha et al., 1985; Hirschi, 2004). Also, it plays an important role in the synthesis and activity of several crucial enzymes (George, 1993). Studies on some plants showed that Ca2+ is an essential factor for protocorm formation (Mitra et al., 1976), adventitious bud formation (Tanimoto and Harada, 1986), increase the mean number of somatic embryos (Jansen et al., 1990), somatic embryogenesis (Timmers et al., 1996), formation of meristemoids (Capitani and Altamura, 2004), and facilitated the uptake of some nutrients (Aranda-Peres et al., 2009). These facts show that why Ca2+ is critical for improving some disorders in plants (Singha et al., 1990) and is necessary for plant growth and development. In agreement with our findings, in several studies have been demonstrated that high Ca2+ concentrations ameliorate the STN disorder (Wang and van Staden, 2001; Chang and Miller, 2005; Martin et al., 2007; Bairu et al., 2009). Similar to the findings of those results, ANN-GA models revealed that high concentrations of Ca2+ are required for optimum growth and development of pear genotypes (Tables 7, 8). Nevertheless, this is not often true so that some studies have reported that high concentrations of Ca2+ increase the STN percentage in some pear genotypes (Grigoriadou et al., 2000; Thakur and Kanwara, 2011). It is evident that ANN-GA models clearly illustrate the independent role of K+ in micro-propagation of pear rootstocks (Tables 7, 8). The results show that high concentrations of K+ is necessary for increasing shoot multiplication, shoot elongation and relieving the STN disorder in both studied rootstocks. It might be due to the important function of K+ in protein synthesis and maintenance of sufficient turgor for growth (Leigh and Wyn Jones, 1984). Our results are contradictory with Ramage and Williams (2002) who noted that low levels of K+ are required for plant growth and differentiation. Also, the present results showed that high K+ concentration lead to explant Vitri in both rootstocks. In opposition, Pasqualetto et al. (1988) showed that Vitri increased with low levels of K+.

Conclusion

The ANN-model was successfully used to describe associations between investigating eight macro-nutrients and explant growth parameters. The sensitivity analysis on the ANN-model indicated that NH and NO in OHF and Ca2+ and NH in Pyrodwarf are the most important variables respectively in the PR and SL. SO, K+ and NO in OHF and NO, NH and again NH in Pyrodwarf are the most important variables respectively in STN, Chl, and Vitri. Our results indicated that there are differences in explant responses to macronutrient concentrations in different pear rootstock genotypes. High Ca2+ and low NO are required for improved explant growth in Pyrodwarf but now, NH concentration is critical which increasing can cause explant Chl and Vitri. Improved explant growth in OHF required increased NH in combination with low SO and K+. NO is critical for OHF since despite increasing its concentration can improve SL but it causes Vitri disorder if it increases more than a critical range. So, it can be suggested that the use of ANN-base model analyses allows us to realize the best macronutrient concentrations required to maximize the explant growth parameters like PR and SL and minimize the explant physiological disorders like STN, Chl, and Vitri which were investigated in the present study.

Author contributions

All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.

Conflict of interest statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
  13 in total

1.  Artificial neural network-based predictive model for bacterial growth in a simulated medium of modified-atmosphere-packed cooked meat products.

Authors:  W Lou; S Nakai
Journal:  J Agric Food Chem       Date:  2001-04       Impact factor: 5.279

2.  Applications of neural networks to recovery of biological products.

Authors:  P R Patnaik
Journal:  Biotechnol Adv       Date:  1999-11       Impact factor: 14.227

Review 3.  Calcium: a central regulator of plant growth and development.

Authors:  Peter K Hepler
Journal:  Plant Cell       Date:  2005-08       Impact factor: 11.277

Review 4.  Artificial neural networks: opening the black box.

Authors:  J E Dayhoff; J M DeLeo
Journal:  Cancer       Date:  2001-04-15       Impact factor: 6.860

5.  Response surface and neural network models for performance of broiler chicks fed diets varying in digestible protein and critical amino acids from 11 to 17 days of age.

Authors:  H Ahmadi; A Golian
Journal:  Poult Sci       Date:  2011-09       Impact factor: 3.352

6.  The integration of broiler chicken threonine responses data into neural network models.

Authors:  H Ahmadi; A Golian
Journal:  Poult Sci       Date:  2010-11       Impact factor: 3.352

7.  The culture of plant cells with ammonium salts as the sole nitrogen source.

Authors:  O L Gamborg; J P Shyluk
Journal:  Plant Physiol       Date:  1970-05       Impact factor: 8.340

8.  Growth analysis of chickens fed diets varying in the percentage of metabolizable energy provided by protein, fat, and carbohydrate through artificial neural network.

Authors:  H Ahmadi; A Golian
Journal:  Poult Sci       Date:  2010-01       Impact factor: 3.352

9.  Calcium increases the yield of somatic embryos in carrot embryogenic suspension cultures.

Authors:  M A Jansen; H Booij; J H Schel; S C de Vries
Journal:  Plant Cell Rep       Date:  1990-08       Impact factor: 4.570

10.  Nitrate and ammonium lead to distinct global dynamic phosphorylation patterns when resupplied to nitrogen-starved Arabidopsis seedlings.

Authors:  Wolfgang R Engelsberger; Waltraud X Schulze
Journal:  Plant J       Date:  2012-01-20       Impact factor: 6.417

View more
  14 in total

1.  Development of support vector machine-based model and comparative analysis with artificial neural network for modeling the plant tissue culture procedures: effect of plant growth regulators on somatic embryogenesis of chrysanthemum, as a case study.

Authors:  Mohsen Hesami; Roohangiz Naderi; Masoud Tohidfar; Mohsen Yoosefzadeh-Najafabadi
Journal:  Plant Methods       Date:  2020-08-13       Impact factor: 4.993

2.  Analysis of nutrient deficiencies affecting in vitro growth and development of Eucalyptus dunnii Maiden.

Authors:  Gustavo Pedro Javier Oberschelp; Antônio Natal Gonçalves
Journal:  Physiol Mol Biol Plants       Date:  2018-06-07

3.  Artificial Neural Network Genetic Algorithm As Powerful Tool to Predict and Optimize In vitro Proliferation Mineral Medium for G × N15 Rootstock.

Authors:  Mohammad M Arab; Abbas Yadollahi; Abdolali Shojaeiyan; Hamed Ahmadi
Journal:  Front Plant Sci       Date:  2016-10-19       Impact factor: 5.753

4.  Mathematical Modeling and Optimizing of in Vitro Hormonal Combination for G × N15 Vegetative Rootstock Proliferation Using Artificial Neural Network-Genetic Algorithm (ANN-GA).

Authors:  Mohammad M Arab; Abbas Yadollahi; Hamed Ahmadi; Maliheh Eftekhari; Masoud Maleki
Journal:  Front Plant Sci       Date:  2017-11-01       Impact factor: 5.753

5.  Development of an Artificial Neural Network as a Tool for Predicting the Targeted Phenolic Profile of Grapevine (Vitis vinifera) Foliar Wastes.

Authors:  Maliheh Eftekhari; Abbas Yadollahi; Hamed Ahmadi; Abdolali Shojaeiyan; Mahdi Ayyari
Journal:  Front Plant Sci       Date:  2018-06-19       Impact factor: 5.753

6.  High throughput mathematical modeling and multi-objective evolutionary algorithms for plant tissue culture media formulation: Case study of pear rootstocks.

Authors:  Saeid Jamshidi; Abbas Yadollahi; Mohammad Mehdi Arab; Mohammad Soltani; Maliheh Eftekhari; Jalal Shiri
Journal:  PLoS One       Date:  2020-12-18       Impact factor: 3.240

Review 7.  Shoot tip necrosis of in vitro plant cultures: a reappraisal of possible causes and solutions.

Authors:  Jaime A Teixeira da Silva; Esmaeil Nezami-Alanagh; María E Barreal; Mafatlal M Kher; Adhityo Wicaksono; Andrea Gulyás; Norbert Hidvégi; Katalin Magyar-Tábori; Nóra Mendler-Drienyovszki; László Márton; Mariana Landín; Pedro Pablo Gallego; John A Driver; Judit Dobránszki
Journal:  Planta       Date:  2020-09-03       Impact factor: 4.116

8.  Modeling and Optimizing a New Culture Medium for In Vitro Rooting of G×N15 Prunus Rootstock using Artificial Neural Network-Genetic Algorithm.

Authors:  Mohammad Mehdi Arab; Abbas Yadollahi; Maliheh Eftekhari; Hamed Ahmadi; Mohammad Akbari; Saadat Sarikhani Khorami
Journal:  Sci Rep       Date:  2018-07-02       Impact factor: 4.379

9.  Combining gene expression programming and genetic algorithm as a powerful hybrid modeling approach for pear rootstocks tissue culture media formulation.

Authors:  Saeid Jamshidi; Abbas Yadollahi; Mohammad Mehdi Arab; Mohammad Soltani; Maliheh Eftekhari; Hamed Sabzalipoor; Abdollatif Sheikhi; Jalal Shiri
Journal:  Plant Methods       Date:  2019-11-18       Impact factor: 4.993

10.  Forecasting and optimizing Agrobacterium-mediated genetic transformation via ensemble model- fruit fly optimization algorithm: A data mining approach using chrysanthemum databases.

Authors:  Mohsen Hesami; Milad Alizadeh; Roohangiz Naderi; Masoud Tohidfar
Journal:  PLoS One       Date:  2020-09-30       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.