An IT2FS-PT 3 based emergency response plan evaluation with MULTIMOORA method in group decision making.

The eruption of COVID-19 at the beginning of 2020 has sounded the alarm, making experts pay more attention to public health emergency events. A suitable emergency response plan plays a vital role in handling emergency events. Therefore, this paper focuses on the evaluation of emergency response plans among a set of group in the comprehensive prospect, and an emergency decision making method integrated with the interval type-2 fuzzy information based on the third generation prospect theory ( PT 3 ) and the extended MULTIMOORA method is proposed. Individuals express their preferences using some given linguistic terms set. Furthermore, considering the conflicts may occur in the group, a convergent iterative algorithm is designed for group consensus reaching. Then, the stochastic multi-criteria acceptability analysis (SMAA) method and the Borda Count (BC) method are generated to combine the results instead of the dominance theory in MULTIMOORA system. Finally, based on the background of the COVID-19 pandemic from Wuhan, a case study about the selection of emergency response plan and the corresponding sensitivity and comparative analysis are exhibited to explain the effectiveness of the proposed method.

Introduction

Emergency events refer to any situation arising from sudden and unforeseen catastrophe that may cause casualties, economic losses, environmental damage, and serious social harm [1]. In China, kinds of emergency events have had severely negative impact on people’s life and social development, especially for the public health emergency events, e.g. the outbreak of SARS in 2003, the Wenchuan Earthquake in Sichuan, China on May 12, 2008. Recently, the new corona virus (COVID-19) in the end of 2019 caused huge loss of lives and properties. More seriously, the confirmed and suspected cases of COVID-19 have been increasing without ending not only in Wuhan, Hubei Province, but also China and the world. As early as January 30, 2020, the World Health Organization (WHO) announced COVID-19 as the eruption a public health emergency of international concern. In the meanwhile, China declared a travel quarantine of Wuhan and other 16 cities, encompassing a population of 45 million [2]. By October 18, 2021, a total of 4,512 fatalities and 68,303 laboratory-confirmed cases had been reported in Hubei Province. With the continuous exponential increase of the number of pandemic cases, the Chinese government has taken powerful preventive measures followed by the highest level of class A infectious diseases based on the Law of the People’s Republic of China on Prevention and Treatment of Infectious Diseases (LPTID) [3]. China has imposed strict restrictions on public activities containing a large number of people, thus reducing the possibility of virus transmission, which exists a negative impact on economy development and caused the unemployment on a certain scale.

Therefore, researchers proposed the corresponding emergency response plans to minimize destructive consequences for people’s healthy life and the normal development of society. Apparently, decision makers (DMs) from emergency department are supposed to select the suitable and desirable emergency response plan when tacking with these devastating hazards. Generally speaking, the assessments of emergency response plans are complicated, owing to the uncertain and partial information of the catastrophic scenarios and the multi-perspectives of DMs. Hence, many researchers have focused on this topic and made great contributions [1], [4], [5], [6], [7], [8], [9]. For instance, Hämäläinen et al. [1] used a multi-attribute utility theory analysis in a simulated nuclear emergency, Levy and Taji [4] discussed the hazard planning and emergency management in the group analytic network process (GANP). Ferreira et al. [5] presented a new urban fire emergency plan assessment method using the integrated geographical information system (GIS) tool. Shamim et al. [6] integrated the Delphi technique with a mathematical model to qualify the performance of emergency planning response (EPR) in a real case of a major accident in the process industry. Liu et al. [9] dealt with the decision making in emergency response plans about the simulation of H1N1 infectious diseases based on Fault Tree Analysis. These studies mentioned above provided various decision making methods for the selection of the optimal emergency response plan. Whereas, in the existing literatures about emergency response plans evaluation, the characteristics of the DMs are seldomly considered. It is worth noting that the decision making process in emergency events tend to be vague and uncertain due to the inadequate information. A substantial body of psychological studies on human behaviors show that DMs incline to express the reference dependence, preference reversal and other typical characteristics in the circumstance of fuzzy and uncertain events [10], [11], [12], [13]. Hence, the psychological behaviors of DMs should be taken into consideration.

Since, Kahneman and Tversky [10] introduced the alternative model, named prospect theory (PT) to replace the expected utility theory considering human behaviors, the behavioral decision making theories showed rapid development, such as the regret theory [14]. Afterwards, they extended the original PT called cumulative prospect theory (CPT) with using the cumulative decision weights [12], inspired by the rank and sign dependent utility(RSDU) by Luce and Fishburn [15]. Then, Schmidt et al. [13] founded that both PT and CPT have a common limitation: the reference points in the prospects are supposed to be certainties, which cannot be applied to solve this type of situations: DMs purchased lotteries and had the chance to sell or exchange them. Hence, they expanded these theories and proposed the third generation prospect theory (), which retained the power of previous version of PT and increased new proposals: the value-maximal buying prices (WTP) and minimal selling prices (WTA). It is easy to see that has the wider range to solve various decision making problems in risk and uncertain environment [16], [17], [18]. For instance, Wang et al. [17] constructed the three-way decision model based on and Z-numbers to solve the task assessment in human–machine collaboration. Feng et al. [18] applied to illustrate the reduced demand of U.S. corn and soybean producers. Thus, the idea to incorporate into the assessments of emergency response plans deserves more attention. Simultaneously, one should consider the features of public health emergency events affected by time series. The consequences caused by COVID-19 are changed over time. Wuhan switched from a high-risk area in March into a low-risk area in June. Hence, the time factor is supposed to be considered for the formation and updating of dynamic reference points. We introduce the prediction method of reference points in the time line referred in [19], which proposed a parsimonious formula to predict reference points.

Furthermore, in a real emergency scenario, DMs often face the incomplete and fuzzy information, which means DMs prefer to make judgments on linguistic terms than single numbers in the complex situations. Then type-2 fuzzy sets (T2FSs) is regarded as the ideal tool to qualify terms, which offers capabilities to handle higher level uncertain problems. In light of the computational complexity mathematical calculation, researchers intend to choose interval type-2 fuzzy sets (IT2FSs), known as the special type of T2FSs [20], [21], [22], [23], [24], [25], [26], which are characterized by the membership values of numerical intervals, the benefits of IT2FSs can be summarized as: IT2FSs are the extension of type-1 fuzzy sets (T1FSs), they can handle higher degrees of uncertainty and ambiguity when the preference information expressed linguistically. Moreover, IT2FSs are relatively simpler among the higher order fuzzy sets [22]. As a result, in this proposed model, the linguistic terms set in the form of IT2FSs is served as the evaluation systems for DMs. Meanwhile, the evaluation of emergency response plans by a set of DMs can be viewed as multiple criteria group decision making (MCGDM) process. Some integrated hazard assessments using GANP [4], fuzzy analytic hierarchy process (FAHP) [27], multiple multi-objective optimization by ratio analysis (MULTIMOORA) [28] and other multi-criteria decision making (MCDM) methods see in [27], [29]. Among these approaches, MULTIMOORA, initially introduced by Brauers and Zavadska [30], is an effective decision making method for the benefits of computational time, the simplicity and stability for mathematical calculations [31]. There are wide applications of MULTIMOORA method, for instance, the green supply chain management [32], healthcare management [33] and other field referred in [34]. Since [30] first proposed the Multi-Objective Optimization by Ratio Analysis (MOORA) method, which contained two major parts: Ratio System (RS) and Reference Point Theory (RPT). Afterwards, the Full Multiplicative Form (FMF) method is considered, then the MULTIMOORA (MOORA plus FMF) method is constructed in [35], which derives the three subordinate rankings. At present, there are abundant ranking aggregation techniques to fuse these results [24], [32], [36], the dominance theory is the classical integration tool in the initial MULTIMOORA method [35]. Furthermore, other aggregation tools are proposed to take place the theory which emerge the better robustness. For instance, Celik et al. [24] applied the dominance directed graph, rank position method and the Borda Count (BC) method [37] to integrate the three results. Besides using the improved BC method as the fusion tool, Mi et al. [32] applied the stochastic multi-criteria acceptability analysis (SMAA) to increase the stochastic uncertain factors for the input of MULTIMOORA. The more fusion tools on MULTIMOORA method refer to Ref. [36]. Inspired by these above studies, we choose the improved BC method to aggregate the three subordinate methods, instead of adding the rankings of these three methods directly, we consider the integration of the utility values, which are based on the cardinal numbers and further conform the Arrow’s opinion [38], that is, a cardinal utility implies an ordinal preference but not vice versa. Besides, considering the advantages of SMAA in dealing with uncertain problems, we introduce the combination of SMAA and MULTIMOORA by disturbing the weights of criteria. SMAA is an efficient method to deal with decision problems where little or no weight information is available, which is suitable to assist DMs for tackling the corresponding criteria weights of emergency response plans. The detailed content on SMAA refers to Refs. [39], [40], [41]. Hence, in this study, owing to the randomness and contingency of emergency events, we integrate SMAA method with MULTIMOORA method to form the extended MULTIMOORA method to deal with the issue of information uncertainty in the assessment of emergency response plans.

Furthermore, in the evaluation process of emergency response plans, all DMs should reach consensus to avoid conflicts and obtain higher-quality decision result with timely feedback [4], [42]. Generally, there are two steps to reach group consensus: (i) aggregate individual decision information into a group decision result, and (ii) verify whether the result have reach consensus, if not, use the relative algorithm to modify the group decision result. Moreover, different distance functions are usually applied to reflect consensus measures in [43], [44]. In this paper, a standard Euclidean-based distance measurement is proposed to calculate the degree of group consensus. Simultaneously, the distance threshold is given as referred to Refs. [43], [45] and the corresponding convergent iterative algorithm is put forward to modify the group decision result. Hence, on the basis of considering group consensus, we combine the IT2FSs, , and the extended MULTIMOORA method to construct the evaluation system of emergency response plans in the group set. Then a novel IT2FS- with the extended MULTIMOORA method in a group emergency response plan evaluation is proposed.

To emphasize the reasons for the novel combination of IT2FS, and MULTIMOORA method, it can be illustrated as follows: considering that it is difficult to acquire enough essential information in real emergency events and the evolution of diseases is hard to estimate. Thus, it is unreasonable for DMs to assign the accurate numerical assessments to the emergency response plans. Hence, we apply the linguistic terms to assist DMs to make evaluations with IT2FSs served as the quantitative tool. In the meanwhile when dealing with catastrophes, has a good performance in dealing with the subjectivity of decision making process. Furthermore, the dynamic reference points suit well to the timeliness of emergency events. In the end, it is vital to choose an effective MCDM method and the reasonable establishment of the relative criteria weight due to the huge pessimistic impact brought by emergency events, the MULTIMOORA method is more robust and objective from integrating three utility functions than other MCDM methods, such as AHP in [46], TOPSIS in [46], VIKOR in [47], etc. In addition, SMAA method can be used with uncertain criteria preference information [41].

Based on the above discussion, the major contributions of the proposed model can be summarized as follows.

We take into consideration the personality characteristics of DMs, then introduce the combined the extended MULTIMOORA method to make assessments to the emergency response plans. In detail, we associate the time line with the setting of dynamic reference points, which is in line with time factor of emergency events and the SMAA method is applied to randomize the criteria weight to increase the stability and robustness of the final ranking results.

We apply the linguistic evaluation matrix to make DMs more flexible in expressing their preferences, and for the qualification of the IT2FSs-based linguistic terms in , there are six possible cases to construct the corresponding prospect matrix. Meanwhile, we design a standard Euclidean-based distance formula to measure the level of agreement between the individuals and the group, the relative convergent consensus iterative algorithm is given as well.

We present an emergency response plan assessments case based on COVID-19 erupted in Wuhan, China. The corresponding risk states can be referred from Wuhan Municipal Health Commission (wjw.wuhan.gov.cn), which further illustrates the effectiveness and practicality of this method.

The remainder of this paper is arranged as follows. Section 2 briefly exhibits the knowledge about IT2FSs, and the extended MULTIMOORA method. Section 3 describes the main model of this paper and the solution procedures of the optimal emergency response plan selection. Section 4 gives a case study on COVID-19 infectious diseases to demonstrate the feasibility of this proposed model. In the meanwhile, sensitivity analysis and comparative analysis are taken into consideration as well. Section 5 presents a further discussion. Finally, Section 6 summarizes conclusions, limitations, and future studies.

Preliminaries

In this section, the basic concepts about IT2FSs, and the extended MULTIMOORA method are briefly discussed.

Interval type-2 fuzzy sets

IT2FSs, served as a kind of special T2FSs have a wider application for its computational simplicity [48]. The important associated concepts are given as below.

[49]

. Let be a general T2FS, characterized by type-2 membership function (MF) in the universe of discourse it can be expressed as follows. where is the primary MF, satisfied , stands for the secondary MF with and represents the union contained all admissible and .

. If all then, an IT2FS can be expressed as follows.

where Fig. 1 displays an example of IT2FS MF in a 3-D plane, which the construction of IT2FS is intuitively presented, and the lower MF (LMF) and upper MF (LMF) of the IT2FS are type-1 MF, respectively.

Fig. 1

An example of the IT2FS MF in a 3-D plane.

[50]

. Let and be the left and right end-points of the centroid of an IT2FS satisfying the following equations. and where , is the value of MF IT2FS, is the value of LMF of the IT2FS and denotes the UMF, which can be seen in Fig. 1. We can find the optimal values of and by KM algorithm, for the detail procedures about KM algorithm see in [51].

In order to better understand the operation mechanism of IT2FSs, there exhibits a numerical example for illustration with its MFs in Fig. 1: The IT2FS (, ) , where and are the TIFSs, and are the reference points of on axis, and represent the membership values in the LMF and UMF respectively. In Fig. 1, , , , , , , and .

Third generation prospect theory

There are some prerequisites about are given as follows.

[13]

. Let be a finite state space, containing the states be the objective probability set associated with , is the result of state under probability , be the set of all acts, and acts are the functions from to , satisfied , , where is the reference act of , the value function used in the can be expressed in the following form. where the parameters and are strictly positive, and associated with the curvature of the value functions of gain and losses, is the risk-aversion parameter, which controls the DMs’ attitudes to gain and loss.

[19]

. Let be the time series set, be the outcome set in the time line, and be the relative weight function of outcome . The reference point in period can be calculated in the following form. where is a built-in parameter, the estimate value of in [19] is 5.2. And , represents the weight information of time, which can be expressed as a weighting function and Eq. (6) can be in the following form as well. where the weight function can be any continuous and increasing function with and . Through the experiments in [19], the specific form of is represented in Eq. (8). where the value of is 0.2 and 0.26, the value of is 0.9, 1.7 and 2.1, from Fig. 2, it can be intuitively see that the shape of is reverse S-shaped, with steep sides and quite flat in the middle and the parameter determines the curvature of , while the parameter controls the elevation of .

Fig. 2

Curve of where .

. Let be the number of the states of weak gains, be the total number of states and be the number of the states of strict loss. The decision weight function assigned to state when is evaluated from in can be represented as follows. where is the probability weight function for the gain domains and is the probability weight function for loss domains, according to the Ref. [11], the form of and are denoted as follows. where and are model parameters controlling the shape of the weighting function.

For any , pair, there is a weak gain in a state if , and a strict loss if .

. Let be the set of weak gains, denotes the strict loss. The prospect value of can be expressed as follows.

Thus, the function can be applied to construct the prospect value matrix of each DM.

The extended MULTIMOORA method

In this subsection, the major part in MULTIMOORA method is presented. Furthermore, the SMAA method [39] and BC method [37], [52] are applied to replace the dominance theory to determine the final ranking results, where the BC method is named and proposed by the French mathematician and physicist Jean-Charles de Borda [53], which is inspired the voting paradox first introduced by Condorcet [54]. BC method can be regarded as the generalization of the majority-voting rule. To a certain degree, it can be defined as a mapping from individuals ranking results to the integrated ranking result to the most relevant decision.

There are the decision matrix for alternative set and the criteria set with its corresponding weight set and , where is the evaluation value of alternative on the criteria . Then standardization is completed in the form [55]. After that, where and respectively denote the numbers of benefit criteria and cost criteria, the parameter represents the normalized evaluation of alternative related to all objectives. The optimal alternative under RS can be acquired as

The first step is to find the reference point for each alternative using the standardized data obtained by Eq. (13), then the reference point can be defined as follows. Based on this, a Tchebycheff Min–Max metric to calculate the deviation between the assessment value of each alternative and the reference point in Eq. (17) as below. where and the optimal alternative in reference point theory can be obtained as

The utility value of the alternative can be written as follows. where stands for the product of evaluation value of all benefit criteria and is the product of the evaluation values of all cost criteria. After that, the optimal alternative under the MFM method can be expressed as .

After the establishment of the ranking results of the three subordinate methods, it is need to aggregate these results to obtain the final rankings, all of these methods in MULTIMOORA are non-correlated objectives [56]. The original dominance theory determines the overall rankings by integrating the subordinate rankings, when the number of alternatives is in a small scale, the original dominant theory can quickly obtain the overall rankings. However, in the large amount of alternatives, its operation efficiency will reduce. Furthermore, it fails to consider the utility value of each alternative in the three methods. Based on these analysis, BC method as a substitute for aggregation of the results. The vector normalization method in Eq. (13) is used to normalize the three sub utility values, which proved to be the suitable choice for normalization [55]. The aggregation process can be seen in Eq. (20) where denotes the normalized utility values, , and are the values of alternative under the three utility functions. The larger value of the indicates that the corresponding alternative has the better performance.

There are two feasible space of and , where is the space of criteria weights, while presents the evaluation matrix of alternatives under a set of criteria. Firstly the ranking of alternative can be obtained in Eq. (21). where represents the stochastic value of alternative on a criterion and denotes a random giving criterion weight value, satisfying the uniform distribution in and , is the related utility function of alternative, where . is a binary function, if , then , else . Then is the set of rank weights making alternative in the rank . There are three measurements of SMAA to evaluate the final rankings, the rank acceptability indexes, the central weight vectors and the confidence factors. Let be the rank acceptability index of alternative being on position. Where the expression of can be written as follows. where and are the probability density functions of and . Let be the central weight vector of alternative being on the first rank The value of is displayed as. where the rank acceptability index indicates is on the first rank, and . The confidence factor stands for the possibility of alternative in the first position with determined central weight vector, which is shown as follows. The SMAA-MULTIMOORA method is based on Monte Carlo simulation to calculate the results of the measurements, the detail procedures are illustrated in Algorithm 1.

Solution procedures for assessment of emergency response plan

In this section, we develop a novel emergency response plans evaluation method based on GDM. Firstly, the IT2FS- method is represented, then we integrate the extended MULTIMOORA method, and the group consensus is considered as well by designing a convergent iterative algorithm to gain the consentaneous group decision result. Finally, the solution process of emergency response plan selection is illustrated. In the evaluation process depicted in Fig. 3, the linguistic terms are quantified as the centroid intervals of IT2FSs through KM algorithm, then interval-based decision matrix of each DM is constructed. In the framework, we input the concept of time series to predict the reference points in different periods for the setting of dynamic reference points, which is line with the timeliness of emergency response plans. Simultaneously, there are six possible cases of the relationship between interval-based evaluation information and the related reference point, shown in Table 1. Thereafter, we construct the decision matrix in the level of reaching group consensus, and the final ranking results can be determined by the extended MULTIMOORA method.

Fig. 3

Construction of a consensus prospect value matrix.

Table 1

Possible cases of .

Possible Cases	Δx	For Benefit/ Neutral Criteria		For Cost Criteria
		Gain	Loss	Gain	Loss
case1: xijl<xijr<hjl<hjr	hjl−0.5(xijr+xijl)		✓	✓
case2: xijl<hjl<xijr<hjr	(hjl−xijl)^2/2(xijr−xijl)		✓	✓
case3: hjl<xijl<xijr<hjr	0
case4: hjl<xijl<hjr<xijr	−(hjr−xijr)^2/2(xijr−xijl)	✓			✓
case5: xijl<hjl<hjr<xijr	0.5(hjl+hjr)−0.5(xijl+xijr)	✓			✓
case6: hjl<hjr<xijl<xijr	hjr−0.5(xijl+xijr)	✓			✓

In this study, we assume that all the DMs make their judgments on the aspect of emergency response plans evaluations by using the same linguistic terms set.

Description of IT2FS- based emergency response plan evaluation

We can see that the assessments for emergency response plans can be regarded as a MCGDM problem in the uncertain and fuzzy environment. First, the relative parameters are expressed as follows.

: the set of DMs from hospitals, public health departments and other related sectors, the corresponding weight of experts satisfying .

: the set of emergency response plans (alternatives) needs to find the optimal one in an emergency event.

: the set of criteria is served as evaluation indexes of emergency events, which can be divided in 3 types: the beneficial criteria, the cost criteria and the neutral criteria and is the weight of criterion , satisfying and .

: the set of linguistic terms, these linguistic terms are expressed in the form of IT2FSs in this proposed model.

: the set of states of a public health emergency event, where is the -th state. Generally, the classification of can be obtained by the previous similar emergency events.

: the probability set for the state , where and , means the probability of state occurring in the future.

: the decision making matrix from a DM, where denotes the value of alternative under the criteria .

: the time line set for an emergency event, where length() , length() length() and stands for the -th time period.

: the uncertain reference point vector set, where means the reference point vector in the state at period and can be expressed as .

: the illustration of value matrix set from DMs, where is the prospect value matrix from DM and presents the prospect value of alternative under the criteria of DM .

In the process of a real-world emergency response plans evaluation, due to the complexity and inadequate information of the emergency event, the selection of evaluation indexes is supposed to be summarized from all relative aspects. These indexes are abstract and cannot be explained by numeric entries [28], [42]. Consequently, the expressions of linguistic terms are more reasonable for DM making assessments. When for the setting of parameters , , and of mentioned in Section 2.2, We refer the values of these parameters in Ref. [11], the median exponent of value function , and the median values of .

In this paper, we develop a novel IT2FS- with the extended MULTIMOORA method to evaluate and select the optimal emergency response plan. Firstly, the process of the IT2FS- method in an emergency event can be described in Fig. 4, which shows in detail the construction of the prospect decision matrix of each DM in different states, then forms the consensus reached prospect decision matrix.

Fig. 4

Overall process behind the proposed model.

In the process of group consensus reaching, the group prospect value matrix can be obtained by aggregating the single DM’s prospect value matrix through the additive weighted aggregation (AWA) operator, which can be expressed as follows. where denotes the weight of -th DM and is the prospect value of -th DM. To measure the level of similarity of prospect value matrix between the individuals and the group, the distance function is expressed as. where stands the similarity degree of and . It is worth noting that satisfies the attributes of general distance function as: , and .

Let be the threshold of acceptable consensus level, which can be determined by DMs in advance. If , Eq. (27) is satisfied, which means that the group has reached consensus.

If such that , then matrices and are of unacceptable similarity. The Eq. (28) is given to reconstruct these matrices in a convergent iterative form. where is a constant satisfied and be the -th of iterative time.

Under the above hypotheses, there is .

if , then From Eq. (28), we have . Then: which completes the proof of Theorem 1.

The IT2FS- integrated with the extended MULTIMOORA method

For this section, we focus on the main model proposed in this paper, in what follows, the specific procedures are given below.

In the evaluation system, there are three types of criteria: the benefit criteria, the neural criteria and the cost criteria. For these types of criteria, we assign different parameter values in the subsequent value functions. Then, the initial linguistic evaluation matrix given by each DM is transformed into IT2FSs-based decision matrix according to the given UMF and LMF of each linguistic term. Through the KM algorithm mentioned in Section 2, we can calculate the centroids of the IT2FSs. Supposed that, the values of linguistic terms follow uniform distribution in the centroid intervals of the IT2FSs, then the expression of linguistic terms is. where is the -th linguistic term, for instance, the linguistic term ”Low” can be expressed as . is the corresponding probability density function expressed as follows. where is an arbitrary value satisfied .

According to the psychological characteristics of each DM, we give the corresponding value functions and the determination of the parameters is based on the research in Ref. [11]. The value functions of the benefit criteria and neutral criteria are expressed as follows. and the value function of the cost criteria can be expressed as. where and denotes -th DM’s assessment result of the -th emergency response plan under the -th criterion in the state , is the reference value of the -th criterion in the state . And for the benefit and cost criteria, the loss aversion parameter is 2.55, is 0.88, while for the neural criteria, and .

Simultaneously, considering the features of public health emergency events affected by time series. Wuhan switched from a high risk area in March into a low risk area in April. Hence, the time factor is supposed to taken into consideration for the formation and updating of dynamic reference point. We introduce the prediction method of reference point formation in the time line referred in [19] as follows. where is the continuously increasing function of the variable in the interval [0,1], satisfying and . the form of is shown in Eq. (8). And is the mean vector of DMs for all criteria in the -th time period, which can be written as. where is applied to calculate the average value of the column in the matrix calculations.

Therefore, considering that and are interval numbers, there are six possible situations for , as shown in the Table 1, and the procedures of these cases are illustrated in Appendix A.

The decision weight function of the value of emergency response plan in the criterion expressed as below. where and in Ref. [11] can be expressed as follows. and where the value of is 0.61 and is 0.69, which are the same settings in Ref. [11].

Through the calculation of Eq. (38), we can obtain the prospect value of each DM for the emergency response plans in different criteria. where is the prospect value matrix from DM .

After attaining the prospect matrices of individual DMs, AWA operators is used to formalize the group prospect matrix as exhibited in Eq. (39). where is the group prospect matrix, if the obtained group prospect matrix does not satisfy the acceptable consensus condition given in Eq. (27), then Eq. (28) is applied to recalculate the group prospect matrix until satisfying the group consensus. Thereafter, Eqs. (40), (41) are applied to standardize . and where Eq. (40) is for the benefit criteria and Eq. (41) is for the cost criteria.

Substitute the consensus reached group prospect matrix into the extended MULTIMOORA method at the aim of making the sequence for these emergency response plans. Firstly, determine the feasible criteria weights space in this proposed model, it is assumed that DMs have the same preference for each criterion, which implies the weight space can be expressed as , where is a random number generated by a normal distribution. Secondly, calculate the rankings of the three utility functions RS in Eq. (15), RP in Eq. (18) and FMF in Eq. (19) of MULTIMOORA method with the weight , then BC method in Eq. (20) is applied to aggregate the three utility values. Finally, Monte Carlo simulation runs 1000 times to calculate the integrals, thereafter, in Eq. (22), in Eq. (23) can be obtained.

In the end, we can obtain the final ranking of these emergency response plans. The whole algorithm of this proposed method can be seen in Algorithm 1 given below.

Case study

On the aim of explaining the validity and feasibility of the proposed model, this section exhibits the real case, that is, the eruption of infectious disease, adapted from COVID-19 that occurred in Wuhan, China.

Background description

The COVID-19 as a potential deadly coronavirus has caused a level of global illness unseen in numbers and rapidity since it occurred in late 2019. Through the report of National Health Commission of People’s Republic of China, there are three potential states of risk levels in COVID-19, i.e. : high risk area, :medium risk area and : low risk area. The specific explanations of these status is shown in Table 2. Simultaneously, we collect the statistics of cumulative confirmed cases from Wuhan Municipal Health Commission website (wjw.wuhan.gov.cn) on March 5th, March 24th, April 7th and April 28th, which the corresponding data is shown in Appendix A. Fig. 5 presents the distribution of Wuhan epidemic risk level map at four time points, which can be vividly seen that the change of risk level is affected by time factors, and Fig. 5 also indicates the rationality of setting three states in the evaluation of an emergency event.

Table 2

Risk classification standard.

	Definition	Explanation in detail
s_1	High Risk Area	The cumulative number of cases exceeds 50, and a cluster of epidemics occurred within 14 days
s_2	Medium Risk Area	Newly confirmed cases within 14 days, the cumulative number of confirmed cases does not exceed 50, or the cumulative number of confirmed cases exceeds 50, and no cluster epidemic occurs within 14 days
s_3	Low Risk Area	No confirmed cases or no new confirmed cases for 14 consecutive days

Fig. 5

Distribution of COVID-19 states in Wuhan (Full high risk areas(marked in red) on March 5th; 8 medium risk areas(marked in light red) and 5 low risk areas(marked in green) on March 24th;1 medium risk area and 12 low risk areas on April 7th;Full low risk areas on April 28th).

Meanwhile, it can be known that Wuhan successfully converted from full high risk areas to full low risk areas in nearly about two months owing to the effective prevention and controllability of the government, we set the time set , the interval between them is set to 14 days. In the time point the corresponding states is , in the time point is connected with the state and the state in the time point is . Accordingly, the corresponding probability of the above states are designed as follows: , and . Suppose that there are 3 representative DMs from hospitals, disease control and prevention centers and other clinical institutions their corresponding weights are set as , 5 emergency response plans for DMs to make evaluations. Considering the complexity of emergency response plans evaluation, we select 7 criteria in the report of National Health Commission of People’s Republic of China, displayed in Table 3. And , , and are the cost criteria, and are the benefit criteria, is the neutral criterion. In general, the value of the consensus threshold level is 0.05, and the parameter coefficient during the iteration process is set as 0.5.

Table 3

The criteria for the assessment of emergency response plans.

Criterion	Definition	Explanation in detail
c_1	Time	The most important index in emergency response plan evaluation, it is required to solve emergency events in time to reduce the damage
c_2	Attendance of Medical Staff	The required number of medical staff in an emergency response plan
c_3	Economic Impact	Cost of the emergency response plan for handling public health emergency events
c_4	Social Influence	The positive impact on society after taking emergency response plans to resolve emergency events
c_5	Resource Consumption	The consumption medical supplies in the public health emergency events
c_6	Transportation Security	Implement blockade management on epidemic areas When the pandemic happened
c_7	Flexibility	The emergency response plan should be dynamically adjustable for the uncertainty of emergency events

Procedures of this proposed model

Some required conditions and specific solution steps are displayed in this section. Table 4 exhibits the linguistic terms set and the relative IT2FS MF. The assessment information of DMs in the state of is displayed in Table 5, and the linguistic evaluation information in other states and can be seen in Appendix A.

Table 4

Linguistic evaluation terms and their upper and lower membership functions.

Linguistic terms	UMF	LMF
Very Unimportant (VUI)	(0,0.1,0.1,0.2,1)	(0,0.1,0.1,0.2,0.8)
Unimportant (UI)	(0.1,0.3,0.3,0.5,1)	(0.1,0.3,0.3,0.5,0.8)
Slightly Important (SI)	(0.3,0.5,0.5,0.7,1)	(0.3,0.5,0.5,0.7,0.8)
Important (I)	(0.5,0.7,0.7,0.9,1)	(0.5,0.7,0.7,0.9,0.8)
Very Important (VI)	(0.8,0.9,0.9,1,1)	(0.8,0.9,0.9,1,0.8)

Table 5

The linguistic evaluation information of DMs in the state of .

		c_1	c_2	c_3	c_4	c_5	c_6	c_7
DM_1	a_1	SI	I	UI	VI	UI	VI	SI
	a_2	I	SI	I	I	UI	SI	VI
	a_3	I	UI	VUI	SI	SI	UI	I
	a_4	UI	I	SI	VI	SI	I	VI
	a_5	VI	VUI	SI	SI	I	UI	I
DM_2	a_1	I	UI	SI	I	SI	I	I
	a_2	VI	I	I	VI	VUI	UI	SI
	a_3	SI	UI	UI	I	UI	SI	I
	a_4	SI	I	UI	I	SI	I	VI
	a_5	I	SI	I	SI	SI	SI	I
DM_3	a_1	SI	SI	UI	I	VUI	SI	UI
	a_2	I	UI	SI	VI	UI	SI	I
	a_3	VI	SI	UI	I	UI	I	VI
	a_4	VUI	VI	SI	I	I	SI	UI
	a_5	I	SI	UI	I	SI	VUI	VI

According to Table 4, KM algorithm is used to calculate the centroid intervals of each linguistic term, follows as: VUI: [0.0963,0.1037], UI:[0.2926,0.3074], SI:[0.4926,0.5074], I:[0.6926,0.7074] and VI:[0.8963,0.9037]. Thereafter, the linguistic evaluation information of DMs can be transformed into the interval-based decision matrices.

Firstly, in the state, let the mean vector of each criterion be the reference point vector . According to Eq. (34), is equal to , then following by the Eq. (33), can be obtained as , and expressed as , where and are the mean vectors of DMs for criteria in the time and time respectively. The value of and are 0.26 and 1.7. The estimation of value in the research [19] is 5.2, the magnitude of variables in [19] is , while in this proposed study the magnitude of variables is between −1 and 0, then the value of is set as 0.0052. Thus the reference vector , and can be denoted in the following form.

Then, according to the six possible situations shown in Table 1, the corresponding value obtained by comparing the reference points with the DMs’ evaluation values. Thus, the gain or loss situation of each DM can be obtained. Table 6 exhibits the DM’s evaluation values in state , the situations in state and state are represented in Appendix A. For better comprehension, here is an example: in state , the linguistic evaluation term given by for emergency response plan under the benefit criterion is VI:[0.8963,0.9037], and , which in accordance with case 6, the assessed value is acquired as: .

Table 6

The value of evaluation from DMs in the state of .

		c_1	c_2	c_3	c_4	c_5	c_6	c_7
DM_1	a_1	0.1136	−0.1971	0.1249	−0.1816	0.105	−0.3771	0.1859
	a_2	−0.0736	−1.4131	−0.2609	0.0057	0.105	0.0091	−0.2019
	a_3	−0.0736	0.1891	0.3249	0.2056	−0.081	0.2091	−1.2291
	a_4	0.3136	−0.1971	−0.0609	−0.1816	−0.081	−0.1771	−0.2019
	a_5	−0.2736	0.3891	−0.0609	0.2056	−0.281	0.2091	−1.2291
DM_2	a_1	−0.0736	0.1891	−0.0609	0.0057	−0.081	−0.1771	−0.0029
	a_2	−0.2736	−0.1971	−0.2609	−0.1816	0.305	0.2091	0.1859
	a_3	0.1136	0.1891	0.1249	0.0057	0.105	0.0091	−0.0029
	a_4	0.1136	−0.1971	0.1249	0.0057	−0.081	−0.1771	−0.2019
	a_5	−0.0736	−5.4275	−0.2609	0.2056	−0.081	0.0091	−0.0029
DM_3	a_1	0.1136	−1.4131	0.1249	0.0057	0.305	0.0091	0.3859
	a_2	−0.0736	0.1891	−0.0609	−0.1816	0.105	0.0091	−5.1581
	a_3	−0.2736	−1.4131	0.1249	0.0057	0.105	−0.1771	−0.2019
	a_4	0.5136	−0.3971	−0.0609	0.0057	−0.281	0.0091	0.3859
	a_5	−0.0736	−1.4131	0.1249	0.0057	−0.081	0.4091	−0.2019

Secondly, calculate the prospect value and relative probability weight of each emergency response plan under the different criteria in Eqs. (31),(32), (35). Hereafter, based on Eq. (38) the prospect value matrices of and can be attained as follows.

Then through the standardization of Eqs. (40), (41), the modified prospect matrices of and can be obtained.

Finally, the group prospect matrix is calculated by Eq. (38) given as below.

For this part, we measure the distances between the individual matrices and the group matrix by Eq. (26), the results are as follows , and , which can be seen that and exceed the threshold . Hence, Eq. (28) is used to modify , and , the modified results are given below.

Again, we recalculate the level of similarity of the individual matrix and the group matrix, , and , all of them satisfying the condition shown in Eq. (27). Therefore, is the consensus group prospect matrix.

Let the consensus group prospect matrix be used in the extended MULTIMOORA method, calculate the rank acceptability index in Eq. (22) and the central weight vector in Eq. (23) of each emergency response plan respectively.

Eventually, Fig. 6 exhibits the distribution of the rank acceptability indexes, it can be obtained the final ranking results of these emergency response plans according to the rank acceptability indexes and the central weight vectors of emergency response plans from Table 7, Table 8 as: .

Fig. 6

The rank acceptability indexes of emergency response plans.

Table 7

Emergency response plans’ rank acceptability indexes.

	1st	2nd	3rd	4th	5th
a_1	0.0070	0.0830	0.3300	0.2720	0.3080
a_2	0.0060	0.1610	0.2260	0.1680	0.4390
a_3	0.0000	0.1730	0.1830	0.3910	0.2530
a_4	0.5540	0.2330	0.0750	0.1380	0.0000
a_5	0.4330	0.3500	0.1860	0.0310	0.0000

Table 8

Emergency response plans’ central weight vectors.

	c_1	c_2	c_3	c_4	c_5	c_6	c_7
a_1	0.0160	0.0880	0.0410	0.5170	0.0230	0.2880	0.0270
a_2	0.1130	0.0860	0.1020	0.0420	0.0430	0.5210	0.0920
a_3	NE	NE	NE	NE	NE	NE	NE
a_4	0.0640	0.1320	0.1780	0.1760	0.1330	0.1710	0.1450
a_5	0.1930	0.1250	0.0980	0.1030	0.1810	0.1340	0.1660

1 NE denotes “Not Exist”, that is, has got no possibility to rank the first place.

Sensitivity analysis

In this part, we explore the influences of related parameters and on the reference point vector and the final ranking results. From the aforementioned in Section 2, parameters and in Eq. (8) determine the curvature and the elevation of respectively, or in another perspective, and control the importance level of the current evaluation matrices of DMs in this period.

It can be intuitively that the change of the parameter and merely have direct impacts on the reference point . Table 9 exhibits the values of and the ranking sequence of emergency response plans in different values of and . And Fig. 7 displays the distribution of the rank acceptability indexes of emergency plans with different and .

Table 9

The values of and ranking results of alternatives in different and .

γ	ξ	h(s_3)^o_3	Ranking results
0.2	0.9	(0.5675,0.5276,0.4432,0.6797,0.4181,0.5222,0.6652)a	a_4≻a_5≻a_1≻a_3≻a_2
		(0.5799,0.5418,0.4569,0.6929,0.4317,0.5356,0.6777)b
	1.7	(0.5852,0.5161,0.4387,0.6905,0.4154,0.5195,0.6741)	a_4≻a_5≻a_1≻a_3≻a_2
		(0.5978,0.5301,0.4526,0.7035,0.4291,0.5330,0.6866)
	2.1	(0.5903,0.5128,0.4374,0.6935,0.4146,0.5187,0.6767)	a_4≻a_5≻a_2≻a_3≻a_1
		(0.6029,0.5268,0.4513,0.7065,0.4284,0.5323,0.6891)
0.26	0.9	(0.5681,0.5272,0.4431,0.6801,0.4180,0.5221,0.6655)	a_4≻a_5≻a_1≻a_3≻a_2
		(0.5805,0.5414,0.4568,0.6933,0.4316,0.5355,0.6781)
	1.7	(0.5858,0.5157,0.4385,0.6908,0.4153,0.5194,0.6744)	a_4≻a_5≻a_2≻a_3≻a_1
		(0.5983,0.5298,0.4524,0.7038,0.4290,0.5329,0.6869)
	2.1	(0.5908,0.5125,0.4373,0.6938,0.4145,0.5186,0.6769)	a_4≻a_5≻a_2≻a_3≻a_1
		(0.6034,0.5265,0.4512,0.7068,0.4283,0.5322,0.6894)

The lower bound of when .

The upper bound of when .

Fig. 7

The rank acceptability indexes of emergency plans with different and .

In the following discussion, we elaborate on the changes of and the final ranking results from Table 9 separately, which are described as.

For the values of

When the value of is fixed, through increasing the value of , the displays a distinct upward trend. Take an example, when the value of is [0.5675,0.5799], while is [0.5903,0.6029]; meanwhile, if the value of is constant, the value of has been slightly increased, and there is basically no change in the length of the intervals.

For the final results

It can be seen from Table 9 that parameters and caused an unobviously change in the ranking of emergency response plans with keep the optimal alternative being and the second optimal alternative being . This indicates the parameters presents less sensitive to the final ranking results in the proposed study.

Comparative analysis

In what follows, we conduct the comparative analysis with the exisited MCDM methods [42], [57] in emergency situation to verify the feasibility and comprehensiveness of this study. The corresponding calculations and analysis are all based on the same scenario mentioned above.

Firstly, Wang et al. [42] considered and emphasized the psychological behaviors of DMs in risk and uncertainty environment for solving group emergency decision making problem. Therefore, they applied PT into decision making process, simultaneously, the judgments provided by DMs were expressed in the interval-based linguistic terms. Then Wang et al. [57] discussed the MULTIMOORA method under IT2FS fuzzy environment. They used the IT2FSs-based linguistic terms to deal with the uncertainty and fuzzy evaluations which is the same as the proposed model, after that they calculated the ranking results by MULTIMOORA method. Table 10 represents the ranking results in different methods, it can be clearly seen that the results obtained by this proposed model are closely to the method in [42], while are different from those obtained by method in [57].

Table 10

Ranking results of emergency response plans in different methods.

	Main Methods	Ranking Indices	Ranking Results
Wang et al.’s [42] Method	Group emergency decision making method based on PT	v(a_1)=0.4320, v(a_2)=0.5321,	a_4≻a_5≻a_2≻a_1≻a_3
		v(a_3)=0.4194, v(a_4)=0.5623,
		v(a_5)=0.5586
Wang et al.’s [57] Method	MLUTIMOORA method in IT2FSs environment	srs∗(a_1)>srs∗(a_3)>srs∗(a_2)>srs∗(a_4)>srs∗(a_5)	a_1≻a_3≻a_2≻a_4≻a_5
		sIT2p∗(a_1)<sIT2p∗(a_2)<sIT2p∗(a_4)<sIT2p∗(a_3)<sIT2p∗(a_5)
		sfm∗(a_1)>sfm∗(a_3)>sfm∗(a_2)>sfm∗(a_4)>sfm∗(a_5)
The Proposed Method	PT^3 and with the extended MULTIMOORA method in IT2FSs environment	The indexes shown in Table 7, Table 8	a_4≻a_5≻a_1≻a_3≻a_2

The above two studies have both considered the issue of setting criteria weights and proposed the distance based methods for determining the criteria weights. And for the GDM scenario, both of them merely used AWA operators to aggregate the individual’s assessments, and the group consensus reaching process is not reflected. Compared with these methods, the features of the proposed model can be summarized in the following aspects.

Compared with Wang et al.’s [42] method, this study introduces and develops the dynamic reference points associated with time series, which is more flexible than PT and has wider application in dealing with emergency events. Meanwhile, this proposed model selects the IT2FSs-based linguistic terms set which is more reasonable for solving emergency response plans evaluation problems than interval-based linguistic terms.

Compared to Wang et al.’s [57] research, this paper considers the bounded rationality of DMs, and combines and the SMAA-MULTIMOORA method to calculate the results in a multi perspective. The introduction of SMAA method allows the stochastic input data of MULTIMOORA framework, which can increase the consistency of the final ranking results.

In addition, in GDM process, this paper considers the group consensus and designs a consensus iterative algorithm to promote group consensus reaching. Moreover, we use Monte Carlo simulation to produce the criteria’s weights randomly, thereafter, the three measurements in SMAA method are applied to testify the ranking results. It increases the robustness of results compared with the establishment of the criteria weights in the previous two studies [42], [57].

Therefore, through the comparative analysis, the propose method can be applied in the process of emergency response plan evaluation in a more comprehensive perspective.

Further discussion

In this proposed model, we have proposed an integrated MCGDM method, which takes the IT2FSs, and MULTIMOORA method into consideration. The major parts of this research are as follows: firstly, individual DMs make judgments on the emergency response plans in , then through the consensus iterative algorithm, obtain the group evaluation information. Thereafter, with the application of the extended MULTIMOORA method to calculate the final ranking results.

Generally, in the assessments of emergency response plans, linguistic terms are usually applied to express the preferences of DMs. It is difficult to obtain sufficient information in emergency events, so we use IT2FSs to quantify the expressions of terms and reduce the loss in the data processing. We consider the characteristics of DMs and introduced the . In the extended MULTIMOORA framework, the BC method is arranged to aggregate the utility values of the three subordinate methods instead of the original dominance theory, and we apply the SMAA method to randomize the criteria weight to increase the robustness of the final results.

After that, as shown in Table 9, by modifying the relevant parameters for sensitivity analysis, it can be seen that the changes of the parameters have a little effects on the final evaluation results, which illustrates the robustness of this model. Furthermore, through the comparative analysis, it can reflect the reliability of the method from the side. Based on the above discussions, the major novelty and advantages of the proposed model can be highlighted as follows.

The proposed model uses the IT2FSs as the quantitative tool for linguistic terms for DMs making evaluations. Meanwhile the six possible cases of dealing with the centroid intervals of IT2FSs are designed, which can make the final qualified evaluation values are closer to the real DMs’ assessments.

is applied to construct the decision making matrix of DMs, considering the bounded rationality in handling with emergency events of DMs. Furthermore, the setting of dynamic reference points corresponds to the timeliness of the development of emergency events as well.

In the GDM situation, the distance formula in Eq. (26) is designed to examine the group consensus, and we put forward the related iterative algorithm to help consensus reaching, which is not considered in [42], [57].

The extended MULTIMOORA method is presented. Specifically, the BC method is applied to fuse the utility values of the three sub functions in MULTIMOORA framework, then the Monte Carlo simulation is constructed to randomize the criteria weights, and the corresponding indexes in the SMAA method are supposed to verify the final rankings, which increase robustness of results and make the model more suitable to deal with real cases.

Conclusions, limitations, and future studies

In the recent years, owing to the harmfulness caused by emergency events, researches on emergency response plans evaluation has attracted many scholars. The related studies can be seen in Refs. [58], [59], [60], [61]. In this paper, we have developed an emergency response plans assessment method in a comprehensive way, owing to the complexity of emergency events and the bounded rationality of DMs, this proposed model combines and the extended MULTIMOORA method with considering the group consensus reaching, the whole process is described as follows: DMs use the given linguistic terms set to make judgments on the emergency response plans, then based on centroids of IT2FSs, each term can be qualified into interval numbers, formalize the interval-based evaluation matrices. When comparing with the related reference point vectors, six possible cases are presented to measure DMs’ expectation of gains or losses of alternatives. It is worth noting that we provide a formula for the formation of dynamic reference point vectors over time. Thereafter, we calculate the prospect matrix of each DM. Afterwards, through the consensus conditions, we substitute the agreeable group prospect decision matrix into the extended MULTIMOORA method, through 1000 times of Monte Carlo simulation, the related indexes in SMAA are calculated to determine the final ranking results of these emergency response plans. Finally, the emergency response plans evaluation case of COVID-19 happened in Wuhan, China further illustrates the application of the model in practice. The feasibility and reliability of this study are validated by sensitivity analysis and comparison analysis with other methods.

In the future, it is possible to extend the proposed model in the following directions.

In the initial evaluation process, DMs choose the linguistic terms to express their opinions with IT2FSs served as the quantitative tool. It will be worth studying to express the evaluation information of DMs in other ways, for instance, the generalized T2FSs [62], the use of quantum mechanics in the DMs’ decision making process [63], the granular computing in GDM [64].

This proposed model considers the psychological behavior of DMs and assumes that they are all risk-aversion, while DMs may also exist risk-neutral or risk-preference emotion in dealing with emergency events. Meanwhile, there is merely one state for each time period. In some catastrophe, there may be multiple risk states in a time period.

We integrated with the extended MULTIMOORA method in this paper, The introduction of the SMAA method increases the uncertainty of the input data, thereby enhancing the robustness of the results. It deserves to take further research in stochastic dominance issues [65] and generalized almost stochastic dominance issues [66].

CRediT authorship contribution statement

Jindong Qin: Conceptualization, Methodology and model design, Writing – original draft, Writing – review & editing, Funding acquisition, Supervision. Xiaoyu Ma: Conceptualization, Methodology, Data Curation, Writing – original draft.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Table 11

The linguistic evaluation information of DMs in the state of .

		c_1	c_2	c_3	c_4	c_5	c_6	c_7
DM_1	a_1	UI	SI	VUI	I	UI	I	SI
	a_2	SI	I	SI	I	SI	VI	I
	a_3	UI	SI	UI	UI	SI	VUI	VI
	a_4	VUI	SI	I	I	VI	SI	I
	a_5	VI	UI	UI	SI	I	SI	I
DM_2	a_1	SI	SI	I	VI	UI	SI	SI
	a_2	I	VI	VI	I	UI	VUI	I
	a_3	UI	SI	SI	VI	SI	I	I
	a_4	I	SI	SI	I	UI	SI	VI
	a_5	VI	I	UI	I	UI	I	SI
DM_3	a_1	UI	SI	UI	SI	VUI	I	VI
	a_2	I	SI	SI	I	VUI	SI	SI
	a_3	VI	I	VUI	SI	SI	SI	I
	a_4	UI	I	I	I	UI	I	VUI
	a_5	VI	UI	SI	VI	SI	UI	I

Table 12

The value of evaluation from DMs in the state of .

		c_1	c_2	c_3	c_4	c_5	c_6	c_7
DM_1	a_1	0.3188	0.0001	0.3301	0.0108	0.1102	−0.1719	0.1911
	a_2	0.1188	−0.1919	−0.0557	0.0108	−0.0758	−0.3719	−0.0006
	a_3	0.3188	0.0001	0.1301	0.4108	−0.0758	0.4143	−0.1967
	a_4	0.5188	0.0001	−0.2557	0.0108	−0.4758	0.0143	−0.0006
	a_5	−0.2684	0.1943	0.1301	0.2108	−0.2758	0.0143	−0.0006
DM_2	a_1	0.1188	0.0001	−0.2557	−0.1764	0.1102	0.0143	0.1911
	a_2	−0.0684	−0.3919	−0.4557	0.0108	0.1102	0.4143	−1.3568
	a_3	0.3188	0.0001	−0.0557	−0.1764	−0.0758	−0.1719	−1.3568
	a_4	−0.0684	0.0001	−0.0557	0.0108	0.1102	0.0143	−0.1967
	a_5	−0.2684	−0.1919	0.1301	0.0108	0.1102	−0.1719	0.1911
DM_3	a_1	0.3188	0.0001	0.1301	0.2108	0.3102	−0.1719	−0.1967
	a_2	−0.0684	0.0001	−0.0557	0.0108	0.3102	0.0143	0.1911
	a_3	−0.2684	−0.1919	0.3301	0.2108	−0.0758	0.0143	−1.2965
	a_4	0.3188	−0.1919	−0.2557	0.0108	0.1102	−0.1719	0.5911
	a_5	−0.2684	0.1943	−0.0557	−0.1764	−0.0758	0.2143	−1.2965

Table 13

The linguistic evaluation information of DMs in the state of .

		c_1	c_2	c_3	c_4	c_5	c_6	c_7
DM_1	a_1	VUI	VI	SI	I	VUI	SI	UI
	a_2	I	I	UI	UI	SI	VI	UI
	a_3	VI	SI	UI	I	UI	VUI	VI
	a_4	SI	VI	I	I	SI	UI	I
	a_5	I	VUI	SI	UI	VI	SI	VI
DM_2	a_1	UI	I	UI	VI	SI	UI	I
	a_2	SI	VI	I	SI	VUI	VUI	I
	a_3	I	VUI	SI	VI	VUI	VI	UI
	a_4	SI	SI	UI	VI	VUI	I	I
	a_5	I	I	SI	I	UI	SI	SI
DM_3	a_1	UI	SI	SI	I	UI	VI	I
	a_2	SI	SI	I	VI	VUI	I	UI
	a_3	I	I	VUI	SI	UI	I	VI
	a_4	VUI	VI	VI	SI	I	UI	VUI
	a_5	VI	I	UI	I	I	UI	VI

Table 14

The value of evaluation from DMs in the state of .

		c_1	c_2	c_3	c_4	c_5	c_6	c_7
DM_1	a_1	0.4858	−0.3702	−0.0476	−1.3037	0.3153	0.0194	0.3744
	a_2	−0.1017	−0.1702	0.1385	0.3908	−0.071	−0.3671	0.3744
	a_3	−0.3017	0.0157	0.1385	−1.3037	0.1153	0.4194	−0.2131
	a_4	0.0858	−0.3702	−0.2476	−1.3037	−0.071	0.2194	−0.0131
	a_5	−0.1017	0.4157	−0.0476	0.3908	−0.471	0.0194	−0.2131
DM_2	a_1	0.2858	−0.1702	0.1385	−0.1962	−0.071	0.2194	−0.0131
	a_2	0.0858	−0.3702	−0.2476	0.1908	0.3153	0.4194	−0.0131
	a_3	−0.1017	0.4157	−0.0476	−0.1962	0.3153	−0.3671	0.3744
	a_4	0.0858	0.0157	0.1385	−0.1962	0.3153	−0.1671	−0.0131
	a_5	−0.1017	−0.1702	−0.0476	−1.3037	0.1153	0.0194	0.1744
DM_3	a_1	0.2858	0.0157	−0.0476	−12.168	0.1153	−0.3671	−0.0131
	a_2	0.0858	0.0157	−0.2476	−0.1962	0.3153	−0.1671	0.3744
	a_3	−0.1017	−0.1702	0.3385	0.1908	0.1153	−0.1671	−0.2131
	a_4	0.4858	−0.3702	−0.4476	0.1908	−0.271	0.2194	0.5744
	a_5	−0.3017	−0.1702	0.1385	−12.168	−0.271	0.2194	−0.2131

Table 15

Distribution of COVID-19 states in Wuhan on March 5th.

High risk area	Medium risk area	Low risk area
Qingshan	0	0
Hannan
Jiangan
Hanyang
Qiaokou
Jianghan
Wuchang
Hongshan
Xinzhou
Huangpi
Jiangxia
Caidian
Dongxihu

Table 16

Distribution of COVID-19 states in Wuhan on March 24th.

High risk area	Medium risk area	Low risk area
0	Qingshan	Xinzhou
	Hannan	Huangpi
	Jiangan	Jiangxia
	Hanyang	Caidian
	Qiaokou	Dongxihu
	Jianghan
	Wuchang
	Hongshan

Table 17

Distribution of COVID-19 states in Wuhan on April 7th.

High risk area	Medium risk area	Low risk area
0	Qiaokou	Qingshan
		Hannan
		Jiangan
		Hanyang
		Jianghan
		Wuchang
		Hongshan
		Xinzhou
		Huangpi
		Jiangxia
		Caidian
		Dongxihu

Table 18

Distribution of COVID-19 states in Wuhan on April 28th.

High risk area	Medium risk area	Low risk area
0	0	Qingshan
		Hannan
		Jiangan
		Hanyang
		Qiaokou
		Jianghan
		Wuchang
		Hongshan
		Xinzhou
		Huangpi
		Jiangxia
		Caidian
		Dongxihu