Ellina V Grigorieva1, Evgenii N Khailov2, Andrei Korobeinikov3. 1. Department of Mathematics and Computer Sciences Texas Woman's University Denton Texas USA. 2. Faculty of Computational Mathematics and Cybernetics Lomonosov Moscow State University Moscow Russia. 3. School of Mathematics and Information Science Shaanxi Normal University Xi'an China.
Abstract
At the time when this paper was written, quarantine-related strategies (from full lockdown to some relaxed preventive measures) were the only available measure to control coronavirus disease 2019 (COVID-19) epidemic. However, long-term quarantine and especially full lockdown is an extremely expensive measure. To explore the possibility of controlling and suppressing the COVID-19 epidemic at the lowest possible cost, we apply optimal control theory. In this paper, we create two controlled Susceptible-Exposed-Infectious-Removed (SEIR) type models describing the spread of COVID-19 in a human population. For each model, we solve an optimal control problem and find the optimal quarantine strategy that ensures the minimal level of the infected population at the lowest possible cost. The properties of the corresponding optimal controls are established analytically using the Pontryagin maximum principle. The optimal solutions, obtained numerically, validate our analytical results. Additionally, for both controlled models, we find explicit formulas for the basic reproductive ratios in the presence of a constant control and show that while the epidemic can be eventually stopped under long-term quarantine measures of maximum strength (full lockdown), the strength of quarantine can be reduced under the optimal quarantine policies. The behavior of the appropriate optimal solutions and their dependence on the basic reproductive ratio, population density, and the duration of quarantine are discussed, and practically relevant conclusions are made.
At the time when this paper was written, quarantine-related strategies (from full lockdown to some relaxed preventive measures) were the only available measure to control coronavirus disease 2019 (COVID-19) epidemic. However, long-term quarantine and especially full lockdown is an extremely expensive measure. To explore the possibility of controlling and suppressing the COVID-19 epidemic at the lowest possible cost, we apply optimal control theory. In this paper, we create two controlled Susceptible-Exposed-Infectious-Removed (SEIR) type models describing the spread of COVID-19 in a human population. For each model, we solve an optimal control problem and find the optimal quarantine strategy that ensures the minimal level of the infected population at the lowest possible cost. The properties of the corresponding optimal controls are established analytically using the Pontryagin maximum principle. The optimal solutions, obtained numerically, validate our analytical results. Additionally, for both controlled models, we find explicit formulas for the basic reproductive ratios in the presence of a constant control and show that while the epidemic can be eventually stopped under long-term quarantine measures of maximum strength (full lockdown), the strength of quarantine can be reduced under the optimal quarantine policies. The behavior of the appropriate optimal solutions and their dependence on the basic reproductive ratio, population density, and the duration of quarantine are discussed, and practically relevant conclusions are made.
The coronavirus disease 2019 (COVID‐19) pandemic began in Wuhan, China, with the discovery of unknown pneumonia cases in late December 2019. The city of Wuhan was closed and quarantined by January 22, 2020. On the 30th of January, World Health Organization (WHO) recognized the outbreak of a new coronavirus (SARS‐CoV‐2) as a public health emergency of international concern; on the 11th of March, it announced that the outbreak had become a pandemic and on the 13th of March, Europe had become its center. Two key factors of this virus, which contribute to the difficultly of the pandemic, are the wide variations of the incubation period (in some cases over 14 days) and a very large number of asymptomatic patients who are contagious but demonstrate mild or no clinical manifestations.If no vaccine against COVID‐19 is available, the quarantine‐related measures remain to be the only accessible control policy. The Chinese experience of the February–March of 2020 shows that the quarantine can effectively stop the spread of the infection and annihilate the virus. However, at the same time, the large‐scale quarantine is also extremely expensive policy inflicting huge economic losses. Moreover, while some groups of a population can be quarantined at a comparatively low cost, the cost quickly grows as more and more of the economically active people have to be isolated.By quarantine‐related strategies, we mean an effective enforcement of safety protocol including social and economic measures imposed by the national and local governments to minimize the spread of the infection by the mean of (i) isolation and (ii) reducing the number of social contacts by other means, and (iii) reducing the probability of passing the infection in the remaining contacts, as well as the state when these measures are imposed. These restrictions and their severity can be implemented by a variety of different forms (from full lockdown to relaxed measures as mask‐wearing). A specific implementation depends on many factors, including geographic location (where the susceptible population is located) and the local population density.One of the difficulties associated with COVID‐19 control is that the actual functional form that describes the transmission of the infection from one individual to another is currently unknown in details. However, as our study demonstrates, this can be a factor of principal importance for designing of a control policy. In this paper, to take this fact into account, we formulated two different models of the COVID‐19 transmission, which cover two most likely cases. For each of these models, we formulated the corresponding optimal control problems (which are respectively referred to as first optimal control problem [OCP‐1] and second optimal control problem [OCP‐2]). Each of the problems was analytically studied and then solved numerically for a variety of time intervals and basic reproduction numbers.While the objective of this paper is finding a quarantining policy that would minimize both the level of infection and the cost of the quarantine, we left the consequences of the epidemic for the economy out of the paper's scope. An interested reader can find discussion of the various economic scenarios associated with epidemics in Refs. 1, 2.
OPTIMAL CONTROL PROBLEMS
Let us consider the spread of COVID‐19 in a human population of size . We postulate that the population is divided into the five classes and denote:—the number of susceptible individuals;—the number of exposed individuals who exhibit no symptoms and are not contagious yet (the individuals in the latent state);—the number of infected individuals who have very mild symptoms or no symptoms at all (it is believed that for COVID‐19, those are about 80% of the infectious individuals);—the number of infected individuals who are seriously ill;—the number of recovered individuals.Hence, the natural equality
holds. Please note that the proposed population structure postulates that there are two parallel pathways of the disease progression, namely, symptomatic, , and asymptomatic, , which is shown in Figure 1.
FIGURE 1
Schematic compartmental diagram for the transmission dynamics of COVID‐19
Schematic compartmental diagram for the transmission dynamics of COVID‐19In this paper, we are only interested in a single epidemic, which we assume to be reasonably short. Therefore, we ignore the demographic processes (that is, the new births and natural deaths), assuming that they occur at a considerably slower time scale. Then the spread of COVID‐19 can be described by the following system of differential equations:Model (2) differs from the classical SEIR model by having two parallel infection passways, and hence, two parallel infectious classes, namely, the asymptomatically infectious individuals and the symptomatically infectious individuals . System (2) postulates that the susceptible individuals are infected through contact with asymptomatically and symptomatically infected individuals, and , at incidence rates and , respectively. After an instance of infection, the infected individuals move into the exposed compartment where they remain for an average days. (Hence, is the per capita rate with which the exposed individuals move into the infectious groups.) Moreover, and are, respectively, the fractions of the exposed individuals that move into the classes of the asymptomatically infected individuals and the symptomatically infected individuals . Hence, . For COVID‐19, it is currently assumed that and ; we use these figures in our computations. Parameters and are the per capita removal (recovery plus death) rates for the and groups, respectively. We assume that and are the recovery rates of individuals in the and groups, respectively, and that is the disease‐induced death rate. (Hence, value is the death probability.)System (2) should be complemented by the corresponding initial conditions
We assume that values , , , , are positive and . Moreover, the equality:
where is the initial population size, holds.We have to point that the precise forms of the incidence rates and and, in particular, their functional dependence on population size are currently unknown. However, as we are going to show below, the dependence of incidence rate on population size is extremely important for designing of a quarantining strategy. In the Kermack–McKendrick type models, it is typically assumed that the rate of infection obeys the law of acting masses (see, e.g., Refs. 3, 4), and thus, the rate is directly proportional to the product of the current numbers of susceptible and infected individuals. Then the intensity of infection in the susceptible compartment, which is also called the force of infection, has the form . However, for some infectious diseases, it is more appropriate to postulate that the force of infection depends on the relative value (density) of the infectious individuals, rather than of their absolute number, and hence, is expressed as (Refs. 3, 5). Under this assumption, the so‐called “standard disease incidence rate” is respectively defined as or . As, as we mentioned above, for COVID‐19, the real‐life dependency of the incidence rate on the population size is unknown in detail, we consider both above‐mentioned rates, namely, the bilinear rates
and the “standard” ratesMoreover, in this paper, we assume that the individuals in class exhibit the characteristic symptoms of the disease, and hence, are isolated, either at homes or in a hospital. We assume that this implies that their ability to spread the virus is significantly limited and postulate that and (and even , ) hold.We believe that, with respect of the dependency of the incidence rate on population size , all realistic transmission rates are bounded by these two limiting cases. Note that if the population size is constant, or if its variations are reasonably small, then, in the absence of a control, these two incidence rates, respectively, lead to identical or to a very similar outcomes. (See, for example, Figure 2 in Section 6, which demonstrates the dynamics of the infective population for these two incidence rates in the absence of a control.) Nevertheless, as we show below, if quarantine is imposed, the corresponding control models are principally different.
FIGURE 2
Upper row: Expected number of the infectious individuals in the absence of any intervention policy for days and for (the red line) and (the blue line) for Model‐1 (left) and Model‐2 (right), respectively; lower row: the same for days. (Please note that although the infection curves for Model‐1 and Model‐2 look almost the same on the graphs, they are slightly different, as can be seen from Table 2)
Upper row: Expected number of the infectious individuals in the absence of any intervention policy for days and for (the red line) and (the blue line) for Model‐1 (left) and Model‐2 (right), respectively; lower row: the same for days. (Please note that although the infection curves for Model‐1 and Model‐2 look almost the same on the graphs, they are slightly different, as can be seen from Table 2)
TABLE 2
Values (OCP‐1), (Model‐1), (OCP‐2), and (Model‐2) for different and
T
ℜ0
OCP‐1
Model‐1
OCP‐2
Model‐2
i∗1(T)+j∗1(T)
i(T)+j(T)
i∗2(T)+j∗2(T)
i(T)+j(T)
15 days
3.0
0.653373×10−4
0.000280994
0.789280×10−4
0.000280994
6.0
0.655233×10−4
0.000800482
0.974572×10−4
0.000800485
30 days
3.0
0.115364×10−3
0.000898117
0.501926×10−4
0.000898128
6.0
0.313768×10−4
0.008208311
0.836713×10−4
0.008208734
60 days
3.0
0.104779×10−4
0.008950499
0.232701×10−4
0.008952093
6.0
0.107664×10−4
0.323447058
0.619580×10−4
0.324043791
120 days
3.0
0.433145×10−5
0.222049395
0.102394×10−4
0.223221149
6.0
0.523114×10−5
0.028793638
0.352345×10−4
0.028675612
Indeed, quarantine results in a reduction of the number of infectious contacts (either through reducing a probability of passing the infection, or through a direct reduction of the number of contacts, or, more often, through both these modes). What is of importance, this reduction equally affects all groups of epidemiological significance, apart from the group of symptomatically ill individuals who assumed to be isolated in either case. However, this later group is small, and hence, we can assume that the reduction equally affects the entire population as well. In each of the group affected by the reduction, such a reduction is equivalent to introduction of the “effective epidemiologically active” (that is, involved in the disease transmission) population: for example, if at the moment , the number of infectious contacts of the susceptible group is reduced by a factor (), then susceptible individuals can be considered as temporary inactive (“removed”) from the susceptible group, and hence, the effective susceptible population is . As we said, quarantine affects all groups (apart from the group of the patients with serious symptoms, who are assumed to be already isolated) equally, and hence, the effective numbers of epidemiologically active individuals in other groups are , and , respectively. Furthermore, is defined by (1). However, we already assumed that the number of infectious and severely ill, , is small compared with , , and even with asymptomatic infectious group, . Hence, we can assume that the effective size of the entire epidemiologically active population is
Therefore, for the first of the models, under the action of quarantine, the effective incidence rates and are and , respectively. For the second model, the rates are and , respectively. As can be seen, the effect of quarantine significantly depends on the actual dependency of the transmission rate on population size .We assume that model (2) is to be an object of control, and hence, we consider this model at a given finite time interval .
Model 1
Model (2) combined with incidence rate (5) and defined on time interval yields the following system of differential equations:
with the initial conditions (3).It is easy to see that the equations of system (8) together with initial conditions (3) and equality (4) imply relationship (1) and that the value of naturally varies (decreases due to disease‐induced mortality).For the sake of simplicity, let us perform the normalization of system (8) and initial conditions (3), using the following formulas:
The substitution yields system of differential equations
with the initial conditions
Here , , , and are positive, (further in this paper, we will use , assuming that we study an initial stage of the epidemic), and the equality
following from (4), holds.Note that normalization (9) converts equality (1) into equalityThe important properties of solutions for system (10) are established by the following lemma.Let system (10) with the initial conditions (11) has solutions , , , , , and . Then, for all , the solutions are positive, bounded, and defined on the entire interval .The proof of Lemma 1 is deferred to Appendix A. Lemma 1 implies that all solutions of system (10) with the initial conditions (11) retain their biological meanings for all .Let us introduce a control function into system (10). We assume that this control reflects the intensity of the quarantine. We assume that the quarantine implies “effective isolation” of equal fraction in groups , , and (or reducing the number of contacts of the individuals in these groups by factor ), whereas the group (the symptomatically ill individuals) is assumed to be already isolated, and therefore, its status is not affected by the quarantine. The control satisfies the restrictions:
These considerations, combined with the discussion of the groups‐effective population sizes, lead to the following control system:
with the corresponding initial conditions (11).
Model 2
For the incidence rates (6), the change in the size of the compartments is described by the following system of differential equations:
The corresponding initial conditions are defined by (3) and (4). Here and are the per capita rates of virus transmission from asymptomatic infected individuals and symptomatic infected individuals , respectively.Substituting (9) into system (16) with initial conditions (3), we obtain the following normalized system of differential equations:
with the initial conditions (11).The positiveness, boundedness, and continuation of the solutions , , , , , and on the entire interval for system (17) are established by arguments similar to those presented in Lemma 1.Now, we introduce into system (17) the control function (the “quarantine intensity”) . We have to stress that, due to the difference of incidence rates, the effect of quarantine on model (17) is different (smaller) compared to model (10).As above, we assume that the quarantine implies isolation of fraction in groups , and , whereas the group is assumed to be already isolated. Furthermore, group is comparatively small, and hence, we can assume that
and that the fraction of the population is isolated. These considerations leads to the following control system:
with the corresponding initial conditions (11). As above, we assume that control satisfies restrictions (14).Note that for (in the absence of quarantine), systems (15) and (19) become systems (10) and (17), respectively. The different manifestation of control in models (15) and (19) shows why the dependence of an incidence rate on population size is so important for studying impacts of quarantine.To formulate the optimal control problems, let us introduce set of all admissible controls. The set is formed by all possible Lebesgue measurable functions that for almost all satisfy restrictions (14). For control systems (15) and (19), on the set of all admissible controls, we consider the payoff objective function
Here, and are nonnegative and is positive weighting coefficients. For convenience of notation, in function (20), we below denote the terminal part by .In the payoff objective function (20), all terms have a cost value. Although the main task of fighting a new virus is to combat its spread and minimize its prevalence, this task has a cost value, which is represented by the nonnegative cost constants and . The terminal part of the payoff objective function (20) determines the level of disease in the population caused by COVID‐19 at the end of the quarantine period multiplied by constant (the first term) and its integral part represents the cumulative level of disease over the entire quarantine period (the second term) multiplied by constant and the cost of these quarantine‐related measures (the third term). Applying the optimal control theory, we want to determine the best control strategies that will minimize the prevalence of COVID‐19 and the cost of applying quarantine‐related strategies. In particular, we seek a control that minimizes the payoff objective function (20), where and are constant costs of minimizing prevalence. The term requires us to minimize the effort and the cost of the applying quarantine‐related measures, and is the constant positive weight. We assume that the cost of the imposed quarantine‐related safety protocol is nonlinear and takes a quadratic form. Generally speaking, we have to note that the actual cost function is unknown. However, it is obvious that quarantining some groups is comparatively inexpensive, and that the cost rapidly grows as wider groups of economically active individuals become isolated. The quadratic cost function that we use in this paper qualitatively reflects this situation and, at the same time, is mathematically convenient. In addition, there are works
,
,
showing that in epidemiological problems, the dependence of the optimal control on the power of control in the objective function is not significant. Hence, the optimal controls obtained in the problems with the payoff objective function (20) can be considered as a good opportunity for implementation in real life.Please note that phase variables , , and are only present in the payoff objective function (20). Moreover, the first four equations of system (15) are independent of variables and . Therefore, the last two differential equations can be omitted from system (15). Likewise, the fifth differential equation can be excluded from system (19).As a result, we state the OCP‐1 as a problem of minimizing the payoff objective function (20) on the set of all admissible controls for system
with the initial conditions
where , , , are positive and satisfy equality (12).Likewise, we state the OCP‐2 as a problem of minimizing the payoff objective function (20) on the set of all admissible controls for system
with the initial conditions
where , , , are positive and satisfy equality (12).It is easy to see that for OCP‐2, the assumptions of Corollary 2 (Exercise 2) to Theorem 4 (chapter 4
) are correct. Namely, Lemma 1, which is also valid for the control system (23) and (24), gives a uniform estimate for its solution corresponding to any admissible control from for all . In addition, system (23) is linear in control , and the integrand of the payoff objective function (20) is a convex function with respect to . Therefore, all these facts guarantee the existence of an appropriate optimal solution for OCP‐2, which consists of the optimal control and the corresponding optimal solutions , , , , to system (23), (24).To justify the existence of the optimal solution for OCP‐1, we use Theorem 4.1
(see also Theorem 5.2.1
). One of the key facts in it is also a uniform estimate for the solution of system (21) and (22) corresponding to any admissible control from for all . This estimate is a direct consequence of Lemma 1, which also holds for the considered control system. Another key assumption in this theorem is the convexity of the set:
considered for an arbitrary fixed point with positive coordinates (see Lemma 1). For this set, such a property is established by the following lemma.The set is convex for an arbitrary fixed point with positive coordinates.The proof of this lemma is in Appendix B. Lemma 2 and the previous fact guarantee the existence of an appropriate optimal solution for OCP‐1, which consists of the optimal control and the corresponding optimal solutions , , , to system (21), (22).
ANALYSIS OF OCP‐1
To study OCP‐1 analytically, we apply the Pontryagin maximum principle.
First, we write down the Hamiltonian of this problem:
where , , , are the adjoint variables. The Hamiltonian satisfies:By the Pontryagin maximum principle, for the optimal control and the corresponding optimal solutions , , , to system (21), there exists the vector function , such thatis a nontrivial solution of the adjoint system
satisfying the corresponding initial conditions
(Here is the terminal part of the payoff objective function (20).)the control maximizes the Hamiltonian
with respect to for almost all .With respect to , this Hamiltonian is a quadratic function of the form
where
Therefore, the following relationship holds:
Here function is the so‐called indicator function,
which for is defined as
It determines the behavior of the optimal control according to (30).By (27), (29), and (31), we can see that and , and therefore, inequality holds. According to (30), this means that the following lemma is true.At , the optimal control is positive and takes either value or value .Now we can see that the following lemma is valid.Let us assume that at moment , the inequality holds. Then the inequality holds as well.The proof of this lemma is in Appendix C. The following important corollary can be drawn from Lemma 4.Relationship (30) can be rewritten asEquality (32) shows that for all values of , the maximum of Hamiltonian (28) is reached with a unique value . Therefore, the following lemma immediately follows from Theorem 6.1 in Ref. 10.The optimal control is a continuous function on the interval .Systems (21) and (26) with corresponding initial conditions (22) and (27), and equality (32) together with (31) form the two‐point boundary value problem for the maximum principle. The optimal control satisfies this boundary value problem together with the corresponding optimal solutions , , , for system (21). Moreover, arguing as in Refs. 14, 15, 16, due to the boundedness of the state and adjoint variables and the Lipschitz properties of systems (21) and (26) and relationship (32), one can establish the uniqueness of this control.
ANALYTICAL STUDY OF OCP‐2
To analytically study OCP‐2, we also use the Pontryagin maximum principle. The Hamiltonian of OCP‐2 is
where , , , , are the adjoint variables. The Hamiltonian satisfiesBy the Pontryagin maximum principle, for the optimal control and the corresponding optimal solutions , , , , to system (23), there exists the vector function , such that:is a nontrivial solution of the adjoint system:
satisfying the initial conditionsthe control maximizes the Hamiltonian
with respect to for almost all . Therefore, the following equalities hold:
where function
is the indicator function that determines the behavior of the optimal control according to (36).Now, (34) and (37) yield
which by Lemma 1 implies the inequality . According to (36), this implies that the following lemma that is similar to Lemma 3 is true.At , the optimal control is positive and takes either value , or value .Equalities (36) show that for all , the maximum of Hamiltonian (35) is reached with a unique value . Therefore, the following lemma, which is similar to Lemma 5, immediately follows from Theorem 6.1 in Ref. 10.The optimal control is a continuous function on the interval .Finally, the arguments in Remark 1 are also applicable here. Specifically, systems (23) and (33) with initial conditions (24), (34), relationship (36), and equality (37) form a two‐point boundary value problem for the maximum principle. The optimal control satisfies this boundary value problem together with the corresponding optimal solutions , , , , and for system (23). Moreover, due to the boundedness of the solutions for the state and adjoint variables and the Lipschitz properties of systems (23) and (33), and equation (36) that defines the control, it is possible to establish the uniqueness of this control.
THE BASIC REPRODUCTIVE RATIO
The basic reproductive ratio typically characterizes the ability of infection to spread: it is usually assumed
that an epidemic occurs if . If , then the epidemic gradually fades.
To find for systems (10) and (17), we apply the next‐generation matrix approach.
For both these systems, the basic reproductive ratio is given by the same formula:Further, in this paper, we use the following values of parameters:
We also assume that
For these values of parameters,Table 1 shows the relationships between and coefficients and that are assumed to be related via (40) and (41). Further, in this paper, we use the value of from (see Refs. 20, 21, 22, 23, 24, 25, 26, 27, 28, 29).
TABLE 1
Values of parameters and depending on
ℜ0
β1
β2
2.5
2.5/11.62 = 0.215146
0.021515
3.0
3.0/11.62 = 0.258176
0.025818
4.0
4.0/11.62 = 0.344234
0.034423
6.0
6.0/11.62 = 0.516351
0.051635
Values of parameters and depending onFor control systems (15) and (19), the corresponding basic reproductive ratios and calculated under assumption of the constant control are
and
Parameters from (39) yield
It is easy to see that for all values of from Table 1, the inequalities
hold. This means that quarantine with the maximum intensity should eventually stop the epidemic. It is also clear that for both systems, the value of can be reduced.
NUMERICAL RESULTS
We conduct numerical study of OCP‐1 and OCP‐2 using BOCOP 2.0.5 package.
BOCOP 2.0.5 is an optimal control interface implemented in MATLAB and used for solving optimal control problems with general path and boundary constraints and with free or fixed final time. By a time discretization, such optimal control problems are approximated by finite‐dimensional optimization problems, which are then solved by the well‐known software package IPOPT using sparse exact derivatives that are computed by ADOL‐C. IPOPT is an open‐source software package designed for large‐scale nonlinear optimization. In the computations, we set the number of time steps to 5000 and the tolerance to and use the sixth‐order Lobatto III C discretization rule.In the computations, we use parameters from (39) and Table 1. The value of (the duration of the quarantine) is 15 days, 30 days, or 60 days. The initial conditions areThough we investigated these problems for and for time intervals , days, in this section, we provide only the results for and , as the most representative cases of average () and high () virus infectivity, referring to other case, if needed. Table 2 shows “the number of active cases” at the end of the quarantine for different and under each control strategy (OCP‐1 and OCP‐2) and without control for Model‐1 (10) and Model‐2 (17).Values (OCP‐1), (Model‐1), (OCP‐2), and (Model‐2) for different andIn all graphs, the numerical curves for are shown in red and for – in blue. Figure 2 shows dynamics of the infectious population for uncontrolled Model‐1 and Model‐2 on the time interval of 60 and 180 days. While the dynamics of the spread of the virus in these models is very similar and mainly determined by the value of , the numerical values of all the solutions are a little bit different. (See also columns (4) and (6) of Table 2). We can see from the graphs in Figure 2 that under the same initial conditions and parameters, the peak of proportion of the total sick carriers of the virus falls on day 130 at and the 70th day at and is approximately 2200000 virus carriers and 3800000, respectively.Figures 3, 4, 5, 6, 7, 8 present some results of computations for two optimal control problems (OCP‐1 and OCP‐2) on the time interval of 15, 30, and 60 days.
FIGURE 3
OCP‐1: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,
FIGURE 4
OCP‐1: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,
FIGURE 5
OCP‐1: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,
FIGURE 6
OCP‐2: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,
FIGURE 7
OCP‐2: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,
FIGURE 8
OCP‐2: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,
OCP‐1: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,OCP‐1: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,OCP‐1: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,OCP‐2: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,OCP‐2: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,OCP‐2: optimal solutions , , and optimal control for days and (red), (blue): upper row: , ; lower row: ,Figures 3, 4, 5 show the results of computations for OCP‐1 for 15, 30 and 60 days of control (duration of the quarantine measures) for two different reproductive ratios ( and ). Figures 6, 7, 8 show the results of similar computations for OCP‐2. These figures demonstrate that even for a comparatively low basic reproductive ratio, 15‐day quarantine is insufficient to eradicate the epidemic. In particular, for OCP‐2, one can see that the graphs of and do not even start to decrease. (note that the sums of the appropriate graphs and represent the level of the infectious at moment for OCP‐1 and OCP‐2, respectively.)Note that the results for are very similar to those for . If the virus is more contagious, which is for , then the situation is worse: as one can see in Figure 6, the hardest quarantine conditions give no acceptable result for 15 days, and the virus continues to grow. The need for optimal quarantine management for at least 2 months is especially well manifested in Figures 6, 7, 8 for OCP‐2, if the intensity of infection is high (see the blue curves). So, if we consider only a site in 2 weeks or even in 1 month (Figures 6 and 7), then it can be seen that the number of patients who may require hospitalization () steadily increases over a site of 15 days () does not decrease in 30 days (), and only when considering the quarantine of 60 days, a decrease in symptomatic patients () is observed. Of course, for , the situation with optimal control is much better and the red curves begin to decrease almost immediately, reaching a minimum value at , so that the approximate number of all infected is 230 people, which is much less than the initial value of 1000.The results of the 30‐day policy for and are presented in Figures 4 and 7. One can see in these figures that at for both, OCP‐1 and OCP‐2, the graph of or (symptomatic virus carriers) passes its maximum and starts to decrease. However, it is noteworthy that at for OCP‐2, the level of symptomatically infected is increasing even under the strongest quarantine measures. One conclusion that has to be withdrawn from these results is the importance of actual dependency of the incidence rate on the population size .The blue curves in all Figures 3, 4, 5, 6, 7, 8 obtained for the high infectivity level () show that the 60‐day quarantine gives considerably better results for both OCP‐1 and OCP‐2. For both optimal control problems, even in the case of the high communicability of the infection, the corresponding graphs for the infection level pass their maxima and start decreasing. Let us compare OCP‐1 results with those for the uncontrolled Model‐1 using Table 2 and Figure 2. Thus, for () without optimal quarantine policy, at the end of 60 days, there would be approximately 3234000 people infected (see the fourth column of Table 2) and even more (3800000) at the peak of infection (see Figure 2). Under optimal control (OCP‐1) this number would be reduced to 107–108 infected at the end of the 60th day (see Figure 5 and the third column of Table 2).For the both problems, the optimal controls and should be kept as high as possible from the beginning of the policy and till a considerable decrease of the infection level is reached. Then the quarantine measures maybe slightly relaxed.As the impact of quarantine in OCP‐2 is smaller (as it was explained earlier, in Section 2, when the incidence rate types were discussed), it is not a surprise that the corresponding optimal control is to keep the value of during almost the entire time period. The optimal control should be maximal during the first month and then different kind of restrictions can be slowly reduced day by day. Although all our numerical results show that the decrease in quarantine measures does not become zero even at the very end of each restriction period, this fact is consistent with Lemmas 3 and 6.We carried out calculations for both optimal control problems also in the 120‐day quarantine period, as can be seen from Table 2. Although the level of infection with such a long quarantine does indeed decrease in comparison with the 60‐day quarantine, the optimal value of the payoff objective function (20) increases, so as the cost of the quarantine. In spite of the fact that, for example, for OCP‐1, the number of infected at the end of a 120‐day quarantine would be 43 compared with 105 at the end of a 60‐day quarantine, such a long quarantine is simply impossible to impose, and obviously, it is unrealistic from an economic point of view.
CONCLUSIONS
In this paper, we explored the optimal, in the terms of minimizing the cost of intervention and the infection level, quarantine implemented to control the spread of COVID‐19 in a human population. To address this problem, we constructed two SEIR‐type models. We took into consideration that the real‐life infection rate for COVID‐19 is unknown, and therefore, the models that we constructed are different in the form of their functional dependency on the population size . A bounded control function reflecting the “intensity of quarantine measures” in the population has been introduced into each of these models. We have to note that this type of control reflects all sorts of the direct and indirect measures, such as quarantine, mask‐wearing, and various educational and information campaigns, aimed at reducing the possibility of transmission of the virus from the infected to the susceptible individuals. In our study, we assumed that there is neither vaccine, nor drug available for the disease treatment. By the term “quarantine,” we mean all direct (isolation) and indirect protective measures during a specified period.The very first observation that should be done is that for these two models, the impact of the “quarantine” is very different. This observation dignifies the significance of the actual form of the dependency of the incidence rate on the population size.For each of these two control models, the optimal control problem, consisting in minimizing the Bolza type payoff objective function, was stated and solved. Applying optimal control theory, we determined the best control strategies that minimize the prevalence of COVID‐19 and the cost of applying quarantine‐related strategies. Using the Pontryagin maximum principle, we conducted a detail analysis of the optimal solutions for these optimal control problems (OCP‐1 and OCP‐2) and thereby established the principal properties of the corresponding optimal controls.Based on the knowledge of the basic reproductive numbers, we estimated the values for the control models parameters. For a variety of model parameters, we numerically found the optimal controls for different durations of the quarantine. The results of computations that were performed using BOCOP 2.0.5 software are presented and discussed. One of the notable conclusion that follows from these results is that the quarantine measures with intensity (that is, a reduction of contacts to 10% of the pre‐quarantine level) is able to eventually eradicate the epidemic, and that the value of can be reduced for both control models.The results of calculations for both considered models and comparison of the dynamics of the system subjected to the optimal control with that of the uncontrolled systems (see (10) and (17)) confirm the undeniable benefits of the optimal controls. Thus, for both no‐control models, the fraction of the infectious (both the asymptomatic carriers of the virus along and the patients with symptoms) grows exponentially very quickly. For example, for system (10), for a moderate value of the basic reproductive number , at the end of the second month, the fraction of the infectious carriers (the value of for ) in a situation without quarantine is . On the other hand, for the same parameter but with the optimal quarantine, this fraction is equal to approximately of the infected in OCP‐1 and of the infected in OCP‐2. (See in Figures 5 and 8 the corresponding ()‐curves and Table 2.) The difference in about 1000 times is apparent.Our analysis and computations lead to the following conclusions regarding the optimal control policy in the absence of vaccine and effective drugs for COVID‐19:The COVID‐19 epidemic can be stopped by quarantine measures, and the virus can be eliminated by decreasing the level of infection below its survival level, for example, less than one secondary infection produced by one infected individual in each location. This outcome can be reached even without vaccination, by quarantine measures only.However, for both considered models short‐term (under 30 days) quarantine is insufficient for preventing the epidemics. One should not expect that even a 1‐month quarantine would be sufficient to decrease the infection to and below its survival level. A longer quarantine, for example, 60‐days quarantine, is needed to get decisive results.It is essential to keep as strong as possible quarantine for the most time of the planned period. The quarantine restrictions can be gradually reduced only when the infection level reaches a certain low level.For any quarantine duration, the control should never become zero, even at the end of the predetermined time interval. This fact confirms our analytical results stated by Lemmas 3 and 6. This implies that certain protective measures, such as wearing face masks, avoiding crowds, and maintaining strong personal hygiene practices, should be continued and encouraged in the society even at the end of a strict quarantine.We would also like to stress one more time that the outcome of any study of a quarantine crucially depends on the actual dependency of the incidence rate on the population size; this is probably the most important factor for quarantine measures modeling.