Applications in Science and Engineering for Modelling, Analysis and Control of ChaosView this Special Issue
Research Article | Open Access
Ruimin Xu, Rongwei Guo, "Pontryagin’s Maximum Principle for Optimal Control of Stochastic SEIR Models", Complexity, vol. 2020, Article ID 6479087, 5 pages, 2020. https://doi.org/10.1155/2020/6479087
Pontryagin’s Maximum Principle for Optimal Control of Stochastic SEIR Models
In this paper, we study the necessary conditions as well as sufficient conditions for optimality of stochastic SEIR model. The most distinguishing feature, compared with the well-studied SEIR model, is that the model system follows stochastic differential equations (SDEs) driven by Brownian motions. Hamiltonian function is introduced to derive the necessary conditions. Using the explicit formulation of adjoint variables, desired necessary conditions for optimal control results are obtained. We also establish a sufficient condition which is called verification theorem for the stochastic SEIR model.
New corona viruses are very harmful to people. Especially, COVID-19 is currently being spread around the world. It has seriously affected people’s lives. Many countries have made good efforts to deal with it and prevent it. At present, the COVID-19 epidemic in China has been basically controlled. It is well known that SEIR models are widely used to model the spreading of infectious diseases in a population. Up to now, many researchers from the world have achieved a variety of both theoretical results and applications, see [1, 2, 7, 9, 15, 16, 18, 20, 21] and the references therein.
However, it is worth pointing that out that SEIR models in the existing literatures are deterministic models. As we know the stochastic events are inevitable in practice, and the stochastic effects that may lead to significant changes, thus, the stochastic SEIR models maybe better to be applied to describe the COVID-19 epidemic. Motivated by the actual situation in reality and the lack of theory, this paper studies the optimal control of stochastic SEIR model. To the best of our knowledge, there were few literatures about the optimal control of epidemic model in the stochastic case. Our main objective is to derive necessary conditions for optimality of the stochastic SEIR model by using the stochastic maximum principle (SMP).
Stochastic optimal control problems have received considerable research attention in recent years due to wide applicability in a number of different fields such as physics, biology, economics, and management science. As it is well known, dynamic programming principle (DPP) and SMP are two main tools to study stochastic control problems. SMP, which provides a necessary condition of an optimal control in stochastic optimal control problems known as the stochastic version of Pontryagin’s type [3–6, 8, 11–14, 19], has been the tool predominantly used to study the stochastic optimal control problems and some stochastic differential game problems.
For example, by using SMP, Xu and Shi  obtain the feedback form of optimal control for linear-quadratic-Gaussian (LQG) problems to study stochastic large population system with jump diffusion processes. The standard SMP involves solving the adjoint equation and minimizing the Hamiltonian function. We also followed this in our paper. We should point out that the SEIR model studied in  is deterministic case, while our SEIR model is stochastic case, that is, the main difference between our model and the model studied in .
The organization of this paper is as follows. Section 2 is devoted to the problem formulation and assumptions. Necessary conditions for optimality are introduced in Section 3. Section 4 aims to prove that the necessary conditions presented in Section 3 are also the sufficient conditions for optimality. Finally, we end our work with some concluding remarks in Section 5.
2. Problem Statement and Assumptions
Throughout this paper, let be a fixed time horizon and be a given complete filtered probability space, on which independent standard one-dimensional Brownian motions are defined. The superscript denotes the transpose of vectors or matrices. We suppose that the filtration is generated by the independent standard one-dimensional standard Brownian motions .
Let denote the set of Lebesgue measurable functions such that . We write if is an -adapted square-integrable process (i.e., ). Let be nonempty subsets of . We introduce the admissible control set as
Now, we introduce our stochastic SEIR model. Let , and represent the number of individuals in the susceptible, exposed, infectious, and recovered compartments at time , respectively. The total population is denoted by . Let denote the fraction of susceptible individuals being vaccinated per unit of time.
We input the random disturbance proportionally to each variable value in the model and get the following dynamical system:
The parameters in the disease transmission model is described as follows: is the natural birth rate, represents the natural death rate, denotes the death rate due to the disease, and represents the incidence coefficient of horizontal transmission, and let be the rate at which the exposed individuals become infectious, and is removal rate. Note that the rate of transmission of the disease is . In the above model, denotes the random disturbance proportionally to each variable value in the model. The parameters in the model are supposed to be constants for simplicity. For more information about the disease transmission model, we refer the reader to [2, 9, 13] and references within.
The expected cost functional is given bywhere and are given constants.
The optimal control problem under consideration is as follows. Problem (P): the objective of the control problem is to find admissible control such that A control that solves this problem is called optimal.
3. Necessary Conditions for Optimality
This section focuses on the necessary optimality conditions of Problem (P).
In order to apply the necessary conditions for optimal control in the form of maximum principle, we first introduce some notations. Assume that
Therefore, stochastic SEIR model (2) can be written as
The corresponding cost functional is
Let be the optimal pair of Problem P. The standard Hamiltonian function is given bywhere the adjoint variable satisfies where .
Next, we want to obtain the adjoint variable explicitly. Let . According to (9), are explicitly given by
Next, we evaluate the necessary condition for the optimal control. By (8), we havewhich means
Now, we summarize the above discussion with the main result of this article.
4. Sufficient Conditions for Optimality
In this section, we will establish the sufficient maximum principle (also called verification theorem) of Problem P. That is to say, given in (12) is also the sufficient condition of Problem P.
Proof. For any , we considerApplying IÔ’s formula to, we obtainCombining (6), (9), (13), with (14), one haswhere, in the last step, we have used the condition of which fulfills (12).
Therefore, . Hence, we draw the desired conclusion.
Maria do Rosário de et al.  considered an optimal control problem with mixed control-state constraint for a SEIR epidemic model of human infectious diseases. Motivated by their pioneering work and the lack of theory, this paper is concerned with the necessary conditions (also, the sufficient conditions) for optimality of the stochastic SEIR model. The model system follows SDEs driven by Brownian motions and with the corresponding cost. It is the first attempt to study this kind of control problem in our technical note, to the authors’ knowledge. Using the explicit formulation of adjoint variables, we obtain the desired necessary conditions for optimal control results.
Some interesting topics deserve further investigations. On the one hand, one may determine the optimal control strategies for the stochastic delayed SIR model and compare it with that presented in this work. On the other hand, we shall investigate some more realistic but complex models, such as considering the effects of impulsive perturbations on the system. We leave these investigations in our future work.
The data used to support the findings of the study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
This research was partially supported by the Project of Shandong Province Higher Educational Science and Technology Program (Grant no. J18KA221), National Natural Science Foundation of China (Grant no. 61973185), Natural Science Foundation of Shandong Province (Grant no. ZR2018MF016), Development Plan of Young Innovation Team in Colleges and Universities of Shandong Province (Grant no.2019KJN011), Shandong Province Key Research and Development Program (Grant no. 2018GGX103054), and Young Doctor Cooperation Foundation of Qilu University of Technology (Shandong Academy of Sciences) (Grant no. 2018BSHZ2008).
- A. Abdelhadi and L. Hassan, “Optimal control strategy for SEIR with latent period and a saturated incidence rate,” ISRN Applied Mathematics, vol. 2013, pp. 1–4, 2013.
- B. Armbruster and E. Beck, “Elementary proof of convergence to the mean-field model for the SIR process,” Journal of Mathematical Biology, vol. 75, no. 2, pp. 327–339, 2016.
- A. Bensoussan, “Lectures on stochastic control,” in Nonlinear Filtering and Stochastic Control (Cortona, 1981), Lecture Notes in Math. 972, pp. 1–62, Springer, Berlin, New York, 1982.
- J.-M. Bismut, “Conjugate convex functions in optimal stochastic control,” Journal of Mathematical Analysis and Applications, vol. 44, no. 2, pp. 384–404, 1973.
- A. Cadenillas, “A stochastic maximum principle for systems with jumps, with applications to finance,” Systems & Control Letters, vol. 47, no. 5, pp. 433–444, 2002.
- U. G. Haussmann, “General necessary conditions for optimal control of stochastic systems,” Mathematical Programming Studies, vol. 6, pp. 30–48, 1976.
- X. Han, F. Li, and X. Meng, “Dynamics analysis of a nonlinear stochastic SEIR epidemic system with varying population size,” Entropy, vol. 2018, pp. 1–20, 2018.
- H. J. Kushner, “Necessary conditions for continuous parameter stochastic optimization problems,” SIAM Journal on Control, vol. 10, no. 3, pp. 550–565, 1972.
- Q. Liu, D. Jiang, N. Shi, T. Hayat, and B. Ahmad, “Stationary distribution and extinction of a stochastic SEIR epidemic model with standard incidence,” Physica A: Statistical Mechanics and Its Applications, vol. 476, pp. 58–69, 2017.
- P. Maria do Rosário de, I. Kornienko, and H. Maurer, “Optimal control of a SEIR model with mixed constraints and cost,” in CONTROLO’2014–Proceedings of the 11th Portuguese Conference on Automatic Control, pp. 135–145, Guimaraes, Portugal, January 2015.
- S. Peng, “A general stochastic maximum principle for optimal control problems,” SIAM Journal on Control and Optimization, vol. 28, no. 4, pp. 966–979, 1990.
- S. Peng, “Backward stochastic differential equations and applications to optimal control,” Applied Mathematics & Optimization, vol. 27, no. 2, pp. 125–144, 1993.
- J. Shi and Z. Wu, “Maximum principle for forward-backward stochastic control system with random jumps and applications to finance,” Journal of Systems Science and Complexity, vol. 23, no. 2, pp. 219–231, 2010.
- J. Shi and Z. Wu, “A risk-sensitive stochastic maximum principle for optimal control of jump diffusions and its applications,” Acta Mathematica Scientia, vol. 31B, no. 2, pp. 419–433, 2011.
- N. Sherborne, J. C. Miller, K. B. Blyuss, I. Z. Kiss, and I. Z. Kiss, “Mean-field models for non-Markovian epidemics on networks,” Journal of Mathematical Biology, vol. 76, no. 3, pp. 755–778, 2018.
- X. Wang, H. Peng, and B. Shi, “Optimal vaccination strategy of a constrained time-varying SEIR epidemic model,” Communications in Nonlinear Sciences and Numerical Simulation, vol. 67, pp. 37–48, 2019.
- R. Xu and J. Shi, “-Nash mean-field games for linear-quadratic systems with random jumps and applications,” International Journal of Control, vol. 114, Article ID 108835, pp. 1–11, 2019.
- X. Yi, R. Guo, and Y. Qi, “Stabilization of chaotic systems with both uncertainty and disturbance by the UDE-based control method,” IEEE Access, vol. 8, no. 1, pp. 62471–62477, 2020.
- J. Yong and X. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, Applied Mathematics, vol. 3, Springer-Verlag, New York, NY, USA, 1999.
- D. Zhao, T. Zhang, and S. Yuan, “The threshold of a stochastic SIVS epidemic model with nonlinear saturated incidence,” Physica A: Statistical Mechanics and Its Applications, vol. 443, pp. 372–379, 2016.
- X. Zhang and K. Wang, “Stochastic SEIR model with jumps,” Applied Mathematics and Computation, vol. 239, pp. 133–143, 2014.
Copyright © 2020 Ruimin Xu and Rongwei Guo. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.