ISRN Biomathematics

Volume 2013 (2013), Article ID 103708, 11 pages

http://dx.doi.org/10.1155/2013/103708

## Stochastic Model for In-Host HIV Dynamics with Therapeutic Intervention

^{1}Center for Applied Research in Mathematical Sciences, Strathmore University, P.O. Box 59857 00200, Nairobi, Kenya^{2}Department of Mathematics, Makerere University, P.O. Box 7062, Kampala, Uganda

Received 22 February 2013; Accepted 27 March 2013

Academic Editors: X.-Y. Lou and J. Suehnel

Copyright © 2013 Waema R. Mbogo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Untangling the dynamics between HIV and CD4 cellular populations
and molecular interactions can be used to investigate the effective points
of interventions in the HIV life cycle. With that in mind, we propose
and show the usefulness of a stochastic approach towards modeling HIV
and CD4 cells’ dynamics *in vivo* by obtaining probability generating
function, the moment structures of the healthy CD4 cell and the virus
particles at any time *t*, and the probability of HIV clearance. The unique
feature is that both therapy and the intracellular delay are incorporated
into the model.
Our analysis shows that, when it is assumed that the drug is not
completely effective as is the case of HIV *in vivo*, the probability of
HIV clearance depends on two factors: the combination of drug efficacy
and length of the intracellular delay and also the education of the infected
patients. Comparing simulated data before and after treatment indicates the importance of combined therapeutic intervention and intracellular delay in having low, undetectable viral load in HIV-infected
person.

#### 1. Introduction

Since HIV pandemic first became visible, enormous mathematical models have been developed to describe the immunological response to infection with human immunodeficiency virus (HIV). Mathematical modeling has proven to be valuable in understanding the dynamics of infectious diseases with respect to host-pathogen interactions. When HIV enters the body, it targets all the cells with CD4 receptors including the CD4 T cells. The knowledge of principal mechanisms of viral pathogenesis, namely, the binding of the retrovirus to the gp120 protein on the CD4 cell, the entry of the viral RNA into the target cell, the reverse transaction of viral RNA to viral DNA, the integration of the viral DNA with that of the host, and the action of viral protease in cleaving viral proteins into mature products, has led to the design of drugs (chemotherapeutic agents) to control the production of HIV.

Chronic HIV-infection causes gradual depletion of the CD4 T-cell poll and, thus, progressively compromises the host’s immune response to opportunistic infections, leading to acquired immunodeficiency syndrome (AIDS) [1]. With the spread of the HIV-AIDS pandemic and in the absence of an “effective” vaccine or cure, therapeutic interventions are still heavily relied on. Several research studies have been carried out in the recent past, both theoretically and experimentally, to analyse the impact of therapy on the viral load in HIV-infected persons in order to ascertain the effectiveness of the treatment (see, e.g., [2–8]). Their utility lies in the ability to predict an infected steady state and examining the effects that the changes in parameters have on the outcome of the system over time to determine which parameters are most important in disease progression, and further determine critical threshold values for these parameters.

In HIV-infected individuals, the infection exhibits a long asymptomatic phase (after the initial high infectious phase) of approximately 10 years on average before the onset of AIDS. During this incubation period, which some call the clinical latency period, the individuals appear to be well and may contribute significantly to the spread of the epidemic in a community [9]. Some clinical markers such as the CD4 cell count and the RNA viral load (viraemia) provide information about the progression of the disease in infected individuals. Also, the clinical latency period of the disease may provide a sufficiently long period during which one can attempt an effective suppressive therapeutic intervention in HIV infections. Various biological reasons lead to the introduction of time delays in models of disease transmission. Time delays are used to model the mechanisms in the disease dynamics (see, e.g., [10, 11]).

Intracellular delays and the target-cell dynamics such as mitosis are two key factors that play an important role in the viral dynamics. Mitosis in healthy or infected target-cell population are typically modelled by a logistic term [2, 12–16]. Intracellular delays have been incorporated into the incidence term in finite or distributed form [4, 17–23]. In [13, 16], in-host viral models with a logistic growth term without intracellular delays are investigated, and it is shown that sustained oscillations can occur through Hopf bifurcation when the intrinsic growth rate increases. It is shown in [17, 23], in in-host models with both a logistic growth term and intracellular delay, that Hopf bifurcations can occur when the intracellular delay increases. In [19], using in-host models with a general form of target-cell dynamics and general distributions for intracellular delays, it is shown that the occurrence of Hopf bifurcation in these models critically depends on the form of target-cell dynamics. More specifically, it is proved in [20] that, if the target-cell dynamics are such that no Hopf bifurcations occur when delays are absent, introducing intracellular delays in the model will not lead to Hopf bifurcations or periodic oscillations.

To incorporate the intracellular delay phase of the virus life cycle, [24] assumed that virus production occurs after the virus entry by a constant delay . They came up with a basic in-host compartmental model of the viral dynamics containing three compartments: , , and denoting the populations of uninfected target cells, infected target cells that produce virus, and free virus particles, respectively. They further assumed that parameters , , and are turnover rates of the , and compartments, respectively. Uninfected target cells are assumed to be produced at a constant rate . They assumed also that cells infected at time will be activated and produce viral materials at time . In their model, constant is the death rate of infected but not yet virus-producing cells, and describes the probability of infected target cells surviving the period of intracellular delay from to . Constant denotes the average number of virus particles that each infected cell produces. Preceding assumptions lead to the following system of differential equations:

System (1) can be used to model the infection dynamics of HIV, HBV, and other viruses [2, 12–14, 25, 26]. It can also be considered as a model for the HTLV-I infection if , and are regarded as healthy, latently infected, and actively infected CD4 T cells [14, 15]. For detailed description and derivation of the model, as well as the incorporation of intracellular delays, we refer the reader to [24].

From the literature, many researchers have employed deterministic models to study HIV internal dynamics, ignoring the stochastic effects. We consider a stochastic model for the interaction of HIV virus and the immune system in an HIV-infected individual undergoing a combination-therapeutic treatment. Our aim in this paper is to use a stochastic model obtained by extending the model of [24] to determine the probability distribution, variance and covariance structures of the uninfected CD4+ cells, infected CD4 cells, and the free HIV particles in an infected individual at any time by examining the combined antiviral treatment of HIV. Based on the model, we obtain joint probability distribution, expectations, variance and covariance structures of variables representing the numbers of uninfected CD4 cells, the HIV-infected CD4 T cells, and the free HIV particles at any time and derive conclusions for the reduction or elimination of HIV in HIV-infected individuals, which is one of the main contributions of this paper.

The organization of this paper is as follows: in Section 2, we formulate our stochastic model describing the interaction of HIV and the immune system and obtain a partial differential equation for the probability generating function of the numbers of uninfected CD4 cells, the HIV-infected CD4 T cells, and the free HIV particles at any time , also moments for the variables are derived here. In Section 3, we derive the moments of the variables in a therapeutic environment and probability of extinction of HIV virus and also provide a numerical illustration to demonstrate the impact of intercellular delay and therapeutic intervention in controlling the progression of HIV. Some concluding remarks follow in Section 4.

#### 2. HIV and CD4 Cells Dynamics before Therapeutic Intervention

To study the interaction of HIV virus and the immune system, we propose a stochastic model by extending the deterministic model presented in the literature. A stochastic process is defined by the probabilities with which different events happen in a small time interval . In our model, there are two possible events (production and death/removal) for each population (uninfected cells, infected cells, and the free virons). The corresponding rates in the deterministic model are replaced in the stochastic version by the probabilities that any of these events occur in a small time interval .

*(**1)* *The Interaction of HIV Virus and the CD4 T-Cells*. A typical life-cycle of HIV virus and immune system interaction is shown in Figure 1.

Let be the size of the healthy cells population at time , be the size of infected cell population at time , and be the size of the virons population at time . In the model to be formulated, it is now assumed that instead of rates of births and deaths, there is a possibility of stochastic births or deaths of the heathy cells, infected cells and the virus particles. Thus, , , and are time-dependent random variables. This epidemic process can be modeled stochastically by letting the nonnegative integer values process , , and , respectively, represent the number of healthy cells, infected cells, and virons of the disease at time . Then, can be modeled as continuous time multivariate Markov chain. Let the probability of there being healthy cells, infected cells, and virons in an infected person at time be denoted by the following joint probability function: , for .

The standard argument using the forward Chapman-Kolmogorov differential equations is used to obtain the joint probability function , by considering the joint probability . This joint probability is obtained as the sum of the probabilities of the following mutually exclusive events.

*(**2)* *Population Change Scenarios. *Consider the following points.(1)There were healthy cells, infected cells, and virons by time , and nothing happens during the time interval . (2)There were healthy cells, infected cells, and virons by time , and one healthy cell is produced from the thymus during the time interval .(3)There were healthy cells, infected cells, and virons by time , and one healthy cell dies or is infected by HIV virus during the time interval . (4)There were healthy cells, infected cells, and virons by time , and one healthy cell is infected by HIV virus during the time interval .(5)There were healthy cells, infected cells, and virons by time and one infected cell dies (HIV-infected cell bursts or undergoes a lysis) during the time interval . (6)There were healthy cells, infected cells, and virons by time and one viron is produced (HIV-infected cell undergoes a lysis or the individual angages in risky behaviour) during the time interval .(7)There were healthy cells, infected cells, and virons by time , and one viron dies during the time interval .

We incorporate a time delay between infection of a cell and production of new virus particles, we let be the time lag between the time the virus contacts a target CD4 T cell and the time the cell becomes productively infected (including the steps of successful attachment of the virus to the cell and penetration of virus into the cell); this means the recruitment of virus producing cells at time is given by the density of cells that were newly infected at time and are still alive at time . If we also let be the death rate of infected but not yet virus producing cell, then the probability that the infected cell will survive to virus producing cell during the short time interval will be given by .

*(**3)* *Variables and Parameters for the Model*. The variables and parameters in the model are described as in Table 1.

Using the population change scenarios and parameters in Table 1, we now summarize the events that occur during the interval together with their transition probabilities in Table 2.

The change in population size during the time interval , which is assumed to be sufficiently small to guarantee that only one such event can occur in , is governed by the following conditional probabilities: Simplifying (2), we have the following forward Kolmogorov partial differential equations for : This will also be referred to as the Master equation or the Differential-Difference equation, with the condition

##### 2.1. The Probability Generating Function

The probability generating function of is defined by Differentiating (5) with respect to yields Differentiating again (5) with respect to , and yields Multiplying (3) by and summing over , , and , then applying (4), (5), (6), and (7) and on simplification we obtain This is called Lagrange partial differential equation for the probability generating function (pgf).

Attempt to solve (8) gave us the following solution: where and are constants.

Equation (9) is not solvable, even for any simple form of . However, it is possible to obtain the moment structure of from (8).

##### 2.2. The Marginal Generating Functions

Recall that Assuming that , , and and solving (8), we obtain the marginal partial generating functions for , , and , respectively,

##### 2.3. Numbers of CD4 T Cells and the Virons

As we know from probability generating function, Letting , we have Differentiating the partial differential equations of the pgf, we get the moments of , , and .

Differentiating (11) with respect to , , and , respectively, and setting , we have Therefore, the moments of from the pgf before treatment are as follows: The corresponding deterministic model of HIV-host interaction as formulated in [24] is given as follows: Comparing system of (15) with the system of (16), we see that expected values of the multivariate Markov process satisfies the corresponding deterministic model of the HIV-host interaction dynamics.

###### 2.3.1. Simulation

Using the parameter values and initial conditions defined in Table 1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (15) during infection and in the absence of treatment.

The second graph in Figure 2 is the population dynamics after taking the logarithm of the cell populations in the first graph.

From the simulations, it is clear that in the primary stage of the infection (period before treatment), a dramatic decrease in the level of the CD4-T cells occurs and the number of the free virons increases with time. With the introduction of intracellular delay, the virus population drops as well as an increase in the CD4, cells but then they stabilize at some point and coexist in the host as shown in Figure 2.

#### 3. HIV and CD4 Cells Dynamics under Therapeutic Intervention

Assume that at time , a combination therapy treatment is initiated in an HIV-infected individual. We assume that the therapeutic intervention inhibits either the enzyme action of reverse transcriptase or that of the protease of HIV in an HIV-infected cell. An HIV-infected cell with the inhibited HIV-transcriptase may be considered a dead cell as it cannot participate in the production of the copies of any type of HIV. On the other hand, an HIV-infected cell in which the reverse transcription has already taken place and the viral DNA is fused with the DNA of the host, but the enzyme activity of HIV-protease is inhibited, undergoes a lysis releasing infectious free HIV and noninfectious free HIV. A noninfectious free HIV cannot successfully infect a CD4 cell. Accordingly, at any time , the blood of the infected person contains virus producing HIV-infected cells, infectious free HIV, and noninfectious free HIV. A typical life cycle of HIV virus and immune system interaction with therapeutic intervention is shown in Figure 3.

Introducing the effect of treatment, the Lagrange partial differential equation becomes

##### 3.1. The Marginal Generating Functions

Recall that Setting , , and and solving (17), we obtain the marginal partial generating functions for , , and , respectively, as:

##### 3.2. Numbers of CD4+ T Cells and Virons under Therapeutic Intervention

From probability generating function one gets Letting , we have the expected number of target CD4+ T cells as follows:

Differentiating the partial differential equations of the pgf, we get the moments of , , and .

Differentiating (19) with respect to , , and , respectively, and setting , we have Therefore, the moments of from the pgf with therapeutic intervention are

###### 3.2.1. Simulation

Using the parameter values and initial conditions defined in Table 1, we illustrate the general dynamics of the CD4-T cells and HIV virus for model (23) with therapeutic intervention and test the effect of intracellular delay and drug efficacy (perform sensitivity analysis).

With drug efficacy, the virus stabilizes and coexists with the CD4 cells within the host as shown in the first graph in Figure 4.

Introducing intracellular time delay, , the CD4 cells increase and the virus population drops then stabilizes and again coexists within the host as illustrated in the second graph in Figure 4.

For and with drug efficacy, the dynamics change as shown in the last graph in Figure 4.

We now analyze drug effectiveness on the cell populations.

Figure 5 shows that, with improved HIV drug efficacy, a patient on treatment will have low, undetectable viral load with time. It also shows that the protease inhibitor drug efficacy is very important in clearing the virus. Also the figure shows that a combination of therapeutic intervention and intracellular delay is very important in lowering the viral load in an HIV-infected person.

##### 3.3. The Probability of HIV Clearance

We now calculate the distribution of times to extinction for the virons reservoir. If we assume the drug given at fixed intervals to sustain its efficacy to be effective in producing noninfectious virus, then we can clear the infectious virus. Using reverse transcriptase (ART), the infected cell can be forced to become latently infected (nonvirus producing cell) hence clearing the virus producing cell reservoir. If we assume that no newly infected cells become productively infected in the short time or that treatment is completely effective (), we can obtain the extinction probability analytically. In this case, the infectious virus cell dynamics decouples from the rest of the model and can be represented as a pure immigration-and-death process with master equation where is the probability that, at time , there are HIV particles. This probability has the conditional probability generating function where is the initial virus reservoir size, and . We noticed that this is a pgf of a random variable with a product of Poisson distribution with mean and a binomial distribution .

The probability of this population going extinct at or before time is given by The probability of extinction is the value of when , that is, From (27), it is evident that probability of clearance of HIV is affected by the combination of drug efficacy and intracellular delay, death of the virons and education (counseling the HIV patients on the risk of involvement in risk behaviors).

#### 4. Discussion and Recommendation

In this study, we derived and analyzed a stochastic model for in-host HIV dynamics that included combined therapeutic treatment and intracellular delay between the infection of a cell and the emission of viral particles. This model included dynamics of three compartments—the number of healthy CD4 cells, the number of infected CD4 cells, and the HIV virons—and it described HIV infection of CD4 T cells before and during therapy. We derived equations for the probability generating a function and using numerical techniques. In this paper we showed the usefulness of our stochastic approach towards modeling HIV dynamics by obtaining moment structures of the healthy CD4+ cell and the virus particles over time . We simulated the mean number of the healthy CD4 cell, the infected cells, and the virus particles before and after combined therapeutic treatment at any time . We will emphasize further usefulness of stochastic models in HIV dynamics in our future research.

Our analysis during treatment shows that, when it is assumed that the drug is not completely effective, as it is the case of HIV *in vivo*, the predicted rate of decline in plasma HIV virus concentration depends on three factors: the death rate of the virons, the efficacy of therapy, and the length of the intracellular delay. Our model produces an interesting feature that the successfully treated HIV patients will have low, undetectable viral load. We conclude that to control the concentrations of the virus and the infected cells in HIV-infected person, a strategy should aim to improve the cure rate (drug efficacy) and also to increase the intracellular delay . Therefore, the efficacy of the protease inhibitor and the reverse transcriptase inhibitor and also the intracellular delay play crucial role in preventing the progression of HIV.

The extinction probability model showed that the time it takes to have low, undetectable viral load (infectious virus) in an HIV-infected patient depends on the combination of drug efficacy and intracellular delay and also education of the infected patients. In our work, the dynamics of mutant virus were not considered, and also our study included dynamics of only three compartments (healthy CD4 cell, infected CD4 cells, and infectious HIV virus particles) of which extensions are recommended for further extensive research. In a follow-up work, we intend to obtain real data in order to test the efficacy of our models as we have done here with simulated data.

#### References

- M. Yan and Z. Xiang, “A delay-differential equation model of HIV infection of CD4
^{+}T-cells with cure rate,”*International Mathematical Forum*, vol. 7, pp. 1475–1481, 2012. View at Google Scholar - A. S. Perelson and P. W. Nelson, “Mathematical analysis of HIV-1 dynamics
*in vivo*,”*SIAM Review*, vol. 41, no. 1, pp. 3–44, 1999. View at Google Scholar · View at Scopus - D. E. Kirschner, “Using mathematics to understand HIV immune dynamics,”
*Mathematical Reviews*, vol. 43, pp. 191–202, 1996. View at Google Scholar - A. S. Perelson, A. U. Neumann, M. Markowitz, J. M. Leonard, and D. D. Ho, “HIV-1 dynamics
*in vivo*: virion clearance rate, infected cell life-span, and viral generation time,”*Science*, vol. 271, no. 5255, pp. 1582–1586, 1996. View at Google Scholar · View at Scopus - J. W. Mellors, A. Munoz, J. V. Giorgi et al., “Plasma viral load and CD4
^{+}lymphocytes as prognostic markers of HIV-1 infection,”*Annals of Internal Medicine*, vol. 126, pp. 946–954, 1997. View at Google Scholar - M. Nijhuis, C. A. B. Boucher, P. Schipper, T. Leitner, R. Schuurman, and J. Albert, “Stochastic processes strongly influence HIV-1 evolution during suboptimal protease-inhibitor therapy,”
*Proceedings of the National Academy of Sciences of the United States of America*, vol. 95, no. 24, pp. 14441–14446, 1998. View at Publisher · View at Google Scholar · View at Scopus - W. Y. Tan and Z. Xiang, “Some state space models of HIV pathogenesis under treatment by anti-viral drugs in HIV-infected individuals,”
*Mathematical Biosciences*, vol. 156, no. 1-2, pp. 69–94, 1999. View at Publisher · View at Google Scholar · View at Scopus - D. R. Bangsberg, T. C. Porco, C. Kagay et al., “Modeling the HIV protease inhibitor adherence-resistance curve by use of empirically derived estimates,”
*Journal of Infectious Diseases*, vol. 190, no. 1, pp. 162–165, 2004. View at Publisher · View at Google Scholar · View at Scopus - S. S. Y. Venkata, M. O. L. Morire, U. Swaminathan, and M. Yeko, “A stochastic model of the dynamics of HIV under a combination therapeutic intervention,”
*Orion*, vol. 25, pp. 17–30, 2009. View at Google Scholar - P. van den Driessche and J. Watmough, “Reproduction numbers and sub-threshold endemic equilibria for compartmental models of disease transmission,”
*Mathematical Biosciences*, vol. 180, pp. 29–48, 2002. View at Publisher · View at Google Scholar · View at Scopus - O. Arino, M. L. Hbid, and A. E. Dads,
*Delay Differential Equations and Applications*, Series II, Springer, Berlin, Germany, 2006. - A. S. Perelson, D. E. Kirschner, and R. De Boer, “Dynamics of HIV infection of CD4
^{+}T cells,”*Mathematical Biosciences*, vol. 144, no. 1, pp. 81–125, 1993. View at Google Scholar · View at Scopus - P. De Leenheer and H. L. Smith, “Virus dynamics: a global analysis,”
*SIAM Journal on Applied Mathematics*, vol. 63, no. 4, pp. 1313–1327, 2003. View at Publisher · View at Google Scholar · View at Scopus - M. A. Nowak and C. R. M. Bangham, “Population dynamics of immune responses to persistent viruses,”
*Science*, vol. 272, no. 5258, pp. 74–79, 1996. View at Google Scholar · View at Scopus - L. Wang and M. Y. Li, “Mathematical analysis of the global dynamics of a model for HIV infection of CD4
^{+}T cells,”*Mathematical Biosciences*, vol. 200, no. 1, pp. 44–57, 2006. View at Publisher · View at Google Scholar · View at Scopus - L. Wang and S. Ellermeyer, “HIV infection and CD4
^{+}T cell dynamics,”*Discrete and Continuous Dynamical Systems B*, vol. 6, no. 6, pp. 1417–1430, 2006. View at Google Scholar · View at Scopus - R. V. Culshaw and S. Ruan, “A delay-differential equation model of HIV infection of CD4
^{+}T-cells,”*Mathematical Biosciences*, vol. 165, no. 1, pp. 27–39, 2000. View at Publisher · View at Google Scholar · View at Scopus - A. V. M. Herz, S. Bonhoeffer, R. M. Anderson, R. M. May, and M. A. Nowak, “Viral dynamics
*in vivo*: limitations on estimates of intracellular delay and virus decay,”*Proceedings of the National Academy of Sciences of the United States of America*, vol. 93, no. 14, pp. 7247–7251, 1996. View at Publisher · View at Google Scholar · View at Scopus - M. Y. Li and H. Shu, “Impact of intracellular delays and target-cell dynamics on
*in vivo*viral infections,”*SIAM Journal on Applied Mathematics*, vol. 70, no. 7, pp. 2434–2448, 2010. View at Publisher · View at Google Scholar · View at Scopus - M. Y. Li and H. Shu, “Multiple stable periodic oscillations in a mathematical model of CTL response to HTLV-I infection,”
*Bulletin of Mathematical Biology*, vol. 73, no. 8, pp. 1774–1793, 2011. View at Publisher · View at Google Scholar · View at Scopus - P. W. Nelson, J. D. Murray, and A. S. Perelson, “A model of HIV-1 pathogenesis that includes an intracellular delay,”
*Mathematical Biosciences*, vol. 163, no. 2, pp. 201–215, 2000. View at Publisher · View at Google Scholar · View at Scopus - P. W. Nelson and A. S. Perelson, “Mathematical analysis of delay differential equation models of HIV-1 infection,”
*Mathematical Biosciences*, vol. 179, no. 1, pp. 73–94, 2002. View at Publisher · View at Google Scholar · View at Scopus - Y. Wang, Y. Zhou, J. Wu, and J. Heffernan, “Oscillatory viral dynamics in a delayed HIV pathogenesis model,”
*Mathematical Biosciences*, vol. 219, no. 2, pp. 104–112, 2009. View at Publisher · View at Google Scholar · View at Scopus - M. Y. Li and H. Shu, “Global dynamics of an in-host viral model with intracellular delay,”
*Bulletin of Mathematical Biology*, vol. 72, no. 6, pp. 1492–1505, 2010. View at Publisher · View at Google Scholar · View at Scopus - M. A. Nowak and R. M. May,
*Virus Dynamics*, Cambridge University Press, Cambridge, UK, 2000. - H. C. Tuckwell and F. Y. M. Wan, “On the behavior of solutions in viral dynamical models,”
*BioSystems*, vol. 73, no. 3, pp. 157–161, 2004. View at Publisher · View at Google Scholar · View at Scopus