The human immunodeficiency virus (HIV) can be suppressed by highly active anti-retroviral therapy (HAART) in the majority of infected patients. Nevertheless, treatment interruptions inevitably result in viral rebounds from persistent, latently infected cells, necessitating lifelong treatment. Virological failure due to resistance development is a frequent event and the major threat to treatment success. Currently, it is recommended to change treatment after the confirmation of virological failure. However, at the moment virological failure is detected, drug resistant mutants already replicate in great numbers. They infect numerous cells, many of which will turn into latently infected cells. This pool of cells represents an archive of resistance, which has the potential of limiting future treatment options. The objective of this study was to design a treatment strategy for treatment-naive patients that decreases the likelihood of early treatment failure and preserves future treatment options. We propose to apply a single, pro-active treatment switch, following a period of treatment with an induction regimen. The main goal of the induction regimen is to decrease the abundance of randomly generated mutants that confer resistance to the maintenance regimen, thereby increasing subsequent treatment success. Treatment is switched before the overgrowth and archiving of mutant strains that carry resistance against the induction regimen and would limit its future re-use. In silico modelling shows that an optimal trade-off is achieved by switching treatment at days after the initiation of antiviral therapy. Evaluation of the proposed treatment strategy demonstrated significant improvements in terms of resistance archiving and virological response, as compared to conventional HAART. While continuous pro-active treatment alternation improved the clinical outcome in a randomized trial, our results indicate that a similar improvement might also be reached after a single pro-active treatment switch. The clinical validity of this finding, however, remains to be shown by a corresponding trial.
Citation: von Kleist M, Menz S, Stocker H, Arasteh K, Schütte C, et al. (2011) HIV Quasispecies Dynamics during Pro-Active Treatment Switching: Impact on Multi-Drug Resistance and Resistance Archiving in Latent Reservoirs. PLoS ONE 6(3): e18204. doi:10.1371/journal.pone.0018204
Editor: Art Poon, British Columbia Centre for Excellence in HIV/AIDS, Canada
Received: November 4, 2010; Accepted: February 27, 2011; Published: March 24, 2011
Copyright: © 2011 von Kleist et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: MvK acknowledges financial support by BMBF funding. SM acknowledges financial support by DFG funding, provided through the Dahlem Research School of Freie Universität Berlin. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
In 1996, the tremendous clinical success of highly active antiretroviral therapy had led many researchers to believe that the eradication of HIV would be feasible. However, it was soon realized that inducible pro-virus persists in latently infected cells despite ongoing therapy and that the latent reservoir prevents HIV eradication within the patients lifetime –.
Latent infection is established when T-lymphoblasts containing integrated provirus ,  escape both immune effector mechanisms and the cytopathic effects of the virus and revert to a resting memory state . Besides preventing eradication of HIV, the latent reservoir also serves as a memory of any virus species replicating during the course of HIV infection , , including drug resistant variants. The contents of this archive of resistance are strong predictors of future treatment failure , .
Despite the impressive improvement of antiviral therapy, many patients still experience virological failure caused by the selection of drug resistant virus populations. Current guidelines recommend changing treatment after the confirmation of virological failure. However, in the face of the rapid viral turnover this approach could be sub-optimal . Changing therapy after the appearance of drug resistant mutants will (i) allow the resistant viral population size to expand and evolve and (ii) lead to an archivation of resistant viral strains. An optimal treatment strategy should therefore prevent viral relapse with drug resistant strains and, more importantly, prevent drug resistant mutants from establishing latent infection.
Induction-maintenance (IM) approaches are used for the treatment of a growing number of infectious- and neoplastic diseases –. Typically, patients start with an intensified induction regimen (composed of a number of potent and potentially toxic drugs), which will subsequently be replaced by a maintenance regimen (composed of a smaller number of less toxic drugs) . However, patients treated with a large number of drugs are particularly vulnerable to drug interactions  and adverse side effects that complicate HIV therapy and seriously undermine the success of clinical management .
Another approach to overcome the development of resistance is to alternate antiretroviral therapy . This strategy has been shown to significantly delay virological failure , , yet it is flawed by its high psychological and physical burden .
We propose an approach that combines the advantages of conventional IM- and treatment alternation strategies, but minimizes their inherent disadvantages. We suggest a single, pro-active treatment switch from an inducer drug combination to a maintenance combination. The inducer drug combination should rapidly lower the viral population size and eliminate resistant mutants. Subsequently, it will be replaced by a maintenance drug regimen with a completely different resistance profile, before drug resistant strains are archived.
We have previously introduced a novel model of virus dynamics and adaptation , which allows us to consider the distinct molecular effects of all novel (and some developmental) HIV drugs. In this article, we present a novel mathematical concept, which prevents the emergence of drug resistance in each individual realization (virtual patient) of the model by switching between therapies. Utilizing this concept, we deduce a distribution of (individual) switching-times, which we use to determine a single fixed duration for the induction therapy, which increases the treatment success probability in the whole virtual patient population and which minimizes the risk for resistance to become archived in the latent reservoir. Finally, the performance of this novel induction-maintenance-strategy is evaluated against conventional HAART therapy.
Virus dynamics model
We have extended the existing viral dynamics model, described in , for the compartment of very long lived, latently infected T-cells (Fig. 1 and Materials and Methods section), which are believed to prevent eradication of HIV  and to lead to the archiving of drug resistance , .
Figure 1. Extended virus dynamics-, mutation- and drug interference model.
Target cells () can become successfully infected by infective virus with infection rate constants and , respectively, creating early infected cells and . Infection can also be unsuccessful after the step of viral fusion (rate constant and ), eliminating the virus and rendering the cell uninfected. Early infected cells and can also destroy essential viral proteins or DNA prior to integration, returning the cell to an uninfected stage. The genomic viral DNA can become integrated with rate constants and creating post-integration, infected cells and . The latently infected cell type does not express viral genes, but can become activated with rate , transforming this cell into a productively infected T-cell . Virus producing cells release new infectious- and non infectious virus and with rate constants and , respectively. Phenotypic mutation occurs at the stage of viral genomic integration (see ). All cellular compartments can get destroyed by the immune system with respective rate constants and the free virus (infectious and non-infectious) gets cleared with rate constant (not shown in the illustration). The site of drug interference with the replicative cycle of HIV is indicated by blue bars for the respective drug classes (NRTIs, NNRTIs, FIs, CCR5-inhibitors, INIs, PIs, and maturation inhibitors).doi:10.1371/journal.pone.0018204.g001
Briefly, the virus dynamics model (Fig. 1) comprises T-cells, macrophages, free non-infectious virus (, respectively), free infectious virus of mutant strain , and five types of infected cells belonging to mutant strain : infected T-cells and macrophages prior to proviral genomic integration ( and , respectively) and infected T-cells and macrophages after proviral genomic integration ( and , respectively). The latently infected cell type does not express viral genes, but can become activated with rate , transforming this cell into a virus producing post-integration infected T-cell . The average rates of change of the different species are displayed in the Materials and Methods section. All parameter values have been chosen according to previous studies and are displayed in Table 1. Since some viral strains are present only in very low copy numbers, we used a hybrid stochastic-deterministic approach  to perform simulations (see Materials and Methods section for details).
Table 1. Model parameters generally used in simulations.doi:10.1371/journal.pone.0018204.t001
Treatment change before virological failure
Currently, changes of antiretroviral treatment regimes are largely triggered by virological failure or toxicity. In Fig. 2A, we show the simulated viral load in the case of first line treatment failure. The corresponding population dynamics of HIV are shown in Fig. 2B. During first line treatment failure, resistant mutants (green- and cyan colored lines in Fig. 2B) are selected from the quasi-species population and quickly evolve into the dominant virus population, leading to viral rebound. While the total virus population is temporarily shrinking, mutants that confer resistance against a potential follow-up treatment (red line, dark grey shaded area in Fig. 2B) are depleted (possibly eradicated). However, during viral rebound the total viral population re-expands and consequently erroneous reverse transcription generates novel mutants that can confer resistance against a second line therapy. Once the viral population size has been restored, the second line therapy, although composed of entirely different drugs, is as likely to fail as before the initiation of first line therapy. Furthermore, it is likely that drug resistant viral strains become archived while they dominate the viral population (light grey shaded area in Fig. 2B).
Figure 2. Abundance of viral mutants during first-line treatment failure and during proposed induction-maintenance strategy.
A: Plasma virus load during first line treatment failure (blue line). B: Total abundance of distinct viral mutants during first-line treatment failure. C: Plasma virus load (blue line) during proposed induction-maintenance strategy with switch between induction- and maintenance treatment at 80 days (vertical dashed line). D: Total abundance of distinct viral mutants during proposed induction-maintenance strategy. The magenta line denotes the abundance of wildtype virus. Green- and cyan lines denote the abundance of mutants that are part-resistant against the first line regimen (resistant against two out of three drugs) and mutants that are fully resistant against the first line regimen, respectively. The red lines denote the abundance of all mutants, which are part-resistant against a second line treatment. The area under the red line is highlighted by the dark grey shaded area, to stress the negative impact of these mutants on the success of a second line regimen. The light shaded area in panel B indicates that resistant mutants are more abundant than the wildtype and therefore highlights when drug resistance archiving in latently infected cells takes place. The simulations were performed by assuming 70% drug efficacy and a fitness loss of 20% per drug resistance mutation. Furthermore, it was assumed that a single point mutation can confer absolute resistance to a single drug.doi:10.1371/journal.pone.0018204.g002
In Fig. 2C, we show the viral load dynamics during the proposed induction-maintenance therapy. The corresponding population dynamics of HIV are shown in Fig. 2D. The inducer combination reduces the viral load (see Fig. 2C). However, treatment is changed (vertical dashed black line) to the maintenance combination, before resistant strains (green and cyan line in Fig. 2D) can become more abundant than the wildtype (magenta line in Fig. 2D). Therefore, at the time of treatment change (vertical dashed black line in Fig. 2D), total virus has been decreased and mutants that confer resistance to the maintenance therapy (red line, dark grey shaded area in Fig. 2D) are likely to be eradicated, which improves the probability to achieve durable virological suppression with the maintenance therapy. With this strategy, the abundance of the wildtype is larger than the abundance of drug-resistant mutants, which lowers the probability that drug resistance enters the latent reservoir (light grey shaded area is absent in Fig. 2D).
In order to determine the optimal time point for switching from inducer- to maintenance- drug combinations, , we first determined relevant sets of parameters for (i) the in vivo efficacy of each utilized drug against the wildtype and (ii) the in vivo fitness loss that is associated with resistance development (shown in Table S1), since the corresponding in vivo parameters are known to vary substantially between different patients, e.g. . For simulation purposes, we assumed that a single point mutation is sufficient to create high-level resistance (99%) to a single drug. This is somewhat a worst-case assumption, but is justified for a number of drugs, see e.g. , . Relevant clinical failure rates after one year in previously treatment-naive patients, who receive HAART in a clinical trial setting, are , (see Table S1).
We then use an algorithm that automatically switches from inducer- to maintenance drug combination, minimizing virological failure for each realization (virtual patient), respectively. A histogram of the derived (individual) switching times from a total of 6000 simulations is shown in Fig. 3. Based on the histogram, we finally chose a fixed time for changing from induction- to maintenance therapy. In the sequel, we evaluate, if the chosen time to change from inducer- to maintenance combination leads to a general improvement compared to conventional HAART therapy, in terms of treatment success and drug resistance archiving.
Figure 3. Histogram of optimal, individual treatment switching times.
Switching times for changing from inducer- to maintenance therapy were automatically determined and carried out (using eq. (1)). The 0.5th percentile, marked by the red line, was determined and the corresponding time days was used as a fixed value in the suggested strategy to switch from inducer- to maintenance therapy. Hybrid deterministic-stochastic simulations were performed at clinically relevant parameter sets (see Table S1). Drug switches occurred in a total of 5478 out of 6000 simulations.doi:10.1371/journal.pone.0018204.g003
Determination of treatment changing time
In  we introduced the ‘reproductive capacity’ . For the extended model used herein, we have provided the derivation of in the Materials and Methods section. The reproductive capacity can be envisaged as the amount of offspring that the whole viral population is expected to produce under some treatment during one round of replication. It can be calculated from any model simulation and enables to evaluate each state of the infection from the perspective of any potential treatment . As the viral population adapts to some currently applied treatment, changes accordingly: is large initially and decreases subsequently until drug resistant strains develop and render the treatment inefficient. We want to assess the point in time, when some inducer- drug combination stops to provide any benefits (in terms of the viral population) for the next drug combination (maintenance combination). We therefore evaluate for while the induction combination is applied and change from the induction- to the maintenance therapy when reaches its minimum;(1)
The derived switch-times are displayed in Fig. 3. We chose the 0.5th percentile at days as a fixed time for treatment change in the forthcoming evaluation of the proposed induction-maintenance-strategy.
Implementation of conventional vs. proposed induction-maintenance-strategy
In order to reflect the clinical practice of HIV care, we have implemented the following routine for assessing the efficacy of the applied treatment combinations.
Our virtual patients are monitored every month for efficacy assessment until virus levels fall below the limit of detection (50 HIV RNA/mL plasma). Thereafter, they are monitored every other month. Virological failure has been defined according to treatment guidelines : At the first efficacy assessment (one month after treatment initiation), viral load should have fallen by at least 2 logs [HIV RNA/mL plasma]. Each consecutive measurement should be below the previous assessment. By month 4, viral load should be below the level of detection (50 HIV RNA/mL plasma). After that, detectable virus is defined as virological failure.
We implemented conventional HAART in the following way: The virtual patients are initially treated with a drug combination consisting of two nucleoside reverse transcriptase inhibitors (NRTIs) and one non-nucleoside reverse transcriptase inhibitor (NNRTI) (e.g. tenofovir (TDF) + emtricitabine (FTC) + efavirenz (EFV)), until virological failure is detected, in which case treatment is changed to a second line regimen consisting of a protease inhibitor (PI), an integrase inhibitor (InI) and an entry inhibitor (EI) (e.g. ritonavir (RTV) -boosted PI + raltegravir (RLV) + maraviroc (MVR)).
In the proposed induction-maintenance-strategy, patients are initially treated with a combination consisting of a PI, an InI and an EI, until days. After that, a treatment consisting of two NRTIs and one NNRTI is applied. If failure is detected at any efficacy assessment time point, treatment change is applied.
In the following, we performed 1000 hybrid stochastic-deterministic simulations for each relevant parameter set (deduced from Table S1) and counted the number of realizations, in which virological failure occurred. Furthermore, we assessed, if the number of drug resistant mutants in the very long-lived infected cells was higher at the end of the simulation than upon initiation of treatment. In this case we recorded “archiving” of drug resistance. The results of our simulations are discussed in the next section.
Proposed induction-maintenance-strategy improves success rate and minimizes archiving of drug-resistance
Fig. 4A shows that the proposed induction-maintenance-strategy (blue line) with a fixed treatment switch time of days leads to a significant reduction in the probability to experience virological failure compared to the conventional treatment strategy (red line). This observation holds true for a wide range of parameters (see Table 2, second column). In only two cases, where failure rarely occurs during conventional therapy, we do not get significant differences at the p = 0.05 level.
Figure 4. Kaplan-Meier estimates for treatment success, and correlation between virological failure and archiving of drug resistance.
The plots summarize the results trough the whole simulated parameter space from Table 2 (12000 simulations in total). A: Probability of no virological failure (%) for the IM-strategy (blue line) and the conventional therapy (red line), respectively. Dashed lines are the 95% confidence ranges, calculated using Greenwood's formula. Virological failure was defined according to  and is summarized in section “Implementation of conventional vs. proposed induction-maintenance-strategy”. B: The probability to virological failure vs. the average number of drug resistance archiving in the latent reservoir. A strong positive correlation () between virological failure and drug resistance archiving exists, as indicated by spearman's non-parametric rank correlation coefficient .doi:10.1371/journal.pone.0018204.g004
Table 2. Probability of virological failure and -archivation of multi-drug resistant virus during suggested induction-maintenance- (IM) vs. conventional HAART strategy.doi:10.1371/journal.pone.0018204.t002
Fig. 4B shows that virological failure and the average number of archived drug resistance mutations are strongly correlated (spearman's correlation coefficient , ). This indicates that virological failure is a strong predictor for drug resistance archiving.
Tables 2 (third–fifth column) show the number of cases in which archiving of multi-drug resistant viral strains (with , and drug resistance mutations) occurred in the latent reservoir, under the proposed induction-maintenance strategy and conventional HAART, respectively. It can be seen that the proposed treatment strategy leads to a significant reduction in multi-drug resistance archiving for the majority of parameters evaluated. This indicates, that although two treatment lines have been used for the novel therapy, more therapeutic options are on average available in the follow-up period, compared to conventional therapy.
We have presented and tested (in terms of a mathematical model) a very simple treatment strategy that can lead to significant reductions in virological failure in comparison to conventional HAART treatment. A unique drug combination (inducer combination) is used for a short time (80 days) and pro-actively switched to a maintenance combination. The purpose of the inducer combination is to decrease viral population size and thereby increase the likelihood that the subsequent therapy (maintenance) will achieve durable suppression. Clinical implementation of this novel treatment strategy requires only one additional clinical visit at 80 days in comparison with the conventional HAART therapy. The important finding of our study is, that although two drug combinations are always utilized during the proposed induction-maintenance strategy, less archiving of drug resistance occurs in comparison with a conventional treatment strategy, where a second treatment line would be applied only in the case of virological failure or toxicity. Less drug resistance archiving implies that more treatment options will be available for the follow-up and long-term management of HIV-infected patients when the proposed induction-maintenance treatment strategy is used (see Table 2, third–fifth column).
Fig. S1 shows that only a few archiving events ( fully resistant mutants) are sufficient to eliminate treatment options permanently. The number of circulating latently infected cells is small , , , . Detecting a small subset of mutants within the circulating latently infected cells is experimentally not feasible, because standard sequencing technology will detect the major strains , while novel, second generation methods require large samples . Hence, mathematical modelling is a reasonable tool to investigate drug resistance archiving following treatment application.
The time for switching between combinations ( = 80 days) is the most critical parameter for the success of the proposed strategy. The following two considerations have to be taken into account: (i) The inducer combination should be applied only for a short time, to prevent the selection and archiving of mutants, which are resistant to the current drug combination and would limit the further use of this drug combination (risk of the strategy), (ii) while at the same time, it has to be applied long enough to possibly eradicate viral mutants, which are resistant to the next drug combination (the benefit of the strategy).
The time required for resistant mutants to emerge, depends on their abundance before the initiation of therapy (if they pre-exist and are selected from the population) and also on their genetic distance to the wildtype (if resistance is de novo developed). As discussed above, we determine the abundance of mutants at the time of therapy initiation by utilizing the deterministic fix-point as starting condition for our simulations. We have shown the non-inferiority of our approach in Fig. 5, if drug resistant mutants are more abundant than expected. We have assumed the shortest genetic distance possible between wildtype and fully drug resistant mutants (one mutation is sufficient to create full resistance against a single drug, three distinct mutations are required for full resistance against a triple-drug combination). For some drugs, however, subsequent accumulation of mutations creates fully drug resistant mutants . In our model, drug resistance might therefore develop more rapidly than in vivo for drugs with a large genetic barrier . This implies that in vivo the inducer combination could possibly be applied for a longer time frame than the 80 days utilized in our model, if the genetic distance between wildtype and fully drug resistant mutant was greater than considered here (greater than one point mutation). However, our results demonstrate that even a very short time (80 days) in which the inducer combination is applied, can improve the clinical outcome significantly (see Fig. 4 and Table 2). This short time already minimizes the probability that drug resistance emerges and can, in that sense, be considered safer than a longer induction phase.
Figure 5. Kaplan-Meier estimates of treatment success (probability of no virological failure) for very high initial abundance of drug resistant mutants.
The figure shows the outcome of 500 simulations for the proposed induction-maintenance strategy (blue line) and for the conventional HAART therapy (red line), respectively. Dashed lines indicate the 95% confidence ranges, calculated using Greenwood's formula. The initial abundance of drug resistant mutants was set to 1% of the population. Other parameter values: = 0.75, = 0.8.doi:10.1371/journal.pone.0018204.g005
Eradication of viral mutants depends critically on their abundance prior to the initiation of therapy and on the rate at which viral compartments (and therefore resistant mutants) are cleared in vivo. The elimination of viral compartments in vivo has been quantified and validated in a number of clinical studies –. We used the expected abundance of viral mutants (the deterministic fix-point of the model) to estimate the abundance of different viral mutants at the time of treatment initiation. In Fig. 5 we show non-inferiority of our approach in the case, where an unexpectedly high abundance of drug resistant mutants is present (1% of the wildtype; detection limit of second generation sequencing technologies , , ), which would require longer time for eradication.
One limitation of the proposed induction-maintenance strategy is the potential inability to eliminate viral strains, that carry resistance to the maintenance therapy. This is particularly the case, if viral mutants, which carry resistance against all (or at least the majority of) drugs in the maintenance combination, are archived in the latent reservoir prior to treatment initiation. In Fig. S1B, we have quantified that 40 fully resistant viral mutants in the latent reservoir eliminate treatment options permanently. However, the likelihood for fully resistant archival copies (resistant against all drugs in the maintenance regimen) in the treatment naive patient, who was infected with wildtype virus, is relatively small. Based on quasi-species theory, Ribero et al.  calculated the pre-treatment frequency of viral mutants. According to , the frequency of double mutants (part-resistant) relative to the wildtype equals(2)
where and are the selective disadvantages of the strain carrying the first-, the second- and the both drug-resistance mutations and is the single point mutation rate . It is reasonable to assume that resistant mutants are, at best, as likely to enter the latent reservoir as the wildtype in the absence of any drugs, due to their inherent fitness loss, i.e. . Considering a maintenance combination consisting of efavirenz (EFV), tenofovir (TDF) and emtricitabine (FTC), with primary resistance mutations K103N, K65R and M184V and respective selective disadvantages for the single-point mutants and  and additive fitness losses in the double mutants (i.e. ), the probability that mutants, resistant against two out of three maintenance drugs, enter the latent reservoir are and respectively. Using in vivo data, Chun et al.  estimated the average number of latently infected cells with replication-competent provirus to be cells, so that the expected number of partly-resistant mutants that are archived prior to treatment initiation is and . In other words, it is very unlikely that part-resistant mutants are archived in patients prior to treatment, since . Furthermore, part-resistant mutants are still susceptible to one out of the three drugs in the maintenance combination. For triple-drug (fully) resistant strains, the likelihood of archival copies is even smaller.
Infection with drug resistant strains, mainly against established drug classes, is a major, growing health concern . During infection with drug-resistant viral strains, archivation in the latent reservoir is likely, since this reservoir is established early in the infection . If the circulating viral population reverses to a drug-susceptible type, archived resistant mutants from the time of infection might remain undetected and can complicate subsequent treatment (see Fig. S1). This particular circumstance applies equally to the proposed induction-maintenance therapy and conventional HAART.
For our strategy, we have chosen drugs from novel classes (e.g. InI, EI) for the inducer-combination, while we selected drugs from well-established classes for the maintenance combination (NNRTI, NRTI). This has the following rationale: The inducer combination will only be applied for a short time (80 days), while the maintenance combination could possibly be applied for much longer periods of time (until it fails, or toxicological events occur). Second or third generation drugs within the established drug-classes are often more convenient to apply (e.g. once daily dosing) and are less toxic, which has important implications for the long-term management of HIV . Secondly, drugs from the novel drug classes (InI, EI), are currently not available as generic formulations, whereas low-cost alternative drugs exist for established drug classes. Therefore, in order to reduce treatment costs, it is of advantage to select a strategy, in which inexpensive drugs can be used for the majority of time, while cost-intensive ones are only applied for short treatment periods.
Some drug classes can cause a distinct viral load decline. In particular, the only approved InI raltegravir causes a more rapid viral load decay, compared with other HIV inhibitors , . It might therefore seem logical, based on viral load decay, to use raltegravir in the induction treatment. It has been shown, however, that the faster viral decay with raltegravir could be a consequence of the particular site of action of InIs within the viral life cycle and may not be due to an overall increased removal rate of replication-competent viral compartments by raltegravir , . Long-term studies of raltegravir- versus efavirenz-based HAART showed equal outcomes with either therapies , , arguing against the superiority of raltegravir-based drug combinations in removing replication-competent virus; however, further analysis is required.
Intuitively, it might be more advantageous to use drug resistance tests to guide treatment switches, instead of using a fixed time for a pro-active switch from inducer- to maintenance combination . However, under the considerations discussed above, a switch from inducer- to maintenance combination should be applied before any resistant strains become abundant. This implies that the most frequent viral strain at the time of switch should be the wildtype. Standard assays fail to detect minority species . Ultra-deep/pyro-sequencing might provide a more holistic picture of the quasi-species composition and can pick up viral mutants that are abundant in of the quasi-species population and if the sample is large enough , , . However, even in this case, viral mutants are likely to dominate once the results are available ( week), owing to the rapid viral kinetics .
In our in silico study, we considered time-invariant, as well as anatomically homogeneous average drug efficacy , for the ease of modelling. It is also possible to consider drug- and patient-specific time-varying pharmacokinetics and to study the impact of compliance on drug resistance development. However, if compliance is identical between the two study arms, the qualitative difference between the outcome of conventional HAART versus the proposed induction-maintenance strategy is not expected to change. As shown in Table 2, the proposed induction-maintenance therapy performs better than conventional HAART for a wide range of parameter values for . Furthermore, it was shown in a clinical study ,  that treatment alternation leads to significantly less virological failure than conventional HAART, when compliance is imperfect but identical between the two study arms. However, since the study in ,  is not identical to the treatment strategy presented herein, a clinical study should be performed to fully investigate the potential of the proposed induction-maintenance strategy. Ideally, this prospective randomized trial could evaluate the time to virological failure in patients taking a single unchanged regimen and patients on induction-maintenance regimens. Importantly, the trial should be designed to evaluate whether the induction maintenance strategy affects the durability of second- and third line regimens. The presence and relative frequency of viral minority populations as well as their mutational patterns could be monitored by analyzing proviral DNA from circulating T-cells using, e.g., next-generation sequencing. This data could serve to validate our mathematical model.
Based on a recent, successful pre-exposure prophylaxis (PrEP) trial, where emtricitabine (FTC) + tenofovir (TDF) were given to high-risk individuals , it could be envisioned that PrEP is used more broadly. One risk with such a strategy is the selection of FTC/TDF resistance, which occurred in both subjects with acute HIV infection at enrolment in the PrEP trial . Furthermore, there is a high risk for the selection of drug resistance, if subjects get infected despite PrEP (e.g. due to low adherence; in the PrEP trial ). While FTC/TDF is a core component of first-line HAART, the long-term epidemiological consequences of drug-resistance selection are of utmost importance. One interesting question is whether the proposed induction-maintenance therapy can re-sensitize those subjects towards FTC/TDF treatment, who had become infected with HIV despite PrEP. While a thorough analysis of this question is beyond the scope of the current article, related scenarios are frequently encountered in the context of prevention of mother-to-child transmission (MTCT) programs, when short-course intrapartum nevirapine is used. In the MTCT context, protease-inhibitor-based induction therapy has been used for the re-sensitization of pre-exposed children towards nevirapine . Further analysis, however, is required to elucidate the potential of induction-maintenance strategies for re-sensitization of pre-exposed HIV infected individuals.
Materials and Methods
The virus dynamics model (Fig. 1) comprises T-cells, macrophages, free non-infectious virus (, respectively), free infectious virus of mutant strain , and five types of infected cells belonging to mutant strain : infected T-cells and macrophages prior to proviral genomic integration ( and , respectively) and infected T-cells and macrophages after proviral genomic integration ( and , respectively). The latently infected cell type does not express viral genes, but can become activated with rate , transforming this cell into a virus producing post-integration infected T-cell . The average rates of change of the different species are given by the following system of ODEs:
where and are the birth rates of uninfected T-cells and macrophages, and and denote their death rate constants. The parameters and are the integration rate constants of mutant strain under treatment . The parameters and are the death rate constants of and cells, respectively. The free virus (infectious and non-infectious) gets cleared by the immune system with rate constant . The parameters and refer to the intracellular degradation of essential components of the pre-integration complex, e.g., by the host cell proteasome within early infected T-cells and macrophages, respectively. and denote the total number of released infectious and non-infectious virus from late infected T-cells and macrophages of mutant strain , and and are the rates of release of infective virus under treatment . The parameters and denote the clearance of mutant virus through unsuccessful infection of T-cells and macrophages, respectively , and the parameters and denote the successful infection rate constants of mutant virus under treatment for T-cells and macrophages, respectively. In our model, T-cells can become latently infected with probability . Latent infected cells can undergo apoptosis with rate and can become activated with rate . Activation of latent cells by antigen- or other activating stimuli triggers the production of viral building blocks via positive feedback loops ,  in the late replication cycle of HIV, which turns the cell into a virus producing cell that becomes susceptible to HIV-related cytopathic effects and destruction by the immune system.
The parameter denotes the probability to mutate from strain to strain and is defined by(4)
where denotes the point mutation probability per base and reverse transcription process ( ), denotes the hamming distance between strain and strain , and is the total number of different positions that are considered in our model (here, point mutations). In total, the model includes different viral strains that contain point mutations in any pattern of the modelled possible mutations. The phenotype of each mutant strain is modelled by introducing a selective disadvantage , which denotes the loss of functionality (e.g., in the activity of some viral enzyme that is affected by the mutation) relative to the wildtype, and a strain specific inhibitory activity of treatment against the mutant strain . For example, the strain specific infection rate under a certain treatment is given by , where denotes the infection rate constant of the wildtype in the absence of drug (parameters listed in Table 1). The strain-specific specific inhibitory activity is calculated via , where the efficacy of the drugs against the wildtype is generally stated in the corresponding tables and figures (Fig. 2, Fig. 5 and Table 2) and the resistance of a particular mutant was either set to 1 (100% susceptible) or 0.01 (99% resistant), if the particular mutant conferred resistance to the particular drug .
All parameter values have been chosen according to previous studies (see Table 1). The particular viral decay dynamics after application of distinct drug classes were validated in . The model (Fig. 1) with above described parameters reproduces an average frequency of latently infected cells of cells (reference range: – cells , , , ), a total of latently infected cells (reference: ), with a halflife of 20.6 month (average of , –: 21 month) and a plasma viremia of HIV RNA/mL  from the latent reservoir.
Realization and Implementation of the Model
The overall virus dynamics in our model comprise different viral strains with copy numbers that can vary over several orders of magnitude. For this reason we have chosen a hybrid (stochastic-deterministic) setting for numerical simulation. This approach (i) takes into account stochastic fluctuations in the slow reaction processes; and (ii) reduces the computational costs for the simulation of the fast (deterministic) system dynamics. We used the direct hybrid method proposed in , where we treated elementary reactions as discrete stochastic processes whenever their propensity function or the quantity of at least one of their reactants was below a threshold of 20. All other reactions were approximated as continuous deterministic processes. Elementary reactions with propensity functions and their respective net changes can be deduced from eqs. (3). For example, the term denotes the infection reaction of T-cells by infectious virus. The propensity function of this reaction is . This reaction changes the species levels as follows: one cell and one virus get consumed (the term is once subtracted from each corresponding ODE), and one cell is produced (the term is once added to the ODE of ).
In brief, the hybrid method comprises the following algorithmic workflow:
- Set initial time and initial number of molecules .
- Generate two uniformly distributed pseudo-random variables and on the open unit interval and determine the partitioning of reactions into deterministic and stochastic subsets and , respectively. The latter is realized by comparing the actual propensity and the reactant levels of every reaction with pre-specified thresholds. If one value is below the thresholds, a reaction is included in the stochastic subset , otherwise it is put in the deterministic subset .
- Set and solve the ODE system for the deterministic part of the system starting at time (5)
until time such that .
- Take the integer satisfying(7)
in order to determine the stochastic reaction to be performed.
- Update according to reaction , hence set .
- Set , and stop the procedure if the final time is reached. Otherwise go to Step (2).
The above algorithmic scheme requires the use of numerical integrators that allow to stop integration in step (3) when a stochastic reaction event is detected at a time where . The utilized integrator is based on numerical differentiation formulas , and uses strategies for event detection and error- and step size control comparable to ode15s in Matlab . To generate the data for Fig. 4, we performed 12000 hybrid simulations in total. With realization start () the effects of drug treatment were simulated, until days was reached. Every numerical calculation was computed with a relative error tolerance of 10−6 and an absolute error tolerance of 10−9. Our simulation code is provided in Source Code S1–S6.
For the model above (eq. (3)), the reproductive numbers, which indicate the expected number of offspring in the next generation, are defined as follows: the reproductive number of a single virus of strain under treatment is given by
Since infected cells are also pathogens, which can lead to a rebound of the disease even in the absence of any virus, we also determined their basic reproductive numbers under a given treatment . The basic reproductive numbers and of the infectious stages and , associated with the viral strain , are given by
Finally, the reproductive numbers and of the infectious stages and , associated with the viral strain , are given by
We have previously introduced the reproductive capacity , which can be interpreted as the expected total number of infectious offspring that the infection produces in one round of replication under a certain treatment , given the current state of the infection. In this article, we utilize the reproductive capacity in order to get individual treatment switching times (see eq. (1), main article), which are displayed in Fig. 3. The reproductive capacity of the entire quasi-species ensemble under treatment is defined as the weighted sum of the basic reproductive numbers of all pathogenic stages of mutant strain , i.e., free virus, infected T-cells and infected macrophages, weighted by the abundance of the corresponding pathogenic stage :
where and are the strain-specific reproductive numbers of the different infective compartments (see previous sections).
Time and probability of virological failure depends on pool-size of archived drug-resistant virus. A: The median time until virological failure, in relation to the number of fully-resistant archived virus (fully = resistant against all drugs in the triple-drug combination). B: Probability that virological failure occurs within two years after initiation of HAART therapy as a function of the number of fully-resistant archived virus. 500 stochastic-deterministic runs were performed for each pool size of the latently infected drug-resistant reservoir. Parameter values used: = 0.75, = 0.8.
Determination of relevant parameter space for further investigation. We assessed virological failure rates after one year of triple drug therapy for varying values of efficacy of drug against the wildtype and selective disadvantage per mutation . All other parameters have been taken from Table 1. A parameter combination (in terms of and ) was considered relevant, if it produced realistic failure rates after one year of therapy . Confidence ranges are indicated in brackets and were calculated using Greenwood's formula. Each condition has been evaluated by 100 stochastic deterministic simulations.
The File ‘HAART.m’ can be used to simulate the kinetics of HIV after application of conventional HAART treatment in MATLAB.
The File ‘HIVmodel.m’ builds the original HIV model used throughout the manuscript for use in MATLAB.
The File ‘InductionMaintenance.m’ can be used to simulate the kinetics of HIV after under the proposed induction-maintenance therapy in MATLAB.
The File ‘PatientMonitoring.m’ contains the MATLAB implementation of routine patient monitoring.
The File ‘ReadMeFirst.txt’ Contains a description of all supplied source code files, contact details, information on runtime and execution and a copy of the GNU public license.
The authors would like to thank Prof. Karin Mölling (Head of Virology Dep., University Zürich, Switzerland) for helpful comments regarding the manuscript. We are very grateful to the National University of Ireland in Maynooth for providing the high-performance computing cluster. Special thanks to Vanush Misha Paturyan for assistance in scheduling jobs on the computing cluster.
Conceived and designed the experiments: MvK. Performed the experiments: MvK SM. Analyzed the data: MvK SM HS KA WH CS. Wrote the paper: MvK HS KA WH CS.
- 1. Finzi D, Hermankova M, Pierson T, Carruth LM, Buck C, et al. (1997) Identification of a reservoir for HIV-1 in patients on highly active antiretroviral therapy. Science 278: 1295–1300.
- 2. Finzi D, Blankson J, Siliciano JD, Margolick JB, Chadwick K, et al. (1999) Latent infection of CD4+ T cells provides a mechanism for lifelong persistence of HIV-1, even in patients on effective combination therapy. Nat Med 5: 512–517.
- 3. Wong JK, Hezareh M, Günthard HF, Havlir DV, Ignacio CC, et al. (1997) Recovery of replication-competent HIV despite prolonged suppression of plasma viremia. Science 278: 1291–1295.
- 4. Carter CC, Onafuwa-Nuga A, McNamara LA, Riddell J, Bixby D, et al. (2010) HIV-1 infects multipotent progenitor cells causing cell death and establishing latent cellular reservoirs. Nat Med 16: 446–451.
- 5. Chun TW, Finzi D, Margolick J, Chadwick K, Schwartz D, et al. (1995) In vivo fate of HIV-1-infected T cells: quantitative analysis of the transition to stable latency. Nat Med 1: 1284–1290.
- 6. Chun TW, Stuyver L, Mizell SB, Ehler LA, Mican JA, et al. (1997) Presence of an inducible HIV-1 latent reservoir during highly active antiretroviral therapy. Proc Natl Acad Sci U S A 94: 13193–13197.
- 7. Chun TW, Carruth L, Finzi D, Shen X, DiGiuseppe JA, et al. (1997) Quantification of latent tissue reservoirs and total body viral load in HIV-1 infection. Nature 387: 183–188.
- 8. Pierson T, McArthur J, Siliciano RF (2000) Reservoirs for HIV-1: mechanisms for viral persistence in the presence of antiviral immune responses and antiretroviral therapy. Annu Rev Immunol 18: 665–708.
- 9. Siliciano JD, Siliciano RF (2004) A long-term latent reservoir for HIV-1: discovery and clinical implications. J Antimicrob Chemother 54: 6–9.
- 10. Lambotte O, Chaix ML, Gubler B, Nasreddine N, Wallon C, et al. (2004) The lymphocyte HIV reservoir in patients on long-term HAART is a memory of virus evolution. AIDS 18: 1147–1158.
- 11. Reekie J, Mocroft A, Ledergerber B, Beniowski M, Clotet B, et al. (2010) History of viral suppression on combination antiretroviral therapy as a predictor of virological failure after a treatment change. HIV Med 11: 469–478.
- 12. Ho DD, Neumann AU, Perelson AS, Chen W, Leonard JM, et al. (1995) Rapid turnover of plasma virions and CD4 lymphocytes in HIV-1 infection. Nature 373: 123–126.
- 13. Blumberg HM, Leonard MK, Jasmer RM (2005) Update on the treatment of tuberculosis and latent tuberculosis infection. JAMA 293: 2776–2784.
- 14. Horstkotte D, Follath F, Gutschik E, Lengyel M, Oto A, et al. (2004) Guidelines on prevention, diagnosis and treatment of infective endocarditis executive summary; the task force on infective endocarditis of the european society of cardiology. Eur Heart J 25: 267–276.
- 15. Zimmerli W, Ochsner PE (2003) Management of infection associated with prosthetic joints. Infection 31: 99–108.
- 16. Curlin ME, Iyer S, Mittler JE (2007) Optimal timing and duration of induction therapy for HIV-1 infection. PLoS Comput Biol 3: e133.
- 17. Catanzaro LM, Slish JC, DiCenzo R, Morse GD (2004) Drug interactions with antiretrovirals. Curr HIV/AIDS Rep 1: 89–96.
- 18. Carr A (2003) Toxicity of antiretroviral therapy and implications for drug development. Nat Rev Drug Discov 2: 624–634.
- 19. D'Amato RM, D'Aquila RT, Wein LM (1998) Management of antiretroviral therapy for HIV infection: modelling when to change therapy. Antivir Ther 3: 147–158.
- 20. Martinez-Picado J, Negredo E, Ruiz L, Shintani A, Fumaz CR, et al. (2003) Alternation of antiretroviral drug regimens for HIV infection. A randomized, controlled trial. Ann Intern Med 139: 81–89.
- 21. Negredo E, Paredes R, Peraire J, Pedrol E, Côté H, et al. (2004) Alternation of antiretroviral drug regimens for HIV infection. efficacy, safety and tolerability at week 96 of the Swatch study. Antivir Ther 9: 889–893.
- 22. Sherr L, Lampe F, Norwood S, Leake-Date H, Fisher M, et al. (2007) Successive switching of antiretroviral therapy is associated with high psychological and physical burden. Int J STD AIDS 18: 700–704.
- 23. von Kleist M, Menz S, Huisinga W (2010) Drug-class specific impact of antivirals on the reproductive capacity of HIV. PLoS Comput Biol 6: e1000720.
- 24. Panel on Antiretroviral Guidelines for Adults and Adolescents. Guidelines for the use of antiretroviral agents in HIV-1-infected adults and adolescents Department of Health and Human Services . 1–161. December 1, 2009. (http://www.aidsinfo.nih.gov/contentfiles/adultandadolescentgl.pdf) (accessed 01-Oct-2010) .
- 25. Alfonsi A, Cancès E, Turinici G, Ventura B, Huisinga W (2005) Exact simulation of hybrid stochastic and deterministic models for biochemical systems. ESAIM Proc 14: 1–23.
- 26. Fabbiani M, Giambenedetto SD, Bracciale L, Bacarelli A, Ragazzoni E, et al. (2009) Pharmacokinetic variability of antiretroviral drugs and correlation with virological outcome: 2 years of experience in routine clinical practice. J Antimicrob Chemother 64: 109–117.
- 27. Clavel F, Hance AJ (2004) HIV drug resistance. N Engl J Med 350: 1023–1035.
- 28. Clavel F (2009) HIV resistance to raltegravir. Eur J Med Res 14: Suppl 347–54.
- 29. Riddler SA, Haubrich R, DiRienzo AG, Peeples L, Powderly WG, et al. (2008) Class-sparing regimens for initial treatment of HIV-1 infection. N Engl J Med 358: 2095–2106.
- 30. Blankson JN, Finzi D, Pierson TC, Sabundayo BP, Chadwick K, et al. (2000) Biphasic decay of latently infected CD4+ T cells in acute human immunodeficiency virus type 1 infection. J Infect Dis 182: 1636–1642.
- 31. Fondere JM, Planas JF, Huguet MF, Baillat V, Bolos F, et al. (2004) Enumeration of latently infected CD4+ T cells from HIV-1-infected patients using an HIV-1 antigen ELISPOT assay. J Clin Virol 29: 33–38.
- 32. Richman DD (2000) Principles of HIV resistance testing and overview of assay performance characteristics. Antivir Ther 5: 27–31.
- 33. Eriksson N, Pachter L, Mitsuya Y, Rhee SY, Wang C, et al. (2008) Viral population estimation using pyrosequencing. PLoS Comput Biol 4: e1000074.
- 34. Nijhuis M, Schuurman R, de Jong D, Erickson J, Gustchina E, et al. (1999) Increased fitness of drug resistant HIV-1 protease as a result of acquisition of compensatory mutations during suboptimal therapy. AIDS 13: 2349–2359.
- 35. Arora P, Dixit NM (2009) Timing the emergence of resistance to anti-HIV drugs with large genetic barriers. PLoS Comput Biol 5: e1000305.
- 36. Markowitz M, Louie M, Hurley A, Sun E, Mascio MD, et al. (2003) A novel antiviral intervention results in more accurate assessment of human immunodeficiency virus type 1 replication dynamics and T-cell decay in vivo. J Virol 77: 5037–5038.
- 37. Perelson AS, Neumann AU, Markowitz M, Leonard JM, Ho DD (1996) HIV-1 dynamics in vivo: virion clearance rate, infected cell life-span, and viral generation time. Science 271: 1582–1586.
- 38. Perelson AS, Essunger P, Cao Y, Vesanen M, Hurley A, et al. (1997) Decay characteristics of HIV-1-infected compartments during combination therapy. Nature 387: 188–191.
- 39. Ji H, Massé N, Tyler S, Liang B, Li Y, et al. (2010) HIV drug resistance surveillance using pooled pyrosequencing. PLoS One 5: e9263.
- 40. Archer J, Braverman MS, Taillon BE, Desany B, James I, et al. (2009) Detection of low-frequency pretherapy chemokine (CXC motif) receptor 4 (CXCR4)-using HIV-1 with ultra-deep pyrosequencing. AIDS 23: 1209–1218.
- 41. Ribeiro RM, Bonhoeffer S, Nowak MA (1998) The frequency of resistant mutant virus before antiviral therapy. AIDS 12: 461–465.
- 42. Mansky LM, Temin HM (1995) Lower in vivo mutation rate of human immunodeficiency virus type 1 than that predicted from the fidelity of purified reverse transcriptase. J Virol 69: 5087–5094.
- 43. Martinez-Picado J, Martínez MA (2008) HIV-1 reverse transcriptase inhibitor resistance mutations and fitness: a view from the clinic and ex vivo. Virus Res 134: 104–123.
- 44. Smith RJ, Okano JT, Kahn JS, Bodine EN, Blower S (2010) Evolutionary dynamics of complex networks of HIV drug-resistant strains: the case of San Francisco. Science 327: 697–701.
- 45. Ghosn J, Pellegrin I, Goujard C, Deveau C, Viard JP, et al. (2006) HIV-1 resistant strains acquired at the time of primary infection massively fuel the cellular reservoir and persist for lengthy periods of time. AIDS 20: 159–170.
- 46. Bartlett JA (2002) Addressing the challenges of adherence. J Acquir Immune Defic Syndr 29: Suppl 1S2–10.
- 47. Murray JM, Emery S, Kelleher AD, Law M, Chen J, et al. (2007) Antiretroviral therapy with the integrase inhibitor raltegravir alters decay kinetics of HIV, significantly reducing the second phase. AIDS 21: 2315–2321.
- 48. DeJesus E, Berger D, Markowitz M, Cohen C, Hawkins T, et al. (2006) Antiviral activity, pharmacokinetics, and dose response of the HIV-1 integrase inhibitor gs-9137 (jtk-303) in treatment-naive and treatment-experienced patients. J Acquir Immune Defic Syndr 43: 1–5.
- 49. Sedaghat AR, Dinoso JB, Shen L, Wilke CO, Siliciano RF (2008) Decay dynamics of HIV-1 depend on the inhibited stages of the viral life cycle. Proc Natl Acad Sci U S A 105: 4832–4837.
- 50. Lennox JL, DeJesus E, Lazzarin A, Pollard RB, Madruga JVR, et al. (2009) Safety and efficacy of raltegravir-based versus efavirenz-based combination therapy in treatment-naive patients with HIV-1 infection: a multicentre, double-blind randomised controlled trial. Lancet 374: 796–806.
- 51. Lennox JL, Dejesus E, Berger DS, Lazzarin A, Pollard RB, et al. (2010) Raltegravir versus efavirenz regimens in treatment-naive HIV-1-infected patients: 96-week efficacy, durability, subgroup, safety, and metabolic analyses. J Acquir Immune Defic Syndr 55: 39–48.
- 52. Ramratnam B, Bonhoeffer S, Binley J, Hurley A, Zhang L, et al. (1999) Rapid production and clearance of HIV-1 and hepatitis C virus assessed by large volume plasma apheresis. Lancet 354: 1782–1785.
- 53. Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY, et al. (2010) Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med 363: 2587–2599.
- 54. Coovadia A, Abrams EJ, Stehlau R, Meyers T, Martens L, et al. (2010) Reuse of nevirapine in exposed HIV-infected children after protease inhibitor-based viral suppression: a randomized controlled trial. JAMA 304: 1082–1090.
- 55. Weinberger LS, Burnett JC, Toettcher JE, Arkin AP, Schaffer DV (2005) Stochastic gene expression in a lentiviral positive-feedback loop: HIV-1 tat fluctuations drive phenotypic diversity. Cell 122: 169–182.
- 56. Lassen KG, Ramyar KX, Bailey JR, Zhou Y, Siliciano RF (2006) Nuclear retention of multiply spliced HIV-1 RNA in resting CD4+ T cells. PLoS Pathog 2: e68.
- 57. Zhang L, Ramratnam B, Tenner-Racz K, He Y, Vesanen M, et al. (1999) Quantifying residual HIV-1 replication in patients receiving combination antiretroviral therapy. N Engl J Med 340: 1605–1613.
- 58. Chun TW, Justement JS, Moir S, Hallahan CW, Maenza J, et al. (2007) Decay of the HIV reservoir in patients receiving antiretroviral therapy for extended periods: implications for eradication of virus. J Infect Dis 195: 1762–1764.
- 59. Siliciano JD, Kajdas J, Finzi D, Quinn TC, Chadwick K, et al. (2003) Long-term follow-up studies confirm the stability of the latent reservoir for HIV-1 in resting CD4+ T cells. Nat Med 9: 727–728.
- 60. Ramratnam B, Mittler JE, Zhang L, Boden D, Hurley A, et al. (2000) The decay of the latent reservoir of replication-competent HIV-1 is inversely correlated with the extent of residual viral replication during prolonged anti-retroviral therapy. Nat Med 6: 82–85.
- 61. Coffin J, Maldarelli F, Palmer S, Weigand A, Brun S, et al. (2006) Long-term persistance of low-level HIV-1 in patients on suppressive antiretroviral therapy. Abstract 169 13th Conference on Retroviruses and Opportunistic Infections; 5–8 February 2006; Denver, Colorado, United States Available at http://wwwretroconferenceorg/2006/Abstracts/28061htm.
- 62. Klopfenstein R (1971) Numerical differentiation formulas for stiff systems of ordinary differential equations. RCA Review 32: 447–462.
- 63. Shampine L, Reichelt M (1997) The Matlab ODE Suite. SIAM Journal on Scientific Computing 18: 1–22.
- 64. Wei X, Ghosh SK, Taylor ME, Johnson VA, Emini EA, et al. (1995) Viral dynamics in human immunodeficiency virus type 1 infection. Nature 373: 117–122.
- 65. Sedaghat AR, Siliciano RF, Wilke CO (2009) Constraints on the dominant mechanism for HIV viral dynamics in patients on raltegravir. Antivir Ther 14: 263–271.
- 66. Callaway DS, Perelson AS (2002) HIV-1 infection and low steady state viral loads. Bull Math Biol 64: 29–64.
- 67. Koelsch KK, Liu L, Haubrich R, May S, Havlir D, et al. (2008) Dynamics of total, linear nonintegrated, and integrated HIV-1DNA in vivo and in vitro. J Infect Dis 197: 411–419.
- 68. Zhou Y, Zhang H, Siliciano JD, Siliciano RF (2005) Kinetics of human immunodeficiency virus type 1 decay following entry into resting CD4+ T cells. J Virol 79: 2199–2210.
- 69. Pierson TC, Zhou Y, Kieffer TL, Ruff CT, Buck C, et al. (2002) Molecular characterization of preintegration latency in human immunodeficiency virus type 1 infection. J Virol 76: 8518–8531.