skip to main content

Title: Detection of significant antiviral drug effects on COVID-19 with reasonable sample sizes in randomized controlled trials: A modeling study
Background Development of an effective antiviral drug for Coronavirus Disease 2019 (COVID-19) is a global health priority. Although several candidate drugs have been identified through in vitro and in vivo models, consistent and compelling evidence from clinical studies is limited. The lack of evidence from clinical trials may stem in part from the imperfect design of the trials. We investigated how clinical trials for antivirals need to be designed, especially focusing on the sample size in randomized controlled trials. Methods and findings A modeling study was conducted to help understand the reasons behind inconsistent clinical trial findings and to design better clinical trials. We first analyzed longitudinal viral load data for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) without antiviral treatment by use of a within-host virus dynamics model. The fitted viral load was categorized into 3 different groups by a clustering approach. Comparison of the estimated parameters showed that the 3 distinct groups were characterized by different virus decay rates ( p -value < 0.001). The mean decay rates were 1.17 d −1 (95% CI: 1.06 to 1.27 d −1 ), 0.777 d −1 (0.716 to 0.838 d −1 ), and 0.450 d −1 (0.378 to 0.522 d −1 more » ) for the 3 groups, respectively. Such heterogeneity in virus dynamics could be a confounding variable if it is associated with treatment allocation in compassionate use programs (i.e., observational studies). Subsequently, we mimicked randomized controlled trials of antivirals by simulation. An antiviral effect causing a 95% to 99% reduction in viral replication was added to the model. To be realistic, we assumed that randomization and treatment are initiated with some time lag after symptom onset. Using the duration of virus shedding as an outcome, the sample size to detect a statistically significant mean difference between the treatment and placebo groups (1:1 allocation) was 13,603 and 11,670 (when the antiviral effect was 95% and 99%, respectively) per group if all patients are enrolled regardless of timing of randomization. The sample size was reduced to 584 and 458 (when the antiviral effect was 95% and 99%, respectively) if only patients who are treated within 1 day of symptom onset are enrolled. We confirmed the sample size was similarly reduced when using cumulative viral load in log scale as an outcome. We used a conventional virus dynamics model, which may not fully reflect the detailed mechanisms of viral dynamics of SARS-CoV-2. The model needs to be calibrated in terms of both parameter settings and model structure, which would yield more reliable sample size calculation. Conclusions In this study, we found that estimated association in observational studies can be biased due to large heterogeneity in viral dynamics among infected individuals, and statistically significant effect in randomized controlled trials may be difficult to be detected due to small sample size. The sample size can be dramatically reduced by recruiting patients immediately after developing symptoms. We believe this is the first study investigated the study design of clinical trials for antiviral treatment using the viral dynamics model. « less
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
Kretzschmar, Mirjam E.
Award ID(s):
Publication Date:
Journal Name:
PLOS Medicine
Page Range or eLocation-ID:
Sponsoring Org:
National Science Foundation
More Like this
  1. Sugden, Bill (Ed.)
    The scientific community is focused on developing antiviral therapies to mitigate the impacts of the ongoing novel coronavirus disease 2019 (COVID-19) outbreak. This will be facilitated by improved understanding of viral dynamics within infected hosts. Here, using a mathematical model in combination with published viral load data, we compare within-host viral dynamics of SARS-CoV-2 with analogous dynamics of MERS-CoV and SARS-CoV. Our quantitative analyses using a mathematical model revealed that the within-host reproduction number at symptom onset of SARS-CoV-2 was statistically significantly larger than that of MERS-CoV and similar to that of SARS-CoV. In addition, the time from symptom onset to the viral load peak for SARS-CoV-2 infection was shorter than those of MERS-CoV and SARS-CoV. These findings suggest the difficulty of controlling SARS-CoV-2 infection by antivirals. We further used the viral dynamics model to predict the efficacy of potential antiviral drugs that have different modes of action. The efficacy was measured by the reduction in the viral load area under the curve (AUC). Our results indicate that therapies that block de novo infection or virus production are likely to be effective if and only if initiated before the viral load peak (which appears 2–3 days after symptom onset), butmore »therapies that promote cytotoxicity of infected cells are likely to have effects with less sensitivity to the timing of treatment initiation. Furthermore, combining a therapy that promotes cytotoxicity and one that blocks de novo infection or virus production synergistically reduces the AUC with early treatment. Our unique modeling approach provides insights into the pathogenesis of SARS-CoV-2 and may be useful for development of antiviral therapies.« less
  2. Faeder, James R. (Ed.)
    Repurposed drugs that are safe and immediately available constitute a first line of defense against new viral infections. Despite limited antiviral activity against SARS-CoV-2, several drugs are being tested as medication or as prophylaxis to prevent infection. Using a stochastic model of early phase infection, we evaluate the success of prophylactic treatment with different drug types to prevent viral infection. We find that there exists a critical efficacy that a treatment must reach in order to block viral establishment. Treatment by a combination of drugs reduces the critical efficacy, most effectively by the combination of a drug blocking viral entry into cells and a drug increasing viral clearance. Below the critical efficacy, the risk of infection can nonetheless be reduced. Drugs blocking viral entry into cells or enhancing viral clearance reduce the risk of infection more than drugs that reduce viral production in infected cells. The larger the initial inoculum of infectious virus, the less likely is prevention of an infection. In our model, we find that as long as the viral inoculum is smaller than 10 infectious virus particles, viral infection can be prevented almost certainly with drugs of 90% efficacy (or more). Even when a viral infection cannotmore »be prevented, antivirals delay the time to detectable viral loads. The largest delay of viral infection is achieved by drugs reducing viral production in infected cells. A delay of virus infection flattens the within-host viral dynamic curve, possibly reducing transmission and symptom severity. Thus, antiviral prophylaxis, even with reduced efficacy, could be efficiently used to prevent or alleviate infection in people at high risk.« less
  3. The antiviral remdesivir has been approved by regulatory bodies such as the European Medicines Agency (EMA) and the US Food and Drug administration (FDA) for the treatment of COVID-19. However, its efficacy is debated and toxicity concerns might limit the therapeutic range of this drug. Computational models that aid in balancing efficacy and toxicity would be of great help. Parametrizing models is difficult because the prodrug remdesivir is metabolized to its active form (RDV-TP) upon cell entry, which complicates dose–activity relationships. Here, we employ a computational model that allows drug efficacy predictions based on the binding affinity of RDV-TP for its target polymerase in SARS-CoV-2. We identify an optimal infusion rate to maximize remdesivir efficacy. We also assess drug efficacy in suppressing both wild-type and resistant strains, and thereby describe a drug regimen that may select for resistance. Our results differ from predictions using prodrug dose–response curves (pseudo-EC50s). We expect that reaching 90% inhibition (EC90) is insufficient to suppress SARS-CoV-2 in the lungs. While standard dosing mildly inhibits viral polymerase and therefore likely reduces morbidity, we also expect selection for resistant mutants for most realistic parameter ranges. To increase efficacy and safeguard against resistance, we recommend more clinical trials withmore »dosing regimens that substantially increase the levels of RDV-TP and/or pair remdesivir with companion antivirals.« less
  4. For large observational studies lacking a control group (unlike randomized controlled trials, RCT), propensity scores (PS) are often the method of choice to account for pre-treatment confounding in baseline characteristics, and thereby avoid substantial bias in treatment estimation. A vast majority of PS techniques focus on average treatment effect estimation, without any clear consensus on how to account for confounders, especially in a multiple treatment setting. Furthermore, for time-to event outcomes, the analytical framework is further complicated in presence of high censoring rates (sometimes, due to non-susceptibility of study units to a disease), imbalance between treatment groups, and clustered nature of the data (where, survival outcomes appear in groups). Motivated by a right-censored kidney transplantation dataset derived from the United Network of Organ Sharing (UNOS), we investigate and compare two recent promising PS procedures, (a) the generalized boosted model (GBM), and (b) the covariate-balancing propensity score (CBPS), in an attempt to decouple the causal effects of treatments (here, study subgroups, such as hepatitis C virus (HCV) positive/negative donors, and positive/negative recipients) on time to death of kidney recipients due to kidney failure, post transplantation. For estimation, we employ a 2-step procedure which addresses various complexities observed in the UNOS databasemore »within a unified paradigm. First, to adjust for the large number of confounders on the multiple sub-groups, we fit multinomial PS models via procedures (a) and (b). In the next stage, the estimated PS is incorporated into the likelihood of a semi-parametric cure rate Cox proportional hazard frailty model via inverse probability of treatment weighting, adjusted for multi-center clustering and excess censoring, Our data analysis reveals a more informative and superior performance of the full model in terms of treatment effect estimation, over sub-models that relaxes the various features of the event time dataset.« less
  5. The pre-clinical development of antiviral agents involves experimental trials in animals and ferrets as an animal model for the study of SARS-CoV-2. Here, we used mathematical models and experimental data to characterize the within-host infection dynamics of SARS-CoV-2 in ferrets. We also performed a global sensitivity analysis of model parameters impacting the characteristics of the viral infection. We provide estimates of the viral dynamic parameters in ferrets, such as the infection rate, the virus production rate, the infectious virus proportion, the infected cell death rate, the virus clearance rate, as well as other related characteristics, including the basic reproduction number, pre-peak infectious viral growth rate, post-peak infectious viral decay rate, pre-peak infectious viral doubling time, post-peak infectious virus half-life, and the target cell loss in the respiratory tract. These parameters and indices are not significantly different between animals infected with viral strains isolated from the environment and isolated from human hosts, indicating a potential for transmission from fomites. While the infection period in ferrets is relatively short, the similarity observed between our results and previous results in humans supports that ferrets can be an appropriate animal model for SARS-CoV-2 dynamics-related studies, and our estimates provide helpful information for such studies.