skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Interim monitoring of sequential multiple assignment randomized trials using partial information
The sequential multiple assignment randomized trial (SMART) is the gold standard trial design to generate data for the evaluation of multistage treatment regimes. As with conventional (single‐stage) randomized clinical trials, interim monitoring allows early stopping; however, there are few methods for principled interim analysis in SMARTs. Because SMARTs involve multiple stages of treatment, a key challenge is that not all enrolled participants will have progressed through all treatment stages at the time of an interim analysis. Wu et al. (2021) propose basing interim analyses on an estimator for the mean outcome under a given regime that uses data only from participants who have completed all treatment stages. We propose an estimator for the mean outcome under a given regime that gains efficiency by using partial information from enrolled participants regardless of their progression through treatment stages. Using the asymptotic distribution of this estimator, we derive associated Pocock and O'Brien‐Fleming testing procedures for early stopping. In simulation experiments, the estimator controls type I error and achieves nominal power while reducing expected sample size relative to the method of Wu et al. (2021). We present an illustrative application of the proposed estimator based on a recent SMART evaluating behavioral pain interventions for breast cancer patients.  more » « less
Award ID(s):
2136034 2103672
PAR ID:
10467918
Author(s) / Creator(s):
; ;
Publisher / Repository:
Wiley
Date Published:
Journal Name:
Biometrics
ISSN:
0006-341X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Complementary features of randomized controlled trials (RCTs) and observational studies (OSs) can be used jointly to estimate the average treatment effect of a target population. We propose a calibration weighting estimator that enforces the covariate balance between the RCT and OS, therefore improving the trial-based estimator's generalizability. Exploiting semiparametric efficiency theory, we propose a doubly robust augmented calibration weighting estimator that achieves the efficiency bound derived under the identification assumptions. A nonparametric sieve method is provided as an alternative to the parametric approach, which enables the robust approximation of the nuisance functions and data-adaptive selection of outcome predictors for calibration. We establish asymptotic results and confirm the finite sample performances of the proposed estimators by simulation experiments and an application on the estimation of the treatment effect of adjuvant chemotherapy for early-stage non-small-cell lung patients after surgery. 
    more » « less
  2. ABSTRACT Many trials are designed to collect outcomes at or around pre-specified times after randomization. If there is variability in the times when participants are actually assessed, this can pose a challenge to learning the effect of treatment, since not all participants have outcome assessments at the times of interest. Furthermore, observed outcome values may not be representative of all participants’ outcomes at a given time. Methods have been developed that account for some types of such irregular and informative assessment times; however, since these methods rely on untestable assumptions, sensitivity analyses are needed. We develop a sensitivity analysis methodology that is benchmarked at the explainable assessment (EA) assumption, under which assessment and outcomes at each time are related only through data collected prior to that time. Our method uses an exponential tilting assumption, governed by a sensitivity analysis parameter, that posits deviations from the EA assumption. Our inferential strategy is based on a new influence function-based, augmented inverse intensity-weighted estimator. Our approach allows for flexible semiparametric modeling of the observed data, which is separated from specification of the sensitivity parameter. We apply our method to a randomized trial of low-income individuals with uncontrolled asthma, and we illustrate implementation of our estimation procedure in detail. 
    more » « less
  3. In the absence of data from a randomized trial, researchers may aim to use observational data to draw causal inference about the effect of a treatment on a time-to-event outcome. In this context, interest often focuses on the treatment-specific survival curves, that is, the survival curves were the population under study to be assigned to receive the treatment or not. Under certain conditions, including that all confounders of the treatment-outcome relationship are observed, the treatment-specific survival curve can be identified with a covariate-adjusted survival curve. In this article, we propose a novel cross-fitted doubly-robust estimator that incorporates data-adaptive (e.g. machine learning) estimators of the conditional survival functions. We establish conditions on the nuisance estimators under which our estimator is consistent and asymptotically linear, both pointwise and uniformly in time. We also propose a novel ensemble learner for combining multiple candidate estimators of the conditional survival estimators. Notably, our methods and results accommodate events occurring in discrete or continuous time, or an arbitrary mix of the two. We investigate the practical performance of our methods using numerical studies and an application to the effect of a surgical treatment to prevent metastases of parotid carcinoma on mortality. 
    more » « less
  4. ImportanceNeurodevelopmental outcomes for children with congenital heart defects (CHD) have improved minimally over the past 20 years. ObjectivesTo assess the feasibility and tolerability of maternal progesterone therapy as well as the magnitude of the effect on neurodevelopment for fetuses with CHD. Design, Setting, and ParticipantsThis double-blinded individually randomized parallel-group clinical trial of vaginal natural progesterone therapy vs placebo in participants carrying fetuses with CHD was conducted between July 2014 and November 2021 at a quaternary care children’s hospital. Participants included maternal-fetal dyads where the fetus had CHD identified before 28 weeks’ gestational age and was likely to need surgery with cardiopulmonary bypass in the neonatal period. Exclusion criteria included a major genetic or extracardiac anomaly other than 22q11 deletion syndrome and known contraindication to progesterone. Statistical analysis was performed June 2022 to April 2024. InterventionParticipants were 1:1 block-randomized to vaginal progesterone or placebo by diagnosis: hypoplastic left heart syndrome (HLHS), transposition of the great arteries (TGA), and other CHD diagnoses. Treatment was administered twice daily between 28 and up to 39 weeks’ gestational age. Main Outcomes and MeasuresThe primary outcome was the motor score of the Bayley Scales of Infant and Toddler Development-III; secondary outcomes included language and cognitive scales. Exploratory prespecified subgroups included cardiac diagnosis, fetal sex, genetic profile, and maternal fetal environment. ResultsThe 102 enrolled fetuses primarily had HLHS (n = 52 [50.9%]) and TGA (n = 38 [37.3%]), were more frequently male (n = 67 [65.7%]), and without genetic anomalies (n = 61 [59.8%]). The mean motor score differed by 2.5 units (90% CI, −1.9 to 6.9 units;P = .34) for progesterone compared with placebo, a value not statistically different from 0. Exploratory subgroup analyses suggested treatment heterogeneity for the motor score for cardiac diagnosis (Pfor interaction = .03) and fetal sex (Pfor interaction = .04), but not genetic profile (Pfor interaction = .16) or maternal-fetal environment (Pfor interaction = .70). Conclusions and RelevanceIn this randomized clinical trial of maternal progesterone therapy, the overall effect was not statistically different from 0. Subgroup analyses suggest heterogeneity of the response to progesterone among CHD diagnosis and fetal sex. Trial RegistrationClinicalTrials.gov Identifier:NCT02133573 
    more » « less
  5. ABSTRACT Platform trials are multi‐arm designs that simultaneously evaluate multiple treatments for a single disease within the same overall trial structure. Unlike traditional randomized controlled trials, they allow treatment arms to enter and exit the trial at distinct times while maintaining a control arm throughout. This control arm comprises both concurrent controls, where participants are randomized concurrently to either the treatment or control arm, and non‐concurrent controls, who enter the trial when the treatment arm under study is unavailable. While flexible, platform trials introduce the challenge of using non‐concurrent controls, raising questions about estimating treatment effects. Specifically, which estimands should be targeted? Under what assumptions can these estimands be identified and estimated? Are there any efficiency gains? In this article, we discuss issues related to the identification and estimation assumptions of common choices of estimand. We conclude that the most robust strategy to increase efficiency without imposing unwarranted assumptions is to target the concurrent average treatment effect (cATE), the ATE among only concurrent units, using a covariate‐adjusted doubly robust estimator. Our studies suggest that, for the purpose of obtaining efficiency gains, collecting important prognostic variables is more important than relying on non‐concurrent controls. We also discuss the perils of targeting ATE due to an untestable extrapolation assumption that will often be invalid. We provide simulations illustrating our points and an application to the ACTT platform trial, resulting in a 20% improvement in precision compared to the naive estimator that ignores non‐concurrent controls and prognostic variables. 
    more » « less