skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Design-Based Covariate Adjustments in Paired Experiments
In paired experiments, participants are grouped into pairs with similar characteristics, and one observation from each pair is randomly assigned to treatment. The resulting treatment and control groups should be well-balanced; however, there may still be small chance imbalances. Building on work for completely randomized experiments, we propose a design-based method to adjust for covariate imbalances in paired experiments. We leave out each pair and impute its potential outcomes using any prediction algorithm such as lasso or random forests. This method addresses a unique trade-off that exists for paired experiments. By addressing this trade-off, the method has the potential to improve precision over existing methods.  more » « less
Award ID(s):
1646108
PAR ID:
10546925
Author(s) / Creator(s):
 ;  
Publisher / Repository:
DOI PREFIX: 10.3102
Date Published:
Journal Name:
Journal of Educational and Behavioral Statistics
Volume:
46
Issue:
1
ISSN:
1076-9986
Format(s):
Medium: X Size: p. 109-132
Size(s):
p. 109-132
Sponsoring Org:
National Science Foundation
More Like this
  1. Background:When conducting a randomized controlled trial, it is common to specify in advance the statistical analyses that will be used to analyze the data. Typically, these analyses will involve adjusting for small imbalances in baseline covariates. However, this poses a dilemma, as adjusting for too many covariates can hurt precision more than it helps, and it is often unclear which covariates are predictive of outcome prior to conducting the experiment. Objectives:This article aims to produce a covariate adjustment method that allows for automatic variable selection, so that practitioners need not commit to any specific set of covariates prior to seeing the data. Results:In this article, we propose the “leave-one-out potential outcomes” estimator. We leave out each observation and then impute that observation’s treatment and control potential outcomes using a prediction algorithm such as a random forest. In addition to allowing for automatic variable selection, this estimator is unbiased under the Neyman–Rubin model, generally performs at least as well as the unadjusted estimator, and the experimental randomization largely justifies the statistical assumptions made. 
    more » « less
  2. There is a long-existing trade-off between the imaging resolution and penetration depth in acoustic imaging caused by the diffraction limit. Most existing approaches addressing this trade-off require controlled “labels,” i.e., metamaterials or contrast agents, to be deposited close to the objects and to either remain static or be tracked precisely during imaging. We propose a “blind-label” approach for acoustic subwavelength imaging. The blind labels are randomly distributed acoustic scatterers with deep-subwavelength sizes whose exact locations and trajectories are not necessary information in image reconstruction. The proposed method achieves the resolution of 0.24 wavelengths in ultrasound imaging experiments and 0.2 wavelengths in simulations, providing over 10 times improvement compared to the diffraction limit. We also elucidate the influence of scatterer size and concentration on imaging performance. The proposed “blind-label” approach relaxes the restrictions of existing acoustic subwavelength imaging technologies relying on controlled labels, therefore substantially improving the practicality of acoustic subwavelength imaging in biomedical ultrasound imaging, sonar, and nondestructive testing. 
    more » « less
  3. Abstract Under climate change, ectotherms will likely face pressure to adapt to novel thermal environments by increasing their upper thermal tolerance and its plasticity, a measure of thermal acclimation. Ectotherm populations with high thermal tolerance are often less thermally plastic, a trade‐off hypothesized to result from (i) a phenotypic limit on thermal tolerance above which plasticity cannot further increase the trait, (ii) negative genetic correlation or (iii) fitness trade‐offs between the two traits. Whether each hypothesis causes negative associations between thermal tolerance and plasticity has implications for the evolution of each trait.We empirically tested the limit and trade‐off hypotheses by leveraging the experimental tractability and thermal biology of the intertidal copepodTigriopus californicus. Using populations from four latitudinally distributed sites in coastal California, six lines per population were reared under a laboratory common garden for two generations. Ninety‐six full sibling replicates (n = 4–5 per line) from a third generation were developmentally conditioned to 21.5 and 16.5°C until adulthood. We then measured the upper thermal tolerance and fecundity of sibships at each temperature.We detected a significant trade‐off in fecundity, a fitness corollary, between baseline thermal tolerance and its plasticity.Tigriopus californicuspopulations and genotypes with higher thermal tolerance were less thermally plastic. We detected negative directional selection on thermal plasticity under ambient temperature evidenced by reduced fecundity. These fitness costs of plasticity were significantly higher among thermally tolerant genotypes, consistent with the trade‐off hypothesis. This trade‐off was evident under ambient conditions, but not high temperature.Observed thermal plasticity and fecundity were best explained by a model incorporating both the limit and trade‐off hypotheses rather than models with parameters associated with one hypothesis. Effects of population and family on tolerance and plasticity negatively covaried, suggesting that a negative genetic correlation could not be ruled as contributing to negative associations between the traits. Our study provides a novel empirical test of the fitness trade‐off hypothesis that leverages a strong inference approach. We discuss our results' insights into how thermal adaptation may be constrained by physiological limits, genetic correlations, and fitness trade‐offs between thermal tolerance and its plasticity. Read the freePlain Language Summaryfor this article on the Journal blog. 
    more » « less
  4. In many commercial applications, polymer–dye interactions are frequently encountered from food to wastewater treatment, and while shear rheology has been well characterized, the extensional properties are not well known. The extensional viscosity ηE and relaxation time λE are the extensional rheological parameters that provide valuable insights into how aqueous polymers respond during deformation, and this study investigated the effect of dyes on the extensional rheology of three different aqueous polymer solutions (e.g., anionic, cationic, and neutral) paired with two different dye salts (e.g., anionic and cationic) using drop pinch-off experiments. We have found that the influence of dyes on the pinch-off dynamics is complex but generally leads to a decrease in, for example, the apparent extensional relaxation time. We have utilized the dripping-onto-substrate method to probe the uniaxial deformation of widely used polymers such as xanthan gum (XG), poly(diallyldimethylammonium chloride) (PDADMAC), and poly(ethylene oxide) (PEO) as the anionic, cationic, and neutral polymers, respectively, paired with either fluorescein (Fl) or methylene blue (MB) as the anionic and cationic dyes, respectively. Polymer–dye pairs with opposite charges (e.g., XG–MB and PDADMAC–Fl) displayed a pronounced decrease in pinch-off times, but even PEO, which is a neutral polymer, resulted in decreased pinch-off times, which was restored by the addition of NaCl. The pinch-off times for the Boger fluid (mixture of poly(ethylene glycol) and PEO), however, were surprisingly uninfluenced by dyes. These results showed that not only did the small addition of dyes strongly decrease the polymer relaxation times, but the relative importance of the dye salts on the polymer pinch-off dynamics was also different from that of pure salts such as NaCl. 
    more » « less
  5. Observing collective effects originating from the interplay between quantum electrodynamics and plasma physics might be achieved in upcoming experiments. In particular, the generation of electron–positron pairs and the observation of their collective dynamics could be simultaneously achieved in a collision between an intense laser and a highly relativistic electron beam through a laser frequency shift driven by an increase in the plasma density increase. In this collision, the radiation of high-energy photons will serve a dual purpose: first, in seeding the cascade of pair generation; and, second, in decelerating the created pairs for detection. The deceleration results in a detectable shift in the plasma frequency. This deceleration was previously studied considering only a small sample of individual pair particles. However, the highly stochastic nature of the quantum radiation reaction in the strong-field regime limits the descriptive power of the average behavior to the dynamics of pair particles. Here, we examine the full kinetic evolution of generated pairs in order to more accurately model the relativistically adjusted plasma density. As we show, the most effective pair energy for creating observable signatures occurs at a local minimum, obtained at finite laser field strength due to the trade-off between pair deceleration and the relativistic particle oscillation at increasing laser intensity. For a small number of laser cycles, the quantum radiation reaction may re-arrange the generated pairs into anisotropic distributions in momentum space, although, in the one-dimensional simulations considered here, this anisotropy quickly decreases. 
    more » « less