skip to main content


Title: Meta-Analytic Use of Balanced Identity Theory to Validate the Implicit Association Test
This meta-analysis evaluated theoretical predictions from balanced identity theory (BIT) and evaluated the validity of zero points of Implicit Association Test (IAT) and self-report measures used to test these predictions. Twenty-one researchers contributed individual subject data from 36 experiments (total N = 12,773) that used both explicit and implicit measures of the social–cognitive constructs. The meta-analysis confirmed predictions of BIT’s balance–congruity principle and simultaneously validated interpretation of the IAT’s zero point as indicating absence of preference between two attitude objects. Statistical power afforded by the sample size enabled the first confirmations of balance–congruity predictions with self-report measures. Beyond these empirical results, the meta-analysis introduced a within-study statistical test of the balance–congruity principle, finding that it had greater efficiency than the previous best method. The meta-analysis’s full data set has been publicly archived to enable further studies of interrelations among attitudes, stereotypes, and identities.  more » « less
Award ID(s):
1661285 1640889
NSF-PAR ID:
10180767
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; « less
Date Published:
Journal Name:
Personality and Social Psychology Bulletin
ISSN:
0146-1672
Page Range / eLocation ID:
014616722091663
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Our study evaluated the effectiveness of using eight pathways in combination for a complete to transition from fossil fuels to renewable energy by 2050. These pathways included renewable energy development; improving energy efficiency; increasing energy conservation; carbon taxes; more equitable balancing of human wellbeing and per capita energy use; cap and trade systems; carbon capture, utilization, and storage; and nuclear power development. We used the annual ‘British Petroleum statistical review of world energy 2021’ report as our primary database. Globally, fossil fuels, renewable (primarily hydro, wind and solar), nuclear energy accounted for 83%, 12.6%, and 6.3% of the total energy consumption in 2020. To achieve zero fossil fuel use by 2050, we found that renewable energy production will need to be increased by up to 6-fold or 8-fold if energy demand is held constant at, or increased 50% from, the 2020 energy demand level. Constraining 2050 world energy demand to a 25% increase over the 2020 level, improves the probability of achieving independence from fossil fuels. Improvements in energy efficiency need to accelerate beyond the current rate of ~1.5% per year. Aggressive application of energy conservation policies involving land use and taxation could potentially reduce world energy use by 10% or more by 2050. Our meta-analysis shows that the minimum level of per capita energy consumption that would allow 8 billion people to have a ‘Decent Living Standard’ is on average ~70 GJ per capita per year, which is 93% of the 2020 global average. Developed countries in temperate climates with high vehicle-dependency needed ~120 GJ per capita year−1, whereas equatorial countries with low vehicle-dependency needed 30 GJ per capita year−1. Our meta-analyses indicated replacement of fossil fuels with renewable energy by 2050 may be possible but will require aggressive application of all eight pathways, major lifestyle changes in developed countries, and close cooperation among all countries. 
    more » « less
  2. The Implicit Association Test (IAT), like many behavioral measures, seeks to quantify meaningful individual differences in cognitive processes that are difficult to assess with approaches like self-reports. However, much like other behavioral measures, many IATs appear to show low test-retest reliability and typical scoring methods fail to quantify all of the decision-making processes that generate the overt task performance. Here, we develop a new modeling approach for IATs based on the geometric similarity representation (GSR) model. This model leverages both response times and accuracy on IATs to make inferences about representational similarity between the stimuli and categories. The model disentangles processes related to response caution, stimulus encoding, similarities between concepts and categories, and response processes unrelated to the choice itself. This approach to analyzing IAT data illustrates that the unreliability in IATs is almost entirely attributable to the methods used to analyze data from the task: GSR model parameters show test-retest reliability around .80-.90, on par with reliable self-report measures. Furthermore, we demonstrate how model parameters result in greater validity compared to the IAT D-score, Quad model, and simple diffusion model contrasts, predicting outcomes related to intergroup contact and motivation. Finally, we present a simple point-and-click software tool for fitting the model, which uses a pre-trained neural network to estimate best-fit parameters of the GSR model. This approach allows easy and instantaneous fitting of IAT data with minimal demands on coding or technical expertise on the part of the user, making the new model accessible and effective. 
    more » « less
  3. Summary

    Many clinical endpoint measures, such as the number of standard drinks consumed per week or the number of days that patients stayed in the hospital, are count data with excessive zeros. However, the zero‐inflated nature of such outcomes is sometimes ignored in analyses of clinical trials. This leads to biased estimates of study‐level intervention effect and, consequently, a biased estimate of the overall intervention effect in a meta‐analysis. The current study proposes a novel statistical approach, the Zero‐inflation Bias Correction (ZIBC) method, that can account for the bias introduced when using the Poisson regression model, despite a high rate of inflated zeros in the outcome distribution of a randomized clinical trial. This correction method only requires summary information from individual studies to correct intervention effect estimates as if they were appropriately estimated using the zero‐inflated Poisson regression model, thus it is attractive for meta‐analysis when individual participant‐level data are not available in some studies. Simulation studies and real data analyses showed that the ZIBC method performed well in correcting zero‐inflation bias in most situations.

     
    more » « less
  4. null (Ed.)
    Propensity score methods account for selection bias in observational studies. However, the consistency of the propensity score estimators strongly depends on a correct specification of the propensity score model. Logistic regression and, with increasing popularity, machine learning tools are used to estimate propensity scores. We introduce a stacked generalization ensemble learning approach to improve propensity score estimation by fitting a meta learner on the predictions of a suitable set of diverse base learners. We perform a comprehensive Monte Carlo simulation study, implementing a broad range of scenarios that mimic characteristics of typical data sets in educational studies. The population average treatment effect is estimated using the propensity score in Inverse Probability of Treatment Weighting. Our proposed stacked ensembles, especially using gradient boosting machines as a meta learner trained on a set of 12 base learner predictions, led to superior reduction of bias compared to the current state-of-the-art in propensity score estimation. Further, our simulations imply that commonly used balance measures (averaged standardized absolute mean differences) might be misleading as propensity score model selection criteria. We apply our proposed model - which we call GBM-Stack - to assess the population average treatment effect of a Supplemental Instruction (SI) program in an introductory psychology (PSY 101) course at San Diego State University. Our analysis provides evidence that moving the whole population to SI attendance would on average lead to 1.69 times higher odds to pass the PSY 101 class compared to not offering SI, with a 95% bootstrap confidence interval of (1.31, 2.20). 
    more » « less
  5. Many individuals with disabling conditions have difficulty with gait and balance control that may result in a fall. Exoskeletons are becoming an increasingly popular technology to aid in walking. Despite being a significant aid in increasing mobility, little attention has been paid to exoskeleton features to mitigate falls. To develop improved exoskeleton stability, quantitative information regarding how a user reacts to postural challenges while wearing the exoskeleton is needed. Assessing the unique responses of individuals to postural perturbations while wearing an exoskeleton provides critical information necessary to effectively accommodate a variety of individual response patterns. This report provides kinematic and neuromuscular data obtained from seven healthy, college-aged individuals during posterior support surface translations with and without wearing a lower limb exoskeleton. A 2-min, static baseline standing trial was also obtained. Outcome measures included a variety of 0 dimensional (OD) measures such as center of pressure (COP) RMS, peak amplitude, velocities, pathlength, and electromyographic (EMG) RMS, and peak amplitudes. These measures were obtained during epochs associated with the response to the perturbations: baseline, response, and recovery. T-tests were used to explore potential statistical differences between the exoskeleton and no exoskeleton conditions. Time series waveforms (1D) of the COP and EMG data were also analyzed. Statistical parametric mapping (SPM) was used to evaluate the 1D COP and EMG waveforms obtained during the epochs with and without wearing the exoskeleton. The results indicated that during quiet stance, COP velocity was increased while wearing the exoskeleton, but the magnitude of sway was unchanged. The OD COP measures revealed that wearing the exoskeleton significantly reduced the sway magnitude and velocity in response to the perturbations. There were no systematic effects of wearing the exoskeleton on EMG. SPM analysis revealed that there was a range of individual responses; both behaviorally (COP) and among neuromuscular activation patterns (EMG). Using both the OD and 1D measures provided a more comprehensive representation of how wearing the exoskeleton impacts the responses to posterior perturbations. This study supports a growing body of evidence that exoskeletons must be personalized to meet the specific capabilities and needs of each individual end-user. 
    more » « less