skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Measuring the predictability of life outcomes with a scientific mass collaboration
How predictable are life trajectories? We investigated this question with a scientific mass collaboration using the common task method; 160 teams built predictive models for six life outcomes using data from the Fragile Families and Child Wellbeing Study, a high-quality birth cohort study. Despite using a rich dataset and applying machine-learning methods optimized for prediction, the best predictions were not very accurate and were only slightly better than those from a simple benchmark model. Within each outcome, prediction error was strongly associated with the family being predicted and weakly associated with the technique used to generate the prediction. Overall, these results suggest practical limits to the predictability of life outcomes in some settings and illustrate the value of mass collaborations in the social sciences.  more » « less
Award ID(s):
1750729 1735095 1704444 1760052
PAR ID:
10171692
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; « less
Date Published:
Journal Name:
Proceedings of the National Academy of Sciences
Volume:
117
Issue:
15
ISSN:
0027-8424
Page Range / eLocation ID:
8398 to 8403
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The Fragile Families Challenge is a scientific mass collaboration designed to measure and understand the predictability of life trajectories. Participants in the Challenge created predictive models of six life outcomes using data from the Fragile Families and Child Wellbeing Study, a high-quality birth cohort study. This Special Collection includes 12 articles describing participants’ approaches to predicting these six outcomes as well as 3 articles describing methodological and procedural insights from running the Challenge. This introduction will help readers interpret the individual articles and help researchers interested in running future projects similar to the Fragile Families Challenge. 
    more » « less
  2. Abstract ObjectiveBone mineral density (BMD) and frame size are important predictors of future bone health, with smaller frame size and lower BMD associated with higher risk of later fragility fractures. We test the effects of body size, habitual use, and life history on frame size and cortical BMD of the radius and tibia in sample of healthy adult premenopausal women. MethodsWe used anthropometry and life history data from 123 women (age 18‐46) from rural Poland. Standard techniques were used to measure height, weight, and body fat. Life history factors were recorded using surveys. Grip strength was measured as a proxy for habitual activity, wrist breadth for skeletal frame size. Cortical BMD was measured at the one‐third distal point of the radius and mid‐point of the tibia using quantitative ultrasound (reported as speed of sound, SoS). ResultsRadial SoS was high (meant‐score 3.2 ± 1.6), but tibia SoS was average (meant‐score 0.35 ± 1.17). SoS was not associated with age, although wrist breadth was positively associated with age after adjusting for height. Radius SoS was not associated with measures of body size, habitual use, or life history factors. Wrist breadth was associated with body size (p < .05 for all), lean mass, and grip strength. Tibia SoS was associated with height. Life history factors were not associated with frame size or cortical SoS. ConclusionsHabitual use and overall body size are more strongly associated with frame size and cortical SoS than life history factors in this sample of healthy adult women. 
    more » « less
  3. This study used nationally representative data from the 2011 National Assessment of Educational Progress (8th-grade Science) and the 2018 National Survey of Science and Mathematics Education toward two primary purposes: (a) to examine the association between teachers’ formal (university) content preparation in science and student outcomes in science, and (b) to document the prevalence and locality of Out-of-Field (OoF) science teaching in the US. The relationship between teachers’ formal science preparation and students’ 8th-grade science outcomes was mixed across science disciplines with a statistically significant association being observed for students’ earth science outcomes. Teachers’ experience teaching science and access to science instructional materials/kits were more strongly associated with student outcomes than was their formal content preparation, with statistically significant associations observed for all student outcomes (physical science, life science, and earth science). The prevalence of OoF science teaching was higher in middle schools than in high schools, as well as more frequently occurring in historically lower achieving and impoverished educational contexts. 
    more » « less
  4. Abstract from the article associated with the dataset: George, Mullinix, et al PeerJ 2021. Reef-building corals are ecosystem engineers that compete with other benthic or- ganisms for space and resources. Corals harvest energy through their surface by photosynthesis and heterotrophic feeding, and they divert part of this energy to defend their outer colony perimeter against competitors. Here, we hypothesized that corals with a larger space-filling surface and smaller perimeters increase energy gain while reducing the exposure to competitors. This predicted an association between these two geometric properties of corals and the competitive outcome against other benthic organisms. To test the prediction, fifty coral colonies from the Caribbean island of Curac ̧ao were rendered using digital 3D and 2D reconstructions. The surface areas, perimeters, box-counting dimensions (as a proxy of space-filling property), and other geometric properties were extracted and analyzed with respect to the percentage of the perimeter losing or winning against competitors based on the coral tissue apparent growth or damage. The increase in surface space-filling dimension was the only significant single indicator of coral winning outcomes, but the combination of surface space-filling dimension with perimeter length increased the statistical prediction of coral competition outcomes. Corals with larger surface space-filling dimensions (Ds > 2) and smaller perimeters displayed more winning outcomes, confirming the initial hypothesis. We propose that the space-filling property of coral surfaces complemented with other proxies of coral competitiveness, such as life history traits, will provide a more accurate quantitative characterization of coral competition outcomes on coral reefs. This framework also applies to other organisms or ecological systems that rely on complex surfaces to obtain energy for competition. For the compressed files: - Reconstruction of the split file can be accomplished by issuing the command cat *.tar.bz2*part-a* > 3D_model_stl_data.tar.bz2 - Unzipping the compressed files can be accomplished by issuing the command tar -jxvf *.tar.bz2 
    more » « less
  5. Abstract ObjectivesChildhood abuse has been extensively studied in relation to later-life health, yet relatively little attention has been given to understanding the nuanced dynamics across victim–perpetrator relationships. This study addresses this gap by identifying typologies of familial perpetrators of childhood abuse in a national sample and examining their associations with various health outcomes, including physical and mental health as well as substance abuse. MethodsWe used 2 waves of data from the Midlife in the US Study (n = 6,295, mean age = 46.9 at baseline). The analysis was completed in 3 stages. Using Latent Class Analysis (LCA), we identified subpopulations of victims with distinct familial perpetrator histories. With assigned LCA memberships and propensity score weighting, we investigated the extent to which specific victim–perpetrator relationships are associated with health outcomes measured at baseline and a 10-year follow-up adjusting for other early-life risks. We evaluated whether the observed associations differ across the waves. ResultsParental and sibling abuse commonly co-occur, surpassing the occurrence of single perpetrators. Although minimal health disparities are evident between sibling-only abuse and no/little abuse groups at baseline, parent-only abuse is associated with compromised health outcomes. Severe abuse from both siblings and parents is linked to the most adverse health outcomes. At the follow-up survey, the associations between familiar abuse and health outcomes weakened, particularly for substance abuse. DiscussionThis study, delving into family relationships, family violence, and health disparities, provides new evidence to augment our comprehension of the enduring link between childhood abuse and health within the family context. 
    more » « less