Abstract
Expert testimony varies in scientific quality and jurors have a difficult time evaluating evidence quality (McAuliff et al., 2009). In the current study, we apply Fuzzy Trace Theory principles, examining whether visual and gist aids help jurors calibrate to the strength of scientific evidence. Additionally we were interested in the role of jurors’ individual differences in scientific reasoning skills in their understanding of case evidence. Contrary to our preregistered hypotheses, there was no effect of evidence condition or gist aid on evidence understanding. However, individual differences between jurors’ numeracy skills predicted evidence understanding.
Summary
Poor-quality expert evidence is sometimes admitted into court (Smithburn, 2004). Jurors’ calibration to evidence strength varies widely and is not robustly understood. For instance, previous research has established jurors lack understanding of the role of control groups, confounds, and sample sizes in scientific research (McAuliff, Kovera, & Nunez, 2009; Mill, Gray, & Mandel, 1994). Still others have found that jurors can distinguish weak from strong evidence when the evidence is presented alone, yet not when simultaneously presented with case details (Smith, Bull, & Holliday, 2011). This research highlights the need to present evidence to jurors in a way they can understand. Fuzzy Trace Theory purports that people encode information in exact, verbatim representations and through “gist” representations, which represent summary of meaning (Reyna & Brainerd, 1995). It is possible that the presenting complex scientific evidence to people with verbatim content or appealing to the gist, or bottom-line meaning of the information may influence juror understanding of that evidence. Application of Fuzzy Trace Theory in the medical field has shown that gist representations are beneficial for helping laypeople better understand risk and benefits of medical treatment (Brust-Renck, Reyna, Wilhelms, & Lazar, 2016). Yet, little research has applied Fuzzy Trace Theory to information comprehension and application within the context of a jury (c.f. Reyna et. al., 2015). Additionally, it is likely that jurors’ individual characteristics, such as scientific reasoning abilities and cognitive tendencies, influence their ability to understand and apply complex scientific information (Coutinho, 2006).
Methods
The purpose of this study was to examine how jurors calibrate to the strength of scientific information, and whether individual difference variables and gist aids inspired by Fuzzy Trace Theory help jurors better understand complicated science of differing quality. We used a 2 (quality of scientific evidence: high vs. low) x 2 (decision aid to improve calibration - gist information vs. no gist information), between-subjects design. All hypotheses were preregistered on the Open Science Framework.
Jury-eligible community participants (430 jurors across 90 juries; Mage = 37.58, SD = 16.17, 58% female, 56.93% White). Each jury was randomly assigned to one of the four possible conditions. Participants were asked to individually fill out measures related to their scientific reasoning skills prior to watching a mock jury trial. The trial was about an armed bank robbery and consisted of various pieces of testimony and evidence (e.g. an eyewitness testimony, police lineup identification, and a sweatshirt found with the stolen bank money). The key piece of evidence was mitochondrial DNA (mtDNA) evidence collected from hair on a sweatshirt (materials from Hans et al., 2011). Two experts presented opposing opinions about the scientific evidence related to the mtDNA match estimate for the defendant’s identification. The quality and content of this mtDNA evidence differed based on the two conditions. The high quality evidence condition used a larger database than the low quality evidence to compare to the mtDNA sample and could exclude a larger percentage of people. In the decision aid condition, experts in the gist information group presented gist aid inspired visuals and examples to help explain the proportion of people that could not be excluded as a match. Those in the no gist information group were not given any aid to help them understand the mtDNA evidence presented. After viewing the trial, participants filled out a questionnaire on how well they understood the mtDNA evidence and their overall judgments of the case (e.g. verdict, witness credibility, scientific evidence strength). They filled this questionnaire out again after a 45-minute deliberation.
Measures
We measured Attitudes Toward Science (ATS) with indices of scientific promise and scientific reservations (Hans et al., 2011; originally developed by National Science Board, 2004; 2006). We used Drummond and Fischhoff’s (2015) Scientific Reasoning Scale (SRS) to measure scientific reasoning skills. Weller et al.’s (2012) Numeracy Scale (WNS) measured proficiency in reasoning with quantitative information. The NFC-Short Form (Cacioppo et al., 1984) measured need for cognition. We developed a 20-item multiple-choice comprehension test for the mtDNA scientific information in the cases (modeled on Hans et al., 2011, and McAuliff et al., 2009). Participants were shown 20 statements related to DNA evidence and asked whether these statements were True or False. The test was then scored out of 20 points.
Results
For this project, we measured calibration to the scientific evidence in a few different ways. We are building a full model with these various operationalizations to be presented at APLS, but focus only on one of the calibration DVs (i.e., objective understanding of the mtDNA evidence) in the current proposal. We conducted a general linear model with total score on the mtDNA understanding measure as the DV and quality of scientific evidence condition, decision aid condition, and the four individual difference measures (i.e., NFC, ATS, WNS, and SRS) as predictors. Contrary to our main hypotheses, neither evidence quality nor decision aid condition affected juror understanding. However, the individual difference variables did: we found significant main effects for Scientific Reasoning Skills, F(1, 427) = 16.03, p <.001, np2 = .04, Weller Numeracy Scale, F(1, 427) = 15.19, p <.001, np2 = .03, and Need for Cognition, F(1, 427) = 16.80, p <.001, np2 = .04, such that those who scored higher on these measures displayed better understanding of the scientific evidence. In addition there was a significant interaction of evidence quality condition and scores on the Weller’s Numeracy Scale, F(1, 427) = 4.10, p = .04, np2 = .01. Further results will be discussed.
Discussion
These data suggest jurors are not sensitive to differences in the quality of scientific mtDNA evidence, and also that our attempt at helping sensitize them with Fuzzy Trace Theory-inspired aids did not improve calibration. Individual scientific reasoning abilities and general cognition styles were better predictors of understanding this scientific information. These results suggest a need for further exploration of approaches to help jurors differentiate between high and low quality evidence.
Note: The 3rd author was supported by an AP-LS AP Award for her role in this research.
Learning Objective:
Participants will be able to describe how individual differences in scientific reasoning skills help jurors understand complex scientific evidence.
more »
« less
This content will become publicly available on December 12, 2024
Testing the Robustness of the ANES Feeling Thermometer Indicators of Affective Polarization
Affective polarization (AP)—the tendency of political partisans to view their opponents as a stigmatized “out group”—is now a major field of research. Relevant evidence in the United States derives primarily from a single source, the American National Election Studies (ANES) feeling thermometer time series. We investigate whether the design of the ANES produces overestimates of AP. We consider four mechanisms: overrepresentation of strong partisans, selection bias conditional on strong identification, priming effects of partisan content, and survey mode variation. Our analysis uses the first-ever collaboration between ANES and the General Social Survey and a novel experiment that manipulates the amount of political content in surveys. Our tests show that variation in survey mode has caused an artificial increase in the mixed-mode ANES time series, but the general increase in out-party animus is nonetheless real and not merely an artifact of selection bias or priming effects.
more » « less- Award ID(s):
- 1835022
- NSF-PAR ID:
- 10479891
- Publisher / Repository:
- Cambridge University Press
- Date Published:
- Journal Name:
- American Political Science Review
- ISSN:
- 0003-0554
- Page Range / eLocation ID:
- 1 to 7
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Plants demonstrate exceptional variation in genome size across species, and their genome sizes can also vary dramatically across individuals and populations within species. This aspect of genetic variation can have consequences for traits and fitness, but few studies attributed genome size differentiation to ecological and evolutionary processes. Biological invasions present particularly useful natural laboratories to infer selective agents that might drive genome size shifts across environments and population histories. Here, we test hypotheses for the evolutionary causes of genome size variation across 14 invading populations of yellow starthistle,
Centaurea solstitialis , in California, United States. We use a survey of genome sizes and trait variation to ask: (1) Is variation in genome size associated with developmental trait variation? (2) Are genome sizes smaller toward the leading edge of the expansion, consistent with selection for “colonizer” traits? Or alternatively, does genome size increase toward the leading edge of the expansion, consistent with predicted consequences of founder effects and drift? (3) Finally, are genome sizes smaller at higher elevations, consistent with selection for shorter development times? We found that 2C DNA content varied 1.21‐fold among all samples, and was associated with flowering time variation, such that plants with larger genomes reproduced later, with lower lifetime capitula production. Genome sizes increased toward the leading edge of the invasion, but tended to decrease at higher elevations, consistent with genetic drift during range expansion but potentially strong selection for smaller genomes and faster development time at higher elevations. These results demonstrate how genome size variation can contribute to traits directly tied to reproductive success, and how selection and drift can shape that variation. We highlight the influence of genome size on dynamics underlying a rapid range expansion in a highly problematic invasive plant. -
more » « less
Abstract With growing affective polarization in the United States, partisanship is increasingly an impediment to cooperation in political settings. But does partisanship also affect behavior in nonpolitical settings? We show evidence that it does, demonstrating its effect on economic outcomes across a range of experiments in real‐world environments. A field experiment in an online labor market indicates that workers request systematically lower reservation wages when the employer shares their political stance, reflecting a preference to work for co‐partisans. We conduct two field experiments with consumers and find a preference for dealing with co‐partisans, especially among those with strong partisan attachments. Finally, via a population‐based, incentivized survey experiment, we find that the influence of political considerations on economic choices extends also to weaker partisans. Whereas earlier studies show the political consequences of polarization in American politics, our findings suggest that partisanship spills over beyond the political, shaping cooperation in everyday economic behavior.
-
more » « less
Abstract Recollection bias (RB) refers to the phenomenon whereby after an adverse event people report that their risk assessment about a similar future event is presently no higher than their recollection of their pre‐event risk assessment. While previous research has outlined this theoretical construct and generated important empirical findings, there were some limitations. We design and employ a new national representative survey to address these limitations in this study. We examine the existence and persistence of RB among the general public in the context of a number of domestic and international terrorist attacks. We further examine the socioeconomic and political base of RB and the influences of RB on a wide range of citizens’ counterterrorism policy preferences. Our data analyses reveal strong evidence showing the occurrence of RB and its persistence across various forms of terrorism risk. With regard to the socioeconomic and political base, we find that females, older people, political conservatives, and Republicans are less likely to be subject to RB. For the effects of RB on public counterterrorism policy preferences, our analyses demonstrate that this bias significantly dampens public support for a wide range of preventive policy measures and government anti‐terrorism spending. Overall, our study, based on a national representative sample and an extended survey design, provides robust evidence of RB in terrorism risk assessment, and adds further evidence to support the idea that RB is likely a generalizable phenomenon. Implications and suggestions for future research are discussed in the conclusion.
-
Deformable Convolutional Networks (DCN) have been proposed as a powerful tool to boost the representation power of Convolutional Neural Networks (CNN) in computer vision tasks via adaptive sampling of the input feature map. Much like vision transformers, DCNs utilize a more flexible inductive bias than standard CNNs and have also been shown to improve performance of particular models. For example, drop-in DCN layers were shown to increase the AP score of Mask RCNN by 10.6 points while introducing only 1% additional parameters and FLOPs, improving the state-of-the art model at the time of publication. However, despite evidence that more DCN layers placed earlier in the network can further improve performance, we have not seen this trend continue with further scaling of deformations in CNNs, unlike for vision transformers. Benchmarking experiments show that a realistically sized DCN layer (64H×64W, 64 in-out channel) incurs a 4× slowdown on a GPU platform, discouraging the more ubiquitous use of deformations in CNNs. These slowdowns are caused by the irregular input-dependent access patterns of the bilinear interpolation operator, which has a disproportionately low arithmetic intensity (AI) compared to the rest of the DCN. To address the disproportionate slowdown of DCNs and enable their expanded use in CNNs, we propose DefT, a series of workload-aware optimizations for DCN kernels. DefT identifies performance bottlenecks in DCNs and fuses specific operators that are observed to limit DCN AI. Our approach also uses statistical information of DCN workloads to adapt the workload tiling to the DCN layer dimensions, minimizing costly out-of-boundary input accesses. Experimental results show that DefT mitigates up to half of DCN slowdown over the current-art PyTorch implementation. This translates to a layerwise speedup of up to 134% and a reduction of normalized training time of 46% on a fully DCN-enabled ResNet model.more » « less
