Abstract
Expert testimony varies in scientific quality and jurors have a difficult time evaluating evidence quality (McAuliff et al., 2009). In the current study, we apply Fuzzy Trace Theory principles, examining whether visual and gist aids help jurors calibrate to the strength of scientific evidence. Additionally we were interested in the role of jurors’ individual differences in scientific reasoning skills in their understanding of case evidence. Contrary to our preregistered hypotheses, there was no effect of evidence condition or gist aid on evidence understanding. However, individual differences between jurors’ numeracy skills predicted evidence understanding.
Summary
Poor-quality expert evidence is sometimes admitted into court (Smithburn, 2004). Jurors’ calibration to evidence strength varies widely and is not robustly understood. For instance, previous research has established jurors lack understanding of the role of control groups, confounds, and sample sizes in scientific research (McAuliff, Kovera, & Nunez, 2009; Mill, Gray, & Mandel, 1994). Still others have found that jurors can distinguish weak from strong evidence when the evidence is presented alone, yet not when simultaneously presented with case details (Smith, Bull, & Holliday, 2011). This research highlights the need to present evidence to jurors in a way they can understand. Fuzzy Trace Theory purports that people encode information in exact, verbatim representations and through “gist” representations, which represent summary of meaning (Reyna & Brainerd, 1995). It is possible that the presenting complex scientific evidence to people with verbatim content or appealing to the gist, or bottom-line meaning of the information may influence juror understanding of that evidence. Application of Fuzzy Trace Theory in the medical field has shown that gist representations are beneficial for helping laypeople better understand risk and benefits of medical treatment (Brust-Renck, Reyna, Wilhelms, & Lazar, 2016). Yet, little research has applied Fuzzy Trace Theory to information comprehension and application within the context of a jury (c.f. Reyna et. al., 2015). Additionally, it is likely that jurors’ individual characteristics, such as scientific reasoning abilities and cognitive tendencies, influence their ability to understand and apply complex scientific information (Coutinho, 2006).
Methods
The purpose of this study was to examine how jurors calibrate to the strength of scientific information, and whether individual difference variables and gist aids inspired by Fuzzy Trace Theory help jurors better understand complicated science of differing quality. We used a 2 (quality of scientific evidence: high vs. low) x 2 (decision aid to improve calibration - gist information vs. no gist information), between-subjects design. All hypotheses were preregistered on the Open Science Framework.
Jury-eligible community participants (430 jurors across 90 juries; Mage = 37.58, SD = 16.17, 58% female, 56.93% White). Each jury was randomly assigned to one of the four possible conditions. Participants were asked to individually fill out measures related to their scientific reasoning skills prior to watching a mock jury trial. The trial was about an armed bank robbery and consisted of various pieces of testimony and evidence (e.g. an eyewitness testimony, police lineup identification, and a sweatshirt found with the stolen bank money). The key piece of evidence was mitochondrial DNA (mtDNA) evidence collected from hair on a sweatshirt (materials from Hans et al., 2011). Two experts presented opposing opinions about the scientific evidence related to the mtDNA match estimate for the defendant’s identification. The quality and content of this mtDNA evidence differed based on the two conditions. The high quality evidence condition used a larger database than the low quality evidence to compare to the mtDNA sample and could exclude a larger percentage of people. In the decision aid condition, experts in the gist information group presented gist aid inspired visuals and examples to help explain the proportion of people that could not be excluded as a match. Those in the no gist information group were not given any aid to help them understand the mtDNA evidence presented. After viewing the trial, participants filled out a questionnaire on how well they understood the mtDNA evidence and their overall judgments of the case (e.g. verdict, witness credibility, scientific evidence strength). They filled this questionnaire out again after a 45-minute deliberation.
Measures
We measured Attitudes Toward Science (ATS) with indices of scientific promise and scientific reservations (Hans et al., 2011; originally developed by National Science Board, 2004; 2006). We used Drummond and Fischhoff’s (2015) Scientific Reasoning Scale (SRS) to measure scientific reasoning skills. Weller et al.’s (2012) Numeracy Scale (WNS) measured proficiency in reasoning with quantitative information. The NFC-Short Form (Cacioppo et al., 1984) measured need for cognition. We developed a 20-item multiple-choice comprehension test for the mtDNA scientific information in the cases (modeled on Hans et al., 2011, and McAuliff et al., 2009). Participants were shown 20 statements related to DNA evidence and asked whether these statements were True or False. The test was then scored out of 20 points.
Results
For this project, we measured calibration to the scientific evidence in a few different ways. We are building a full model with these various operationalizations to be presented at APLS, but focus only on one of the calibration DVs (i.e., objective understanding of the mtDNA evidence) in the current proposal. We conducted a general linear model with total score on the mtDNA understanding measure as the DV and quality of scientific evidence condition, decision aid condition, and the four individual difference measures (i.e., NFC, ATS, WNS, and SRS) as predictors. Contrary to our main hypotheses, neither evidence quality nor decision aid condition affected juror understanding. However, the individual difference variables did: we found significant main effects for Scientific Reasoning Skills, F(1, 427) = 16.03, p <.001, np2 = .04, Weller Numeracy Scale, F(1, 427) = 15.19, p <.001, np2 = .03, and Need for Cognition, F(1, 427) = 16.80, p <.001, np2 = .04, such that those who scored higher on these measures displayed better understanding of the scientific evidence. In addition there was a significant interaction of evidence quality condition and scores on the Weller’s Numeracy Scale, F(1, 427) = 4.10, p = .04, np2 = .01. Further results will be discussed.
Discussion
These data suggest jurors are not sensitive to differences in the quality of scientific mtDNA evidence, and also that our attempt at helping sensitize them with Fuzzy Trace Theory-inspired aids did not improve calibration. Individual scientific reasoning abilities and general cognition styles were better predictors of understanding this scientific information. These results suggest a need for further exploration of approaches to help jurors differentiate between high and low quality evidence.
Note: The 3rd author was supported by an AP-LS AP Award for her role in this research.
Learning Objective:
Participants will be able to describe how individual differences in scientific reasoning skills help jurors understand complex scientific evidence.
more »
« less
A Recurrent Neural Network for Attenuating Non-cognitive Components of Pupil Dynamics
There is increasing interest in how the pupil dynamics of the eye reflect underlying cognitive processes and brain states. Problematic, however, is that pupil changes can be due to non-cognitive factors, for example luminance changes in the environment, accommodation and movement. In this paper we consider how by modeling the response of the pupil in real-world environments we can capture the non-cognitive related changes and remove these to extract a residual signal which is a better index of cognition and performance. Specifically, we utilize sequence measures such as fixation position, duration, saccades, and blink-related information as inputs to a deep recurrent neural network (RNN) model for predicting subsequent pupil diameter. We build and evaluate the model for a task where subjects are watching educational videos and subsequently asked questions based on the content. Compared to commonly-used models for this task, the RNN had the lowest errors rates in predicting subsequent pupil dilation given sequence data. Most importantly was how the model output related to subjects' cognitive performance as assessed by a post-viewing test. Consistent with our hypothesis that the model captures non-cognitive pupil dynamics, we found (1) the model's root-mean square error was less for lower performing subjects than for those having better performance on the post-viewing test, (2) the residuals of the RNN (LSTM) model had the highest correlation with subject post-viewing test scores and (3) the residuals had the highest discriminability (assessed via area under the ROC curve, AUC) for classifying high and low test performers, compared to the true pupil size or the RNN model predictions. This suggests that deep learning sequence models may be good for separating components of pupil responses that are linked to luminance and accommodation from those that are linked to cognition and arousal.
more »
« less
- Award ID(s):
- 1816363
- NSF-PAR ID:
- 10295744
- Date Published:
- Journal Name:
- Frontiers in Psychology
- Volume:
- 12
- ISSN:
- 1664-1078
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Costagliola, Ciro (Ed.)Purpose. This study investigated how a conscious change in ocular accommodation affects intraocular pressure (IOP) and ocular biometrics in healthy adult volunteers of different ages. Methods. Thirty-five healthy volunteers without ocular disease or past ocular surgery, and with refractive error between −3.50 and +2.50 diopters, were stratified into 20, 40, and 60 year old (y.o.) age groups. Baseline measurements of central cornea thickness, anterior chamber depth, anterior chamber angle, cornea diameter, pupil size, and ciliary muscle thickness were made by autorefraction and optical coherence tomography (OCT), while IOP was measured by pneumotonometry. Each subject’s right eye focused on a target 40 cm away. Three different tests were performed in random order: (1) 10 minutes of nonaccommodation (gazing at the target through lenses that allowed clear vision without accommodating), (2) 10 minutes of accommodation (addition of a minus 3 diopter lens), and (3) 10 minutes of alternating between accommodation and nonaccommodation (1-minute intervals). IOP was measured immediately after each test. A 20-minute rest period was provided between tests. Data from 31 subjects were included in the study. ANOVA and paired t-tests were used for statistical analyses. Results. Following alternating accommodation, IOP decreased by 0.7 mmHg in the right eye when all age groups were combined ( p = 0.029). Accommodation or nonaccommodation alone did not decrease IOP. Compared to the 20 y.o. group, the 60 y.o. group had a thicker ciliary muscle within 75 μm of the scleral spur, a thinner ciliary muscle at 125–300 μm from the scleral spur, narrower anterior chamber angles, shallower anterior chambers, and smaller pupils during accommodation and nonaccommodation ( p ’s < 0.01). Conclusion. Alternating accommodation, but not constant accommodation, significantly decreased IOP. This effect was not lost with aging despite physical changes to the aging eye. A greater accommodative workload and/or longer test period may improve the effect.more » « less
-
more » « less
Abstract This study investigated whether detection of a performance mistake is followed by adaptive or detrimental effects on subsequent attention and performance. Using a Stroop task with spatial cueing, along with simultaneous EEG and pupillary measurements, we examined evidence bearing on two alternative hypotheses: maladaptive arousal and adaptive control. Error detection, indexed by the error‐related negativity ERP component, was followed by pupil dilation and suppression of EEG oscillations in the alpha band, two indices of arousal that were associated with one another on a trial‐by‐trial basis. On the trials following errors, there was neural evidence of enhanced spatial cueing, manifested in greater hemispheric activation contralateral to the cued visual field. However, this post‐error enhancement was not followed by changes in Stroop or spatial cueing effects in performance, nor by increased attentional cueing effects in ERP responses to targets. Rather, performance tended to be slower and less accurate following errors compared to correct trials, and higher post‐response arousal, indexed by larger pupils, predicted next‐trial slowing and decreased P2 amplitude to targets. Results favor the maladaptive arousal account of post‐error cognitive control and offer only limited support for adaptive control.
-
Making a categorical judgment can systematically bias our subsequent perception of the world. We show that these biases are well explained by a self-consistent Bayesian observer whose perceptual inference process is causally conditioned on the preceding choice. We quantitatively validated the model and its key assumptions with a targeted set of three psychophysical experiments, focusing on a task sequence where subjects first had to make a categorical orientation judgment before estimating the actual orientation of a visual stimulus. Subjects exhibited a high degree of consistency between categorical judgment and estimate, which is difficult to reconcile with alternative models in the face of late, memory related noise. The observed bias patterns resemble the well-known changes in subjective preferences associated with cognitive dissonance, which suggests that the brain’s inference processes may be governed by a universal self-consistency constraint that avoids entertaining ‘dissonant’ interpretations of the evidence.more » « less
-
null (Ed.)Amid the rapid development of building information technologies, wayfinding information has become more accessible to building users and first responders. As a result, a realistic risk of cognitive load related to the wayfinding information processing starts to emerge. As cognition-driven adaptive wayfinding information systems become increasingly captivated to overcome challenges of cognition overload due to overwhelming information, a practical and non-invasive method to monitor and classify cognitive loads during the processing of wayfinding information is needed. This paper tests a Functional Near-Infrared Spectroscopy (fNIRS) based method to identify cognitive load related to wayfinding information processing. It provides a holistic fNIRS signal analytical pipeline to extract hemodynamic response features in the prefrontal cortex (PFC) for cognitive load classification. A human-subject experiment (N=15) based on the Sternberg working memory test was performed to model the relationship between fNIRS features and cognitive load. Personalized models were also evaluated to capture individual differences and identify unique contributing features to each person. The results find that fNIRS-based model can help classify cognitive load changes driven by the different levels of task difficulty with satisfactory performance (avg. accuracy rate 70.02±4.41 percent). The findings also demonstrate that personalized models, instead of universal models, are needed for classifying cognitive load based on neuroimaging data. fNIRS has demonstrated comparable advantages over other neuroimaging methods in cognitive load classification given its robustness to motion artifacts and the satisfactory predictability.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3389/fpsyg.2021.604522
