skip to main content


Title: Competing Explanations of Competing Explanations: Accounting for Conflict Between Scientific and Folk Explanations
Abstract

People who hold scientific explanations for natural phenomena also hold folk explanations, and the two types of explanations compete under some circumstances. Here, we explore the question of why folk explanations persist in the face of a well‐understood scientific alternative, a phenomenon known asexplanatory coexistence. We consider two accounts: an associative account, where coexistence is driven by low‐level associations between co‐occurring ideas in experience or discourse, and a theory‐based account, where coexistence reflects high‐level competition between distinct sets of causal expectations. We present data that assess the relative contributions of these two accounts to the cognitive conflict elicited by counterintuitive scientific ideas. Participants (134 college undergraduates) verified scientific statements like “air has weight” and “bacteria have DNA” as quickly as possible, and we examined the speed and accuracy of their verifications in relation to measures of associative information (lexical co‐occurrence of the statements' subjects and predicates) and theory‐based expectations (ratings of whether the statements' subjects possess theory‐relevant attributes). Both measures explained a significant amount of variance in participants' responses, but the theory‐based measures explained three to five times more. These data suggest that the cognitive conflict elicited by counterintuitive scientific ideas typically arises from competing theories and that such ideas might be made more intuitive by strengthening scientific theories or weakening folk theories.

 
more » « less
NSF-PAR ID:
10200526
Author(s) / Creator(s):
 ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Topics in Cognitive Science
Volume:
12
Issue:
4
ISSN:
1756-8757
Page Range / eLocation ID:
p. 1337-1362
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Disease transmission is a fruitful domain in which to examine how scientific and folk theories interrelate, given laypeople’s access to multiple sources of information to explain events of personal significance. The current paper reports an in-depth survey of U.S. adults’ ( N = 238) causal reasoning about two viral illnesses: a novel, deadly disease that has massively disrupted everyone’s lives (COVID-19), and a familiar, innocuous disease that has essentially no serious consequences (the common cold). Participants received a series of closed-ended and open-ended questions probing their reasoning about disease transmission, with a focus on causal mechanisms underlying disease contraction, transmission, treatment, and prevention; non-visible (internal) biological processes; and ontological frameworks regarding what kinds of entities viruses are. We also assessed participants’ attitudes, such as their trust in scientific experts and willingness to be vaccinated. Results indicated complexity in people’s reasoning, consistent with the co-existence of multiple explanatory frameworks. An understanding of viral transmission and viral replication existed alongside folk theories, placeholder beliefs, and lack of differentiation between viral and non-viral disease. For example, roughly 40% of participants who explained illness in terms of the transmission of viruses also endorsed a non-viral folk theory, such as exposure to cold weather or special foods as curative. Additionally, participants made use of competing modes of construal (biological, mechanical, and psychological) when explaining how viruses operate, such as framing the immune system response (biological) as cells trying to fight off the virus (psychological). Indeed, participants who displayed greater knowledge about viral transmission were significantly more likely to anthropomorphize bodily processes. Although comparisons of COVID-19 and the common cold revealed relatively few differences, the latter, more familiar disease elicited consistently lower levels of accuracy and greater reliance on folk theories. Moreover, for COVID-19 in particular, accuracy positively correlated with attitudes (trusting medical scientists and taking the disease more seriously), self-protective behaviors (such as social distancing and mask-wearing), and willingness to be vaccinated. For both diseases, self-assessed knowledge about the disease negatively predicted accuracy. The results are discussed in relation to challenges for formal models of explanatory reasoning. 
    more » « less
  2. Abstract Expert testimony varies in scientific quality and jurors have a difficult time evaluating evidence quality (McAuliff et al., 2009). In the current study, we apply Fuzzy Trace Theory principles, examining whether visual and gist aids help jurors calibrate to the strength of scientific evidence. Additionally we were interested in the role of jurors’ individual differences in scientific reasoning skills in their understanding of case evidence. Contrary to our preregistered hypotheses, there was no effect of evidence condition or gist aid on evidence understanding. However, individual differences between jurors’ numeracy skills predicted evidence understanding. Summary Poor-quality expert evidence is sometimes admitted into court (Smithburn, 2004). Jurors’ calibration to evidence strength varies widely and is not robustly understood. For instance, previous research has established jurors lack understanding of the role of control groups, confounds, and sample sizes in scientific research (McAuliff, Kovera, & Nunez, 2009; Mill, Gray, & Mandel, 1994). Still others have found that jurors can distinguish weak from strong evidence when the evidence is presented alone, yet not when simultaneously presented with case details (Smith, Bull, & Holliday, 2011). This research highlights the need to present evidence to jurors in a way they can understand. Fuzzy Trace Theory purports that people encode information in exact, verbatim representations and through “gist” representations, which represent summary of meaning (Reyna & Brainerd, 1995). It is possible that the presenting complex scientific evidence to people with verbatim content or appealing to the gist, or bottom-line meaning of the information may influence juror understanding of that evidence. Application of Fuzzy Trace Theory in the medical field has shown that gist representations are beneficial for helping laypeople better understand risk and benefits of medical treatment (Brust-Renck, Reyna, Wilhelms, & Lazar, 2016). Yet, little research has applied Fuzzy Trace Theory to information comprehension and application within the context of a jury (c.f. Reyna et. al., 2015). Additionally, it is likely that jurors’ individual characteristics, such as scientific reasoning abilities and cognitive tendencies, influence their ability to understand and apply complex scientific information (Coutinho, 2006). Methods The purpose of this study was to examine how jurors calibrate to the strength of scientific information, and whether individual difference variables and gist aids inspired by Fuzzy Trace Theory help jurors better understand complicated science of differing quality. We used a 2 (quality of scientific evidence: high vs. low) x 2 (decision aid to improve calibration - gist information vs. no gist information), between-subjects design. All hypotheses were preregistered on the Open Science Framework. Jury-eligible community participants (430 jurors across 90 juries; Mage = 37.58, SD = 16.17, 58% female, 56.93% White). Each jury was randomly assigned to one of the four possible conditions. Participants were asked to individually fill out measures related to their scientific reasoning skills prior to watching a mock jury trial. The trial was about an armed bank robbery and consisted of various pieces of testimony and evidence (e.g. an eyewitness testimony, police lineup identification, and a sweatshirt found with the stolen bank money). The key piece of evidence was mitochondrial DNA (mtDNA) evidence collected from hair on a sweatshirt (materials from Hans et al., 2011). Two experts presented opposing opinions about the scientific evidence related to the mtDNA match estimate for the defendant’s identification. The quality and content of this mtDNA evidence differed based on the two conditions. The high quality evidence condition used a larger database than the low quality evidence to compare to the mtDNA sample and could exclude a larger percentage of people. In the decision aid condition, experts in the gist information group presented gist aid inspired visuals and examples to help explain the proportion of people that could not be excluded as a match. Those in the no gist information group were not given any aid to help them understand the mtDNA evidence presented. After viewing the trial, participants filled out a questionnaire on how well they understood the mtDNA evidence and their overall judgments of the case (e.g. verdict, witness credibility, scientific evidence strength). They filled this questionnaire out again after a 45-minute deliberation. Measures We measured Attitudes Toward Science (ATS) with indices of scientific promise and scientific reservations (Hans et al., 2011; originally developed by National Science Board, 2004; 2006). We used Drummond and Fischhoff’s (2015) Scientific Reasoning Scale (SRS) to measure scientific reasoning skills. Weller et al.’s (2012) Numeracy Scale (WNS) measured proficiency in reasoning with quantitative information. The NFC-Short Form (Cacioppo et al., 1984) measured need for cognition. We developed a 20-item multiple-choice comprehension test for the mtDNA scientific information in the cases (modeled on Hans et al., 2011, and McAuliff et al., 2009). Participants were shown 20 statements related to DNA evidence and asked whether these statements were True or False. The test was then scored out of 20 points. Results For this project, we measured calibration to the scientific evidence in a few different ways. We are building a full model with these various operationalizations to be presented at APLS, but focus only on one of the calibration DVs (i.e., objective understanding of the mtDNA evidence) in the current proposal. We conducted a general linear model with total score on the mtDNA understanding measure as the DV and quality of scientific evidence condition, decision aid condition, and the four individual difference measures (i.e., NFC, ATS, WNS, and SRS) as predictors. Contrary to our main hypotheses, neither evidence quality nor decision aid condition affected juror understanding. However, the individual difference variables did: we found significant main effects for Scientific Reasoning Skills, F(1, 427) = 16.03, p <.001, np2 = .04, Weller Numeracy Scale, F(1, 427) = 15.19, p <.001, np2 = .03, and Need for Cognition, F(1, 427) = 16.80, p <.001, np2 = .04, such that those who scored higher on these measures displayed better understanding of the scientific evidence. In addition there was a significant interaction of evidence quality condition and scores on the Weller’s Numeracy Scale, F(1, 427) = 4.10, p = .04, np2 = .01. Further results will be discussed. Discussion These data suggest jurors are not sensitive to differences in the quality of scientific mtDNA evidence, and also that our attempt at helping sensitize them with Fuzzy Trace Theory-inspired aids did not improve calibration. Individual scientific reasoning abilities and general cognition styles were better predictors of understanding this scientific information. These results suggest a need for further exploration of approaches to help jurors differentiate between high and low quality evidence. Note: The 3rd author was supported by an AP-LS AP Award for her role in this research. Learning Objective: Participants will be able to describe how individual differences in scientific reasoning skills help jurors understand complex scientific evidence. 
    more » « less
  3. Abstract  
    more » « less
  4. A major goal of psycholinguistic theory is to account for the cognitive constraints limiting the speed and ease of language comprehension and production. Wide-ranging evidence demonstrates a key role for linguistic expectations: A word’s predictability, as measured by the information-theoretic quantity of surprisal, is a major determinant of processing difficulty. But surprisal, under standard theories, fails to predict the difficulty profile of an important class of linguistic patterns: the nested hierarchical structures made possible by recursion in human language. These nested structures are better accounted for by psycholinguistic theories of constrained working memory capacity. However, progress on theory unifying expectation-based and memory-based accounts has been limited. Here we present a unified theory of a rational trade-off between precision of memory representations with ease of prediction, a scaled-up computational implementation using contemporary machine learning methods, and experimental evidence in support of the theory’s distinctive predictions. We show that the theory makes nuanced and distinctive predictions for difficulty patterns in nested recursive structures predicted by neither expectation-based nor memory-based theories alone. These predictions are confirmed 1) in two language comprehension experiments in English, and 2) in sentence completions in English, Spanish, and German. More generally, our framework offers computationally explicit theory and methods for understanding how memory constraints and prediction interact in human language comprehension and production. 
    more » « less
  5. Common-sense intuitions can be useful guides in everyday life and problem solving. However, they can also impede formal science learning and provide the basis for robust scientific misconceptions. Addressing such misconceptions has generally been viewed as the province of secondary schooling. However, in this article, I argue that for a set of foundational but highly counterintuitive ideas (e.g., evolution by natural selection), coherent causal-explanatory instruction—instruction that emphasizes the multifaceted mechanisms underpinning natural phenomena—should be initiated much sooner, in early elementary school. This proposal is motivated by various findings from research in the cognitive, developmental, and learning sciences. For example, it has been shown that explanatory biases that render students susceptible to intuitively based scientific misconceptions emerge early in development. Furthermore, findings also reveal that once developed, such misconceptions are not revised and replaced by subsequently learned scientific theories but competitively coexist alongside them. Taken together, this research, along with studies revealing the viability of early coherent explanation-based instruction on counterintuitive theories, have significant implications for the timing, structure, and scope of early science education.

     
    more » « less