skip to main content


Title: Survey & Experimental Evidence of Cognitive Biases in Psychologists’ Judgments
Three studies (1 survey, 2 experiments) examine cognitive biases in the professional judgments of nationally-representative samples of psychologists working in legal contexts. Study 1 (N= 84) demonstrates robust evidence of the bias blind spot (Pronin, Lin, & Ross, 2002) in experts’ judgments. Psychologists rated their own susceptibility to bias in their professional work lower than their colleagues (and laypeople). As expected, they perceived bias mitigating procedures as more threatening to their own domain than outside domains, and more experience was correlated with higher perceived threat of bias mitigating procedures. Experimental studies 2 (N=118) & 3 (N=128) with randomly-selected psychologists reveals psychologists overwhelmingly engage in confirmation bias (93% with one decision opportunity in study 1, and 90%, 87%, and 82% across three decision opportunities in study 2). Cognitive reflection was negatively correlated with confirmation bias. Psychologists were also susceptible to order effects in that the order of symptoms presented affected their diagnoses–even though the same symptoms existed in the different scenarios (in opposite orders).  more » « less
Award ID(s):
1655011
NSF-PAR ID:
10086238
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Society for Personality & Social Psychology
Volume:
2019
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    In recent years, studies in engineering education have begun to intentionally integrate disability into discussions of diversity, inclusion, and equity. To broaden and advocate for the participation of this group in engineering, researchers have identified a variety of factors that have kept people with disabilities at the margins of the field. Such factors include the underrepresentation of disabled individuals within research and industry; systemic and personal barriers, and sociocultural expectations within and beyond engineering education-related contexts. These findings provide a foundational understanding of the external and environmental influences that can shape how students with disabilities experience higher education, develop a sense of belonging, and ultimately form professional identities as engineers. Prior work examining the intersections of disability identity and professional identity is limited, with little to no studies examining the ways in which students conceptualize, define, and interpret disability as a category of identity during their undergraduate engineering experience. This lack of research poses problems for recruitment, retention, and inclusion, particularly as existing studies have shown that the ways in which students perceive and define themselves in relation to their college major is crucial for the development of a professional engineering identity. Further, due to variation in defining ‘disability’ across national agencies (e.g., the National Institutes of Health, and the Department of Justice) and disability communities (with different models of disability), the term “disability” is broad and often misunderstood, frequently referring to a group of individuals with a wide range of conditions and experiences. Therefore, the purpose of this study is to gain deeper insights into the ways students define disability and disability identity within their own contexts as they develop professional identities. Specifically, we ask the following research question: How do students describe and conceptualize non-apparent disabilities? To answer this research question, we draw from emergent findings from an on-going grounded theory exploration of professional identity formation of undergraduate civil engineering students with disabilities. In this paper, we focus our discussion on the grounded theory analyses of 4 semi-structured interviews with participants who have disclosed a non-apparent disability. Study participants consist of students currently enrolled in undergraduate civil engineering programs, students who were initially enrolled in undergraduate civil engineering programs and transferred to another major, and students who have recently graduated from a civil engineering program within the past year. Sensitizing concepts emerged as findings from the initial grounded theory analysis to guide and initiate our inquiry: 1) the medical model of disability, 2) the social model of disability, and 3) personal experience. First, medical models of disability position physical, cognitive, and developmental difference as a “sickness” or “condition” that must be “treated”. From this perspective, disability is perceived as an impairment that must be accommodated so that individuals can obtain a dominantly-accepted sense of normality. An example of medical models within the education context include accommodations procedures in which students must obtain an official diagnosis in order to access tools necessary for academic success. Second, social models of disability position disability as a dynamic and fluid identity that consists of a variety of physical, cognitive, or developmental differences. Dissenting from assumptions of normality and the focus on individual bodily conditions (hallmarks of the medical model), the social model focuses on the political and social structures that inherently create or construct disability. An example of a social model within the education context includes the universal design of materials and tools that are accessible to all students within a given course. In these instances, students are not required to request accommodations and may, consequently, bypass medical diagnoses. Lastly, participants referred to their own life experiences as a way to define, describe, and consider disability. Fernando considers his stutter to be a disability because he is often interrupted, spoken over, or silenced when engaging with others. In turn, he is perceived as unintelligent and unfit to be a civil engineer by his peers. In contrast, David, who identifies as autistic, does not consider himself to be disabled. These experiences highlight the complex intersections of medical and social models of disability and their contextual influences as participants navigate their lives. While these sensitizing concepts are not meant to scope the research, they provide a useful lens for initiating research and provides markers on which a deeper, emergent analysis is expanded. Findings from this work will be used to further explore the professional identity formation of undergraduate civil engineering students with disabilities. These findings will provide engineering education researchers and practitioners with insights regarding the ways individuals with disabilities interpret their in- and out-of-classroom experiences and navigate their disability identities. For higher education, broadly, this work aims to reinforce the complex and diverse nature of disability experience and identity, particularly as it relates to accommodations and accessibility within the classroom, and expand the inclusiveness of our programs and institutions. 
    more » « less
  2. Abstract. In the geosciences, recent attention has been paid to the influence of uncertainty on expert decision-making. When making decisions under conditions of uncertainty, people tend to employ heuristics (rules of thumb) based on experience, relying on their prior knowledge and beliefs to intuitively guide choice. Over 50 years of decision-making research in cognitive psychology demonstrates that heuristics can lead to less-than-optimal decisions, collectively referred to as biases. For example, the availability bias occurs when people make judgments based on what is most dominant or accessible in memory; geoscientists who have spent the past several months studying strike-slip faults will have this terrain most readily available in their mind when interpreting new seismic data. Given the important social and commercial implications of many geoscience decisions, there is a need to develop effective interventions for removing or mitigating decision bias. In this paper, we outline the key insights from decision-making research about how to reduce bias and review the literature on debiasing strategies. First, we define an optimal decision, since improving decision-making requires having a standard to work towards. Next, we discuss the cognitive mechanisms underlying decision biases and describe three biases that have been shown to influence geoscientists' decision-making (availability bias, framing bias, anchoring bias). Finally, we review existing debiasing strategies that have applicability in the geosciences, with special attention given to strategies that make use of information technology and artificial intelligence (AI). We present two case studies illustrating different applications of intelligent systems for the debiasing of geoscientific decision-making, wherein debiased decision-making is an emergent property of the coordinated and integrated processing of human–AI collaborative teams. 
    more » « less
  3. Abstract. In the geosciences, recent attention has been paid to the influence of uncertainty on expert decision making. When making decisions under conditions of uncertainty, people tend to employ heuristics (rules of thumb) based on experience, relying on their prior knowledge and beliefs to intuitively guide choice. Over 50 years of decision making research in cognitive psychology demonstrates that heuristics can lead to less-than-optimal decisions, collectively referred to as biases. For example, a geologist who confidently interprets ambiguous data as representative of a familiar category form their research (e.g., strike slip faults for expert in extensional domains) is exhibiting the availability bias, which occurs when people make judgments based on what is most dominant or accessible in memory. Given the important social and commercial implications of many geoscience decisions, there is a need to develop effective interventions for removing or mitigating decision bias. In this paper, we summarize the key insights from decision making research about how to reduce bias and review the literature on debiasing strategies. First, we define an optimal decision, since improving decision making requires having a standard to work towards. Next, we discuss the cognitive mechanisms underlying decision biases and describe three biases that have been shown to influence geoscientists decision making (availability bias, framing bias, anchoring bias). Finally, we review existing debiasing strategies that have applicability in the geosciences, with special attention given to those strategies that make use of information technology and artificial intelligence (AI). We present two case studies illustrating different applications of intelligent systems for the debiasing of geoscientific decision making, where debiased decision making is an emergent property of the coordinated and integrated processing of human-AI collaborative teams.

     
    more » « less
  4. There is an urgent need for young people to prepare for and pursue engineering careers. Engineering occupations comprise 20% of the science, technology, engineering, and math (STEM) jobs in the U.S. (Bureau of Labor Statistics, 2017). The average wage for STEM occupations is nearly double that of non-STEM occupations, with engineers commanding some of the highest salaries in STEM (Bureau of Labor Statistics, 2017). Moreover, engineering occupations are expected to be some of the fastest growing occupations in the U.S. over the next 10 years (Occupational Outlook Handbook, 2018); yet, there are current and projected shortages of workers in the engineering workforce so that many engineering jobs will go unfilled (Bureau of Labor Statistics, 2015) Native Americans are highly underrepresented in engineering (NSF, 2017). They comprise approximately 2% of the U.S. population (U.S. Census Bureau, 2013), but only 0.3% of engineers (Sandia National Laboratories, 2016). Thus, they are not positioned to attain a high-demand, high-growth, highly rewarding engineering job, nor to provide engineering expertise to meet the needs of their own communities or society at large. The purpose of this study was to examine factors that encourage or discourage Native American college students’ entry into engineering. Using Social Cognitive Career Theory (SCCT; Lent, Brown, & Hackett, 1994; 2000), we examined the correlates of these students’ interests and efficacy in engineering to accomplish this goal. Participants were N = 30 Native American engineering college students from the Midwest; 65% men, 30% women, and 4% other. The mean age was 25.87 (SD = 6.98). Data were collected over the period of one year on college campuses and at professional development conferences via an online survey hosted on Qualtrics. Three scales were used in the study: Mapping Vocational Challenges – Engineering (Lapan & Turner, 2000, 2016), the Perceptions of Barriers Scale (POB; McWhirter, 1998), and the Structured Career Development Inventory (Lapan & Turner, 2004). An a priori Power Analysis (f2 = .50; α = .05, 1 – β = .90) indicated our sample size was adequate. For all scales, full-scale Cronbach’s α reliabilities ranged from .82 to .86. Results of correlation analyses indicated that engineering efficacy was negatively related to lack of academic preparation (r = -.50, p = .016), and perceived lack of ability (r = -.53, p = .009), and positively related to academic achievement (r = .43, p = .043), career exploration (r = .47, p = .022), and approaching engineering studies proactively (r = .53, p = .009). Engineering interests were negatively related to perceived lack of ability (r = -.55, p = .007), and positively to proactivity (r = .42, p = .044), and academic achievement (r = .45, p = .033). Engineering interests were also related to support from parents, teachers, and friends to study engineering and pursue an engineering career. There was no significant relationship between engineering interests and engineering efficacy among these students. The relevance of these results will be discussed in light of SCCT, and recommendations for practice will be included. 
    more » « less
  5. Abstract

    Psychologists have convincingly demonstrated that preferences are not always stable and, instead, are often “constructed” based on information available in the judgment or decision context. In 4 studies with experts (accountants and actuaries in Studies 1 and 2, respectively) and a diverse lay population (Studies 3 and 4), the evidence was consistent with the highly numerate being more likely than the less numerate to construct their preferences by rating a numerically inferior bet as superior (i.e., the bets effect). Thus, the effect generalizes beyond a college student sample, and preference construction differs by numeracy. Contrary to prior thinking about preference construction, however, high expertise and high ability (rather than low) consistently related to the paradoxical phenomenon. Results across studies including Study 3's experimental modifications of the task supported the hypothesized number comparison process (and not a lack of expertise with monetary outcomes and probabilities or numeracy‐related differences in attention to numbers) as the effect's underlying cause. The bets effect was not attenuated by Study 4's instructions to think about what would be purchased with bet winnings. Task results combined with free‐response coding supported the notion that highly numerate participants have a systematic and persistent inclination for doing simple and complex number operations that drive their judgments (even after controlling for nonnumeric intelligence). Implications for 3 types of dual‐process theories are discussed. The results were inconsistent with default‐interventionist theories, consistent or unclear with respect to fuzzy trace theory, and consistent with interactive theories.

     
    more » « less