More Like this

1. The Effects of Gist Information and Scientific Quality on Damages in a Civil Trial

   Dellapaolera, K.S. ( March 2020 , Annual Conference of the American Psychology-Law Society.)

   Abstract: 100 words Jurors are increasingly exposed to scientific information in the courtroom. To determine whether providing jurors with gist information would assist in their ability to make well-informed decisions, the present experiment utilized a Fuzzy Trace Theory-inspired intervention and tested it against traditional legal safeguards (i.e., judge instructions) by varying the scientific quality of the evidence. The results indicate that jurors who viewed high quality evidence rated the scientific evidence significantly higher than those who viewed low quality evidence, but were unable to moderate the credibility of the expert witness and apply damages appropriately resulting in poor calibration. Summary: <1000 words Jurors and juries are increasingly exposed to scientific information in the courtroom and it remains unclear when they will base their decisions on a reasonable understanding of the relevant scientific information. Without such knowledge, the ability of jurors and juries to make well-informed decisions may be at risk, increasing chances of unjust outcomes (e.g., false convictions in criminal cases). Therefore, there is a critical need to understand conditions that affect jurors’ and juries’ sensitivity to the qualities of scientific information and to identify safeguards that can assist with scientific calibration in the courtroom. The current project addresses these issues with an ecologically valid experimental paradigm, making it possible to assess causal effects of evidence quality and safeguards as well as the role of a host of individual difference variables that may affect perceptions of testimony by scientific experts as well as liability in a civil case. Our main goal was to develop a simple, theoretically grounded tool to enable triers of fact (individual jurors) with a range of scientific reasoning abilities to appropriately weigh scientific evidence in court. We did so by testing a Fuzzy Trace Theory-inspired intervention in court, and testing it against traditional legal safeguards. Appropriate use of scientific evidence reflects good calibration – which we define as being influenced more by strong scientific information than by weak scientific information. Inappropriate use reflects poor calibration – defined as relative insensitivity to the strength of scientific information. Fuzzy Trace Theory (Reyna & Brainerd, 1995) predicts that techniques for improving calibration can come from presentation of easy-to-interpret, bottom-line “gist” of the information. Our central hypothesis was that laypeople’s appropriate use of scientific information would be moderated both by external situational conditions (e.g., quality of the scientific information itself, a decision aid designed to convey clearly the “gist” of the information) and individual differences among people (e.g., scientific reasoning skills, cognitive reflection tendencies, numeracy, need for cognition, attitudes toward and trust in science). Identifying factors that promote jurors’ appropriate understanding of and reliance on scientific information will contribute to general theories of reasoning based on scientific evidence, while also providing an evidence-based framework for improving the courts’ use of scientific information. All hypotheses were preregistered on the Open Science Framework. Method Participants completed six questionnaires (counterbalanced): Need for Cognition Scale (NCS; 18 items), Cognitive Reflection Test (CRT; 7 items), Abbreviated Numeracy Scale (ABS; 6 items), Scientific Reasoning Scale (SRS; 11 items), Trust in Science (TIS; 29 items), and Attitudes towards Science (ATS; 7 items). Participants then viewed a video depicting a civil trial in which the defendant sought damages from the plaintiff for injuries caused by a fall. The defendant (bar patron) alleged that the plaintiff (bartender) pushed him, causing him to fall and hit his head on the hard floor. Participants were informed at the outset that the defendant was liable; therefore, their task was to determine if the plaintiff should be compensated. Participants were randomly assigned to 1 of 6 experimental conditions: 2 (quality of scientific evidence: high vs. low) x 3 (safeguard to improve calibration: gist information, no-gist information [control], jury instructions). An expert witness (neuroscientist) hired by the court testified regarding the scientific strength of fMRI data (high [90 to 10 signal-to-noise ratio] vs. low [50 to 50 signal-to-noise ratio]) and gist or no-gist information both verbally (i.e., fairly high/about average) and visually (i.e., a graph). After viewing the video, participants were asked if they would like to award damages. If they indicated yes, they were asked to enter a dollar amount. Participants then completed the Positive and Negative Affect Schedule-Modified Short Form (PANAS-MSF; 16 items), expert Witness Credibility Scale (WCS; 20 items), Witness Credibility and Influence on damages for each witness, manipulation check questions, Understanding Scientific Testimony (UST; 10 items), and 3 additional measures were collected, but are beyond the scope of the current investigation. Finally, participants completed demographic questions, including questions about their scientific background and experience. The study was completed via Qualtrics, with participation from students (online vs. in-lab), MTurkers, and non-student community members. After removing those who failed attention check questions, 469 participants remained (243 men, 224 women, 2 did not specify gender) from a variety of racial and ethnic backgrounds (70.2% White, non-Hispanic). Results and Discussion There were three primary outcomes: quality of the scientific evidence, expert credibility (WCS), and damages. During initial analyses, each dependent variable was submitted to a separate 3 Gist Safeguard (safeguard, no safeguard, judge instructions) x 2 Scientific Quality (high, low) Analysis of Variance (ANOVA). Consistent with hypotheses, there was a significant main effect of scientific quality on strength of evidence, F(1, 463)=5.099, p=.024; participants who viewed the high quality evidence rated the scientific evidence significantly higher (M= 7.44) than those who viewed the low quality evidence (M=7.06). There were no significant main effects or interactions for witness credibility, indicating that the expert that provided scientific testimony was seen as equally credible regardless of scientific quality or gist safeguard. Finally, for damages, consistent with hypotheses, there was a marginally significant interaction between Gist Safeguard and Scientific Quality, F(2, 273)=2.916, p=.056. However, post hoc t-tests revealed significantly higher damages were awarded for low (M=11.50) versus high (M=10.51) scientific quality evidence F(1, 273)=3.955, p=.048 in the no gist with judge instructions safeguard condition, which was contrary to hypotheses. The data suggest that the judge instructions alone are reversing the pattern, though nonsignificant, those who received the no gist without judge instructions safeguard awarded higher damages in the high (M=11.34) versus low (M=10.84) scientific quality evidence conditions F(1, 273)=1.059, p=.30. Together, these provide promising initial results indicating that participants were able to effectively differentiate between high and low scientific quality of evidence, though inappropriately utilized the scientific evidence through their inability to discern expert credibility and apply damages, resulting in poor calibration. These results will provide the basis for more sophisticated analyses including higher order interactions with individual differences (e.g., need for cognition) as well as tests of mediation using path analyses. [References omitted but available by request] Learning Objective: Participants will be able to determine whether providing jurors with gist information would assist in their ability to award damages in a civil trial. 

   more » « less
2. Assessing Drawing Self-efficacy: A Validation Study Using Exploratory Factor Analysis (EFA) for the Drawing Self-efficacy Instrument (DSEI)

   https://doi.org/10.18260/1-2--36704  

   Jaison, Donna ; Merzdorf, Hillary ; Williford, Blake ; White, Lance ; Watson, Karan ; Douglas, Kerrie ; Hammond, Tracy ( July 2021 , 2021 ASEE Virtual Annual Conference)

   Drawing, as a skill, is closely tied to many creative fields and it is a unique practice for every individual. Drawing has been shown to improve cognitive and communicative abilities, such as visual communication, problem-solving skills, students’ academic achievement, awareness of and attention to surrounding details, and sharpened analytical skills. Drawing also stimulates both sides of the brain and improves peripheral skills of writing, 3-D spatial recognition, critical thinking, and brainstorming. People are often exposed to drawing as children, drawing their families, their houses, animals, and, most notably, their imaginative ideas. These skills develop over time naturally to some extent, however, while the base concept of drawing is a basic skill, the mastery of this skill requires extensive practice and it can often be significantly impacted by the self-efficacy of an individual. Sketchtivity is an AI tool developed by Texas A&M University to facilitate the growth of drawing skills and track their performance. Sketching skill development depends in part on students’ self-efficacy associated with their drawing abilities. Gauging the drawing self-efficacy of individuals is critical in understanding the impact that this drawing practice has had with this new novel instrument, especially in contrast to traditional practicing methods. It may also be very useful for other researchers, educators, and technologists. This study reports the development and initial validation of a new 13-item measure that assesses perceived drawing self efficacy. The13 items to measure drawing self efficacy were developed based on Bandura’s guide for constructing Self-Efficacy Scales. The participants in the study consisted of 222 high school students from engineering, art, and pre-calculus classes. Internal consistency of the 13 observed items were found to be very high (Cronbach alpha: 0.943), indicating a high reliability of the scale. Exploratory Factor Analysis was performed to further investigate the variance among the 13 observed items, to find the underlying latent factors that influenced the observed items, and to see if the items needed revision. We found that a three model was the best fit for our data, given fit statistics and model interpretability. The factors are: Factor 1: Self-efficacy with respect to drawing specific objects; Factor 2: Self-efficacy with respect to drawing practically to solve problems, communicating with others, and brainstorming ideas; Factor 3: Self-efficacy with respect to drawing to create, express ideas, and use one’s imagination. An alternative four-factor model is also discussed. The purpose of our study is to inform interventions that increase self-efficacy. We believe that this assessment will be valuable especially for education researchers who implement AI-based tools to measure drawing skills.This initial validity study shows promising results for a new measure of drawing self-efficacy. Further validation with new populations and drawing classes is needed to support its use, and further psychometric testing of item-level performance. In the future, this self-efficacy assessment could be used by teachers and researchers to guide instructional interventions meant to increase drawing self-efficacy. 

   more » « less
3. The Centrality of Black Identity for Black Students in Engineering

   Mobley, Catherine ; Brawner, Catherine E. ; Brent, Rebecca ; Orr, Marisa K. ( January 2021 , Collaborative Network for Engineering and Computing Diversity (CoNECD) Conference)

   Introduction and Theoretical Frameworks Our study draws upon several theoretical foundations to investigate and explain the educational experiences of Black students majoring in ME, CpE, and EE: intersectionality, critical race theory, and community cultural wealth theory. Intersectionality explains how gender operates together with race, not independently, to produce multiple, overlapping forms of discrimination and social inequality (Crenshaw, 1989; Collins, 2013). Critical race theory recognizes the unique experiences of marginalized groups and strives to identify the micro- and macro-institutional sources of discrimination and prejudice (Delgado & Stefancic, 2001). Community cultural wealth integrates an asset-based perspective to our analysis of engineering education to assist in the identification of factors that contribute to the success of engineering students (Yosso, 2005). These three theoretical frameworks are buttressed by our use of Racial Identity Theory, which expands understanding about the significance and meaning associated with students’ sense of group membership. Sellers and colleagues (1997) introduced the Multidimensional Model of Racial Identity (MMRI), in which they indicated that racial identity refers to the “significance and meaning that African Americans place on race in defining themselves” (p. 19). The development of this model was based on the reality that individuals vary greatly in the extent to which they attach meaning to being a member of the Black racial group. Sellers et al. (1997) posited that there are four components of racial identity: 1. Racial salience: “the extent to which one’s race is a relevant part of one’s self-concept at a particular moment or in a particular situation” (p. 24). 2. Racial centrality: “the extent to which a person normatively defines himself or herself with regard to race” (p. 25). 3. Racial regard: “a person’s affective or evaluative judgment of his or her race in terms of positive-negative valence” (p. 26). This element consists of public regard and private regard. 4. Racial ideology: “composed of the individual’s beliefs, opinions and attitudes with respect to the way he or she feels that the members of the race should act” (p. 27). The resulting 56-item inventory, the Multidimensional Inventory of Black Identity (MIBI), provides a robust measure of Black identity that can be used across multiple contexts. Research Questions Our 3-year, mixed-method study of Black students in computer (CpE), electrical (EE) and mechanical engineering (ME) aims to identify institutional policies and practices that contribute to the retention and attrition of Black students in electrical, computer, and mechanical engineering. Our four study institutions include historically Black institutions as well as predominantly white institutions, all of which are in the top 15 nationally in the number of Black engineering graduates. We are using a transformative mixed-methods design to answer the following overarching research questions: 1. Why do Black men and women choose and persist in, or leave, EE, CpE, and ME? 2. What are the academic trajectories of Black men and women in EE, CpE, and ME? 3. In what way do these pathways vary by gender or institution? 4. What institutional policies and practices promote greater retention of Black engineering students? Methods This study of Black students in CpE, EE, and ME reports initial results from in-depth interviews at one HBCU and one PWI. We asked students about a variety of topics, including their sense of belonging on campus and in the major, experiences with discrimination, the impact of race on their experiences, and experiences with microaggressions. For this paper, we draw on two methodological approaches that allowed us to move beyond a traditional, linear approach to in-depth interviews, allowing for more diverse experiences and narratives to emerge. First, we used an identity circle to gain a better understanding of the relative importance to the participants of racial identity, as compared to other identities. The identity circle is a series of three concentric circles, surrounding an “inner core” representing one’s “core self.” Participants were asked to place various identities from a provided list that included demographic, family-related, and school-related identities on the identity circle to reflect the relative importance of the different identities to participants’ current engineering education experiences. Second, participants were asked to complete an 8-item survey which measured the “centrality” of racial identity as defined by Sellers et al. (1997). Following Enders’ (2018) reflection on the MMRI and Nigrescence Theory, we chose to use the measure of racial centrality as it is generally more stable across situations and best “describes the place race holds in the hierarchy of identities an individual possesses and answers the question ‘How important is race to me in my life?’” (p. 518). Participants completed the MIBI items at the end of the interview to allow us to learn more about the participants’ identification with their racial group, to avoid biasing their responses to the Identity Circle, and to avoid potentially creating a stereotype threat at the beginning of the interview. This paper focuses on the results of the MIBI survey and the identity circles to investigate whether these measures were correlated. Recognizing that Blackness (race) is not monolithic, we were interested in knowing the extent to which the participants considered their Black identity as central to their engineering education experiences. Combined with discussion about the identity circles, this approach allowed us to learn more about how other elements of identity may shape the participants’ educational experiences and outcomes and revealed possible differences in how participants may enact various points of their identity. Findings For this paper, we focus on the results for five HBCU students and 27 PWI students who completed the MIBI and identity circle. The overall MIBI average for HBCU students was 43 (out of a possible 56) and the overall MIBI scores ranged from 36-51; the overall MIBI average for the PWI students was 40; the overall MIBI scores for the PWI students ranged from 24-51. Twenty-one students placed race in the inner circle, indicating that race was central to their identity. Five placed race on the second, middle circle; three placed race on the third, outer circle. Three students did not place race on their identity circle. For our cross-case qualitative analysis, we will choose cases across the two institutions that represent low, medium and high MIBI scores and different ranges of centrality of race to identity, as expressed in the identity circles. Our final analysis will include descriptive quotes from these in-depth interviews to further elucidate the significance of race to the participants’ identities and engineering education experiences. The results will provide context for our larger study of a total of 60 Black students in engineering at our four study institutions. Theoretically, our study represents a new application of Racial Identity Theory and will provide a unique opportunity to apply the theories of intersectionality, critical race theory, and community cultural wealth theory. Methodologically, our findings provide insights into the utility of combining our two qualitative research tools, the MIBI centrality scale and the identity circle, to better understand the influence of race on the education experiences of Black students in engineering. 

   more » « less
4. Measuring adaptive expertise amongst first-year STEM students

   De Rosa, A.J. ; Lytle, A. ; Fisher. F.T. ( April 2022 , 2022 ASEE Mid-Atlantic Section Spring Conference)

   Engineering programs must weave coverage of disciplinary content with the ability of students to apply and extend this content knowledge to new contexts and for use in their professional practice as engineers. It is, therefore, necessary for schools to promote and cultivate additional dispositions within their students that better enable them to adapt and employ their disciplinary knowledge. The concept of an “adaptive expert” (AE) has been previously developed within the learning sciences to describe an individual with deep content knowledge but who also displays additional cognitive characteristics that better enable them to employ their knowledge and skills in practice. Four constructs have been identified in the literature as forming the basis of this adaptive expertise: 1) multiple perspectives (MP), 2) metacognition (META), 3) goals and beliefs (GB), and 4) epistemology (EPIST). Upon entry to an engineering program, it is likely that students will present with different levels of development and awareness within these particular dimensions. Baseline levels must, therefore, be measured in order to assess these levels of development and before research-based practices and activities can be designed to promote growth in these constructs. In this work-in-progress study, the “adaptiveness” of incoming undergraduate STEM students (n=711) is measured using a previously developed validated survey instrument used in other studies to measure levels of adaptive expertise amongst undergraduate students by determining their levels along the four identified dimensions of AE. Based on this survey data, statistically significant differences were found in the AE constructs for men and women, with women outscoring men in three of the four AE subscales (MP, META, EPIST) and men outscoring women in goals and beliefs (GB). White students were found to score statistically higher than Asian students in both multiple perspectives (MP) and goals and beliefs (GB), while no statistically significant differences were observed when White and Black/African American students were compared. The mean epistemology (EPIST) scores for White, non-Hispanic students was statistically higher than Hispanic students, with low-income students scoring lower than non-low-income students on this subscale. This project seeks to provide baseline data concerning the adaptivity of incoming first-year students. A structured mentoring program focusing on elements of AE will then be implemented and student growth in the dimensions of AE assessed through their program of study. 

   more » « less
5. "I'm looking at you, you're a perfectly good person …”: Describing non-apparent disability in engineering

   https://doi.org/https://strategy.asee.org/36059  

   Zongrone, C. ; McCall, C. ; Paretti, M. C. ; Shew, A. ; Simmons, D. R. ; McNair, L. D. ( January 2021 , Collaborative Network for Engineerign and Computing Diversity)

   null (Ed.)

   In recent years, studies in engineering education have begun to intentionally integrate disability into discussions of diversity, inclusion, and equity. To broaden and advocate for the participation of this group in engineering, researchers have identified a variety of factors that have kept people with disabilities at the margins of the field. Such factors include the underrepresentation of disabled individuals within research and industry; systemic and personal barriers, and sociocultural expectations within and beyond engineering education-related contexts. These findings provide a foundational understanding of the external and environmental influences that can shape how students with disabilities experience higher education, develop a sense of belonging, and ultimately form professional identities as engineers. Prior work examining the intersections of disability identity and professional identity is limited, with little to no studies examining the ways in which students conceptualize, define, and interpret disability as a category of identity during their undergraduate engineering experience. This lack of research poses problems for recruitment, retention, and inclusion, particularly as existing studies have shown that the ways in which students perceive and define themselves in relation to their college major is crucial for the development of a professional engineering identity. Further, due to variation in defining ‘disability’ across national agencies (e.g., the National Institutes of Health, and the Department of Justice) and disability communities (with different models of disability), the term “disability” is broad and often misunderstood, frequently referring to a group of individuals with a wide range of conditions and experiences. Therefore, the purpose of this study is to gain deeper insights into the ways students define disability and disability identity within their own contexts as they develop professional identities. Specifically, we ask the following research question: How do students describe and conceptualize non-apparent disabilities? To answer this research question, we draw from emergent findings from an on-going grounded theory exploration of professional identity formation of undergraduate civil engineering students with disabilities. In this paper, we focus our discussion on the grounded theory analyses of 4 semi-structured interviews with participants who have disclosed a non-apparent disability. Study participants consist of students currently enrolled in undergraduate civil engineering programs, students who were initially enrolled in undergraduate civil engineering programs and transferred to another major, and students who have recently graduated from a civil engineering program within the past year. Sensitizing concepts emerged as findings from the initial grounded theory analysis to guide and initiate our inquiry: 1) the medical model of disability, 2) the social model of disability, and 3) personal experience. First, medical models of disability position physical, cognitive, and developmental difference as a “sickness” or “condition” that must be “treated”. From this perspective, disability is perceived as an impairment that must be accommodated so that individuals can obtain a dominantly-accepted sense of normality. An example of medical models within the education context include accommodations procedures in which students must obtain an official diagnosis in order to access tools necessary for academic success. Second, social models of disability position disability as a dynamic and fluid identity that consists of a variety of physical, cognitive, or developmental differences. Dissenting from assumptions of normality and the focus on individual bodily conditions (hallmarks of the medical model), the social model focuses on the political and social structures that inherently create or construct disability. An example of a social model within the education context includes the universal design of materials and tools that are accessible to all students within a given course. In these instances, students are not required to request accommodations and may, consequently, bypass medical diagnoses. Lastly, participants referred to their own life experiences as a way to define, describe, and consider disability. Fernando considers his stutter to be a disability because he is often interrupted, spoken over, or silenced when engaging with others. In turn, he is perceived as unintelligent and unfit to be a civil engineer by his peers. In contrast, David, who identifies as autistic, does not consider himself to be disabled. These experiences highlight the complex intersections of medical and social models of disability and their contextual influences as participants navigate their lives. While these sensitizing concepts are not meant to scope the research, they provide a useful lens for initiating research and provides markers on which a deeper, emergent analysis is expanded. Findings from this work will be used to further explore the professional identity formation of undergraduate civil engineering students with disabilities. These findings will provide engineering education researchers and practitioners with insights regarding the ways individuals with disabilities interpret their in- and out-of-classroom experiences and navigate their disability identities. For higher education, broadly, this work aims to reinforce the complex and diverse nature of disability experience and identity, particularly as it relates to accommodations and accessibility within the classroom, and expand the inclusiveness of our programs and institutions. 

   more » « less