skip to main content


This content will become publicly available on June 1, 2024

Title: Assessment of a Survey Instrument for Measuring Affective Pathways
This research paper analyzes the emotions that students experience while completing ill-defined complex problems called Open-Ended Modeling Problems in their engineering courses. Students are asked to make their own modeling decisions, rather than being given those assumptions, as is the case in most textbook problems. There are many approaches they can take, and having to make decisions and assumptions that impact the problem has been found to generate strong emotions. Goldin’s research on mathematics education asserts that students tend toward affective pathways while completing problems. An affective pathway is the sequence of emotions that a student goes through while solving a problem. Goldin theorizes that there are two main categories of affective pathways that students fall into: positive pathways and negative pathways. This paper builds on our previous work on the development of a survey instrument to quantitatively measure affective pathways. The survey asked students to drag and drop emotions into the order they experienced them during their problem solving process. In this study, we sought to improve upon our survey instrument. Based on our previous research, we added several emotions and alphabetized the list to see whether the order of words impacted the responses. Here, we examine the results from an updated survey question as well as a small set of interviews conducted to investigate how students approach answering the survey question by having them think aloud while completing it. The survey was sent to six classes at five universities, and interviews were conducted with six students at two of those universities. Through our analysis, we found that most students feel confused or frustrated at some stage, and that their emotions change as they continue from start to finish, which is in line with the findings of the previous version of the survey instrument. We are looking further into whether the students turned their frustrations into the positive or negative pathways that Goldin describes. From the interviews, we found most of the verbalized pathways matched what was submitted through the survey instrument. However, there were instances where the submitted and verbalized pathway did not match, suggesting further changes to the question’s implementation. Developing a reliable method for measuring affective pathways will enable future study of why and when positive or negative pathways occur, as well as potential actions that engineering educators can take to help students interrupt negative pathways. Goldin’s work suggests that negative pathways influence students’ global affect, which could impact retention in engineering.  more » « less
Award ID(s):
2204726
NSF-PAR ID:
10429894
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
ASEE annual conference proceedings
ISSN:
1524-4857
Page Range / eLocation ID:
1-16
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background

    Real‐world engineering problems are ill‐defined and complex, and solving them may arouse negative epistemic affect (feelings experienced within problem‐solving). These feelings fall into sequenced patterns (affective pathways). Over time, these patterns can alter students' attitudes toward engineering. Meta‐affect (affect or cognition about affect) can shape or reframe affective pathways, changing a student's problem‐solving experience.

    Purpose/Hypothesis(es)

    This paper examines epistemic affect and meta‐affect in undergraduate students solving ill‐defined problems called open‐ended modeling problems (OEMPs), addressing two research questions: What epistemic affect and transitions between different affective states do students report? And, how does meta‐affect shape students' affective experiences?

    Design/Method

    We examined 11 retrospective interviews with nine students performed across two semesters in which students completed OEMPs. Using inductive and deductive coding with discourse analysis, we systematically searched for expressions conveying epistemic affect and for transitions in affect; we performed additional deductive coding of the transcripts for meta‐affect and synthesized these results to formulate narratives related to affect and meta‐affect.

    Results

    Together, the expressions, transitions, and meta‐affect suggest different types of student experiences. Depending on their meta‐affect, students either recounted experiences dominated by positive or negative affect, or else they experienced negative emotions as productive.

    Conclusions

    Ill‐defined complex problems elicit a wide range of positive and negative emotions and provide opportunities to practice affective regulation and productive meta‐affect. Viewing the OEMPs as authentic disciplinary experiences and/or the ability to view negative emotions as productive can enable overall positive experiences. Our results provide insight into how instructors can foster positive affective pathways through problem‐scaffolding or their interactions with students.

     
    more » « less
  2. In March 2020, the global COVID-19 pandemic forced universities across the United States to immediately stop face-to-face activities and transition to virtual instruction. While this transition was not easy for anyone, the shift to online learning was especially difficult for STEM courses, particularly engineering, which has a strong practical/laboratory component. Additionally, underrepresented students (URMs) in engineering experienced a range of difficulties during this transition. The purpose of this paper is to highlight underrepresented engineering students’ experiences as a result of COVID-19. In particular, we aim to highlight stories shared by participants who indicated a desire to share their experience with their instructor. In order to better understand these experiences, research participants were asked to share a story, using the novel data collection platform SenseMaker, based on the following prompt: Imagine you are chatting with a friend or family member about the evolving COVID-19 crisis. Tell them about something you have experienced recently as an engineering student. Conducting a SenseMaker study involves four iterative steps: 1) Initiation is the process of designing signifiers, testing, and deploying the instrument; 2) Story Collection is the process of collecting data through narratives; 3) Sense-making is the process of exploring and analyzing patterns of the collection of narratives; and 4) Response is the process of amplifying positive stories and dampening negative stories to nudge the system to an adjacent possible (Van der Merwe et al. 2019). Unlike traditional surveys or other qualitative data collection methods, SenseMaker encourages participants to think more critically about the stories they share by inviting them to make sense of their story using a series of triads and dyads. After completing their narrative, participants were asked a series of triadic, dyadic, and sentiment-based multiple-choice questions (MCQ) relevant to their story. For one MCQ, in particular, participants were required to answer was “If you could do so without fear of judgment or retaliation, who would you share this story with?” and were given the following options: 1) Family 2) Instructor 3) Peers 4) Prefer not to answer 5) Other. A third of the participants indicated that they would share their story with their instructor. Therefore, we further explored this particular question. Additionally, this paper aims to highlight this subset of students whose primary motivation for their actions were based on Necessity. High-level qualitative findings from the data show that students valued Grit and Perseverance, recent experiences influenced their Sense of Purpose, and their decisions were majorly made based on Intuition. Chi-squared tests showed that there were not any significant differences between race and the desire to share with their instructor, however, there were significant differences when factoring in gender suggesting that gender has a large impact on the complexity of navigating school during this time. Lastly, ~50% of participants reported feeling negative or extremely negative about their experiences, ~30% reported feeling neutral, and ~20% reported feeling positive or extremely positive about their experiences. In the study, a total of 500 micro-narratives from underrepresented engineering students were collected from June – July 2020. Undergraduate and graduate students were recruited for participation through the researchers’ personal networks, social media, and through organizations like NSBE. Participants had the option to indicate who is able to read their stories 1) Everyone 2) Researchers Only, or 3) No one. This work presents qualitative stories of those who granted permission for everyone to read. 
    more » « less
  3. Abstract Background

    Women and under-represented minority (URM) students continue to be under-represented in STEM and earn the lowest proportion of undergraduate engineering degrees. We employed a mixed methods research approach grounded in social capital theory to investigatewhenthey first consider pursuing engineering as a college degree major,whoinfluences this decision, andhowthe influence occurs. First, we surveyed 2186 first-year undergraduate students entering engineering programs at 11 universities in the U.S. during the fall of 2014. Next, we interviewed a subsample of 55 women and URM students.

    Results

    Survey findings indicated that women were more likely than men to consider pursuing engineering while in high school, before admission into college, or while in college rather than considering it earlier in their education. Black and Latinx students were more likely than white students to consider pursuing engineering after high school. In addition, Black and Latinx students were more likely than white students to identify a school counselor (rather than a family member) as having the most influence on their engineering academic and career decisions. In interviews, women and URM students provided examples of influential people who connected their aptitude and enthusiasm for mathematics, science, and problem-solving to engineering, explained the benefits of being an engineer, and provided advice about engineering academic and career pathways.

    Conclusions

    Encouraging earlier consideration of engineering majors, such as during middle school, could allow women and URM students time to take requisite courses and take advantage of college preparatory programming. Likewise, universities can engage in intentional efforts to identify women and URM students with engineering interests and provide guidance. Such efforts should also include connecting them with other women and URM students in engineering. In addition, universities should support K-12 and university personnel in offering advice that can influence students’ decision to declare an engineering major, which could help recruit more women and URM students into engineering.

     
    more » « less
  4. Introduction and Theoretical Frameworks Our study draws upon several theoretical foundations to investigate and explain the educational experiences of Black students majoring in ME, CpE, and EE: intersectionality, critical race theory, and community cultural wealth theory. Intersectionality explains how gender operates together with race, not independently, to produce multiple, overlapping forms of discrimination and social inequality (Crenshaw, 1989; Collins, 2013). Critical race theory recognizes the unique experiences of marginalized groups and strives to identify the micro- and macro-institutional sources of discrimination and prejudice (Delgado & Stefancic, 2001). Community cultural wealth integrates an asset-based perspective to our analysis of engineering education to assist in the identification of factors that contribute to the success of engineering students (Yosso, 2005). These three theoretical frameworks are buttressed by our use of Racial Identity Theory, which expands understanding about the significance and meaning associated with students’ sense of group membership. Sellers and colleagues (1997) introduced the Multidimensional Model of Racial Identity (MMRI), in which they indicated that racial identity refers to the “significance and meaning that African Americans place on race in defining themselves” (p. 19). The development of this model was based on the reality that individuals vary greatly in the extent to which they attach meaning to being a member of the Black racial group. Sellers et al. (1997) posited that there are four components of racial identity: 1. Racial salience: “the extent to which one’s race is a relevant part of one’s self-concept at a particular moment or in a particular situation” (p. 24). 2. Racial centrality: “the extent to which a person normatively defines himself or herself with regard to race” (p. 25). 3. Racial regard: “a person’s affective or evaluative judgment of his or her race in terms of positive-negative valence” (p. 26). This element consists of public regard and private regard. 4. Racial ideology: “composed of the individual’s beliefs, opinions and attitudes with respect to the way he or she feels that the members of the race should act” (p. 27). The resulting 56-item inventory, the Multidimensional Inventory of Black Identity (MIBI), provides a robust measure of Black identity that can be used across multiple contexts. Research Questions Our 3-year, mixed-method study of Black students in computer (CpE), electrical (EE) and mechanical engineering (ME) aims to identify institutional policies and practices that contribute to the retention and attrition of Black students in electrical, computer, and mechanical engineering. Our four study institutions include historically Black institutions as well as predominantly white institutions, all of which are in the top 15 nationally in the number of Black engineering graduates. We are using a transformative mixed-methods design to answer the following overarching research questions: 1. Why do Black men and women choose and persist in, or leave, EE, CpE, and ME? 2. What are the academic trajectories of Black men and women in EE, CpE, and ME? 3. In what way do these pathways vary by gender or institution? 4. What institutional policies and practices promote greater retention of Black engineering students? Methods This study of Black students in CpE, EE, and ME reports initial results from in-depth interviews at one HBCU and one PWI. We asked students about a variety of topics, including their sense of belonging on campus and in the major, experiences with discrimination, the impact of race on their experiences, and experiences with microaggressions. For this paper, we draw on two methodological approaches that allowed us to move beyond a traditional, linear approach to in-depth interviews, allowing for more diverse experiences and narratives to emerge. First, we used an identity circle to gain a better understanding of the relative importance to the participants of racial identity, as compared to other identities. The identity circle is a series of three concentric circles, surrounding an “inner core” representing one’s “core self.” Participants were asked to place various identities from a provided list that included demographic, family-related, and school-related identities on the identity circle to reflect the relative importance of the different identities to participants’ current engineering education experiences. Second, participants were asked to complete an 8-item survey which measured the “centrality” of racial identity as defined by Sellers et al. (1997). Following Enders’ (2018) reflection on the MMRI and Nigrescence Theory, we chose to use the measure of racial centrality as it is generally more stable across situations and best “describes the place race holds in the hierarchy of identities an individual possesses and answers the question ‘How important is race to me in my life?’” (p. 518). Participants completed the MIBI items at the end of the interview to allow us to learn more about the participants’ identification with their racial group, to avoid biasing their responses to the Identity Circle, and to avoid potentially creating a stereotype threat at the beginning of the interview. This paper focuses on the results of the MIBI survey and the identity circles to investigate whether these measures were correlated. Recognizing that Blackness (race) is not monolithic, we were interested in knowing the extent to which the participants considered their Black identity as central to their engineering education experiences. Combined with discussion about the identity circles, this approach allowed us to learn more about how other elements of identity may shape the participants’ educational experiences and outcomes and revealed possible differences in how participants may enact various points of their identity. Findings For this paper, we focus on the results for five HBCU students and 27 PWI students who completed the MIBI and identity circle. The overall MIBI average for HBCU students was 43 (out of a possible 56) and the overall MIBI scores ranged from 36-51; the overall MIBI average for the PWI students was 40; the overall MIBI scores for the PWI students ranged from 24-51. Twenty-one students placed race in the inner circle, indicating that race was central to their identity. Five placed race on the second, middle circle; three placed race on the third, outer circle. Three students did not place race on their identity circle. For our cross-case qualitative analysis, we will choose cases across the two institutions that represent low, medium and high MIBI scores and different ranges of centrality of race to identity, as expressed in the identity circles. Our final analysis will include descriptive quotes from these in-depth interviews to further elucidate the significance of race to the participants’ identities and engineering education experiences. The results will provide context for our larger study of a total of 60 Black students in engineering at our four study institutions. Theoretically, our study represents a new application of Racial Identity Theory and will provide a unique opportunity to apply the theories of intersectionality, critical race theory, and community cultural wealth theory. Methodologically, our findings provide insights into the utility of combining our two qualitative research tools, the MIBI centrality scale and the identity circle, to better understand the influence of race on the education experiences of Black students in engineering. 
    more » « less
  5. High levels of stress and anxiety are common amongst college students, particularly engineering students. Students report lack of sleep, grades, competition, change in lifestyle, and other significant stressors throughout their undergraduate education (1, 2). Stress and anxiety have been shown to negatively impact student experience (3-6), academic performance (6-8), and retention (9). Previous studies have focused on identifying factors that cause individual students stress while completing undergraduate engineering degree programs (1). However, it not well-understood how a culture of stress is perceived and is propagated in engineering programs or how this culture impacts student levels of identification with engineering. Further, the impact of student stress has not been directly considered in engineering regarding recruitment, retention, and success. Therefore, our guiding research question is: Does the engineering culture create stress for students that hinder their engineering identity development? To answer our research question, we designed a sequential mixed methods study with equal priority of quantitative survey data and qualitative individual interviews. Our study participants are undergraduate engineering students across all levels and majors at a large, public university. Our sample goal is 2000 engineering student respondents. We combined three published surveys to build our quantitative data collection instrument, including the Depression Anxiety Stress Scales (DASS), Identification with engineering subscale, and Engineering Department Inclusion Level subscale. The objective of the quantitative instrument is to illuminate individual perceptions of the existence of an engineering stress culture (ESC) and create an efficient tool to measure the impact ESC on engineering identity development. Specifically, we seek to understand the relationships among the following constructs; 1) identification with engineering, 2) stress and anxiety, and 3) feelings of inclusion within their department. The focus of this paper presents the results of the pilot of the proposed instrument with 20 participants and a detailed data collection and analysis process. In an effort to validate our instrument, we conducted a pilot study to refine our data collection process and the results will guide the data collection for the larger study. In addition to identifying relationships among construct, the survey data will be further analyzed to specify which demographics are mediating or moderating factors of these relationships. For example, does a student’s 1st generation status influence their perception of stress or engineering identity development? Our analysis may identify discipline-specific stressors and characterize culture components that promote student anxiety and stress. Our objective is to validate our survey instrument and use it to inform the protocol for the follow-up interviews to gain a deeper understanding of the responses to the survey instrument. Understanding what students view as stressful and how students identify stress as an element of program culture will support the development of interventions to mitigate student stress. References 1. Schneider L (2007) Perceived stress among engineering students. A Paper Presented at St. Lawrence Section Conference. Toronto, Canada. Retrieved from: www. asee. morrisville. edu. 2. Ross SE, Niebling BC, & Heckert TM (1999) Sources of stress among college students. Social psychology 61(5):841-846. 3. Goldman CS & Wong EH (1997) Stress and the college student. Education 117(4):604-611. 4. Hudd SS, et al. (2000) Stress at college: Effects on health habits, health status and self-esteem. College Student Journal 34(2):217-228. 5. Macgeorge EL, Samter W, & Gillihan SJ (2005) Academic Stress, Supportive Communication, and Health A version of this paper was presented at the 2005 International Communication Association convention in New York City. Communication Education 54(4):365-372. 6. Burt KB & Paysnick AA (2014) Identity, stress, and behavioral and emotional problems in undergraduates: Evidence for interaction effects. Journal of college student development 55(4):368-384. 7. Felsten G & Wilcox K (1992) Influences of stress and situation-specific mastery beliefs and satisfaction with social support on well-being and academic performance. Psychological Reports 70(1):291-303. 8. Pritchard ME & Wilson GS (2003) Using emotional and social factors to predict student success. Journal of college student development 44(1):18-28. 9. Zhang Z & RiCharde RS (1998) Prediction and Analysis of Freshman Retention. AIR 1998 Annual Forum Paper. 
    more » « less