skip to main content


Title: A Mixed Methods Analysis of Student Experiences in Diverse Teams
This work-in-progress research paper describes the initial findings of research on students’ attitudes about diversity in first-year engineering teams. We used quantitative pre- and post-survey data and qualitative interviews with student teams to understand students’ initial attitudes about diversity and teaming and how those were affected by engineering teaming experiences over a semester. The qualitative and quantitative data analyses interact throughout the project’s iterations, with each informing the other. Here, we review the progress made through in-depth qualitative analysis when compared to survey data about changes in variance of students’ attitudes towards teaming. By using an iterative mixed methods approach, we are able to explore the subtle distinctions in students’ attitudes and experiences affecting diverse teaming experiences. In this paper, we will detail this iterative process and how it has produced more nuanced findings than a particular research paradigm alone.  more » « less
Award ID(s):
1531586
NSF-PAR ID:
10064801
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings - Frontiers in Education Conference
ISSN:
0190-5848
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Teaming is a core part of engineering education, especially in the first and last years of engineering when project work is a prevalent focus. The literature on the effects of working in diverse teams is mixed. Negative findings include decreased affect, increased frustration, and sustained conflict in teams. Positive findings include increased productivity, production of high quality products, and divergent-thinking and idea generation. Given these mixed findings, it becomes important to not only understand the practical outputs of working in diverse teams, but also how the experience of working in diverse teams influences whether students see themselves as engineers and whether or not they feel they belong in engineering. Our project, Building Supports for Diversity through Engineering Teams, investigates how students’ attitudes towards diversity influence how students experience work in diverse teams through addressing two main research questions: 1) What changes occur in students’ diversity sensitivity, multicultural effectiveness, and engineering practices as a result of working in diverse teams? 2) How do students’ perceptions of diversity, affect, and engineering practices change because of working on diverse teams? Using a multi-method approach, we deployed survey instruments to determine changes in student’s attitudes about teaming, diversity sensitivity, and openness attitudes. We also observed students working in teams and interviewed these students about their perceptions of diversity and experiences in their teams. Preliminary results of the quantitative phase show that variance in students’ attitudes about diversity significantly increase over the semester, further reflecting the mixed results that have been seen previously in the literature. Additionally, Social Network Analysis was used to characterize the social structure practices of a multi-section, large-enrollment first-year engineering course. This reveals the underlying social structure of the environment, its inclusiveness, and how diverse students work with others on engineering. Initial results indicate that students are included in social networks regardless of gender and race. Preliminary results of the qualitative phase, using Interpretive Phenomenological Analysis, have yielded relationships between student’s definitions, valuation, and enactment of diversity in engineering spaces. Individual student’s incoming attitudes of diversity and previous experiences interact with practical needs in first-year engineering classrooms to create different microclimates within each team. These microclimates depict tensions between what instructors emphasize about diversity, stereotypes of engineering as focused on technical instead of social skills, and pragmatic forces of “getting the job done.” This knowledge can help explain some of the complexity behind the conflicting literature on diversity in teams. Ultimately, this research can help us understand how to build inclusive and diverse environments that guide students to learn how to understand their own complex relationship, understanding, and enactment of diversity in engineering. By understanding how students make sense of diversity in engineering spaces, educators and researchers can figure out how to introduce these concepts in relevant ways so that students can inclusively meet the grand challenges in engineering. This curriculum integration, in turn, can improve team interactions and the climate of engineering for underrepresented groups. 
    more » « less
  2. https://peer.asee.org/27918 Engineering has become a globally focused career with the need to work with people from diverse backgrounds. Researchers seeking to improve students’ teaming skills have found ways to assess team member effectiveness and development of teaming skills. Despite the emphasis on the importance of developing engineering students’ teaming skills, little research has been conducted on how students develop sensitivity for students from different cultures and backgrounds within teams in first-year engineering programs. Here we define diversity sensitivity as students’ multicultural openness and actions taken to incorporate diverse students. To address the lack of literature on diversity and teaming this work examines the following research questions: What changes occur in students’ diversity sensitivity, multicultural effectiveness, and engineering practices as a result of working in diverse teams? How do students’ perceptions of diversity, affect, and engineering practices change as a result of working on diverse teams? The focus of this paper is on the first phase of this three phase project, in which students’ multicultural openness, diversity sensitivity, and teaming effectiveness were measured quantitatively. Additionally, results from qualitative in-depth interviews further develop emerging trends in the quantitative portions of the work. Survey data were collected from participants enrolled in first semester first-year engineering programs at two institutions (n = 1206) as well as data from the Comprehensive Assessment of Team Member Effectiveness (n = 2763 inclusive of survey participants). We used linear modeling, advanced clustering techniques, and pre-post comparisons to understand underlying student attitudes as well as the ways in which students’ attitudes may shift over the course of the semester. Preliminary results indicate that students’ awareness of diversity increased over the semester; however, unwillingness to take action to support diverse groups also increased. We also found that student attitudes towards teaming are ‘sticky’ and difficult to shift over a single-semester experience even when teaming effectiveness and diversity are explicitly taught in the classroom. Additionally, five teams were observed throughout the course of the semester. These observations were conducted to understand how students interact in ways both explicit and implicit. that may or may not improve belongingness in engineering during teaming activities. Students from teams were interviewed individually after completion of their project to understand their perceptions of diversity. Initial trends indicate a valuing of diversity but a lack of adaptation for diverse individuals due to the demands of engineering tasks. Results of this quantitative and qualitative work were used to further refine instruments and data collection protocols for replication in the subsequent phases of the project. 
    more » « less
  3. The lack of diversity and inclusion has been a major challenge affecting engineering programs all over the United States. This problem has been persistent over the years and has been difficult to address despite considerable amount of attention, enriched conversations, and money that has been put towards addressing it. One of the reasons behind this lack of diversity could be the presence of exclusionary behaviors, such as bias and discrimination that permeate the culture of engineering. To address this “wicked” problem, a deeper understanding of current culture and of potential change strategies toward integrating inclusion and diversity is necessary. Our larger NSF funded research project seeks to achieve this understanding through design thinking. While design thinking has been documented to successfully achieve desired outcomes for numerous other problems, its effectiveness as a tool to understand and solve the “wicked problem” of transformation of disciplinary culture related to diversity and inclusion in engineering is not yet known. This Work-in-Progress paper will address the effectiveness of using a design thinking approach by answering the research question: How did stakeholder participants perceive the impact of design sessions on their understanding and value of diversity and inclusion in the professional formation of biomedical engineers? To address this research question, our research team is coordinating six design sessions within each of two engineering schools: Electrical and Computer Engineering (ECE) and Biomedical Engineering (BME) at a large Midwest University. Currently, we have completed the initial phases of the design sessions in the BME school, and hence this paper focuses on insights from preliminary data analysis of BME Design sessions. BME design sessions were conducted with 15 key stakeholders from the program including students, faculty, staff and administrators. Each of the six design session was two hours long. The research team facilitated the inspiration and ideation phase of the design thinking process throughout. Facilitation involved providing prompts and activities to guide the stakeholders through the design thinking processes of problem identification, problem scoping, and prototype solution generation related to diversity and inclusion within the school culture. A mixed-methods approach involving both qualitative and quantitative data analysis is being used to evaluate the efficacy of design thinking as a tool to address diversity and inclusion in professional formation of engineers. Artifacts such as journey maps, culture maps, and design notebooks generated by our stakeholders throughout the design sessions will be qualitatively analyzed to evaluate the role and effectiveness of design thinking in shaping a more diverse and inclusive culture within BME and, eventually ECE. Following the design sessions, participants were interviewed one-on-one to understand how their thoughts about diversity and inclusion in professional formation of biomedical engineers may have changed, and to gather participants’ self-assessment of the design process. Coupled with the interviews, an online survey was administered to assess the participants’ ranking of the solutions generated at the conclusion design sessions in terms of their novelty, importance and feasibility for implementation within their school. This Work-in-Progress paper will discuss relevant findings from initial quantitative analyses of the data collected from the post-design session surveys and is an interim report evaluating participants’ perceptions of the impact of these design sessions on their understanding of diversity and inclusion in professional formation of biomedical engineers. 
    more » « less
  4. Introduction and Theoretical Frameworks Our study draws upon several theoretical foundations to investigate and explain the educational experiences of Black students majoring in ME, CpE, and EE: intersectionality, critical race theory, and community cultural wealth theory. Intersectionality explains how gender operates together with race, not independently, to produce multiple, overlapping forms of discrimination and social inequality (Crenshaw, 1989; Collins, 2013). Critical race theory recognizes the unique experiences of marginalized groups and strives to identify the micro- and macro-institutional sources of discrimination and prejudice (Delgado & Stefancic, 2001). Community cultural wealth integrates an asset-based perspective to our analysis of engineering education to assist in the identification of factors that contribute to the success of engineering students (Yosso, 2005). These three theoretical frameworks are buttressed by our use of Racial Identity Theory, which expands understanding about the significance and meaning associated with students’ sense of group membership. Sellers and colleagues (1997) introduced the Multidimensional Model of Racial Identity (MMRI), in which they indicated that racial identity refers to the “significance and meaning that African Americans place on race in defining themselves” (p. 19). The development of this model was based on the reality that individuals vary greatly in the extent to which they attach meaning to being a member of the Black racial group. Sellers et al. (1997) posited that there are four components of racial identity: 1. Racial salience: “the extent to which one’s race is a relevant part of one’s self-concept at a particular moment or in a particular situation” (p. 24). 2. Racial centrality: “the extent to which a person normatively defines himself or herself with regard to race” (p. 25). 3. Racial regard: “a person’s affective or evaluative judgment of his or her race in terms of positive-negative valence” (p. 26). This element consists of public regard and private regard. 4. Racial ideology: “composed of the individual’s beliefs, opinions and attitudes with respect to the way he or she feels that the members of the race should act” (p. 27). The resulting 56-item inventory, the Multidimensional Inventory of Black Identity (MIBI), provides a robust measure of Black identity that can be used across multiple contexts. Research Questions Our 3-year, mixed-method study of Black students in computer (CpE), electrical (EE) and mechanical engineering (ME) aims to identify institutional policies and practices that contribute to the retention and attrition of Black students in electrical, computer, and mechanical engineering. Our four study institutions include historically Black institutions as well as predominantly white institutions, all of which are in the top 15 nationally in the number of Black engineering graduates. We are using a transformative mixed-methods design to answer the following overarching research questions: 1. Why do Black men and women choose and persist in, or leave, EE, CpE, and ME? 2. What are the academic trajectories of Black men and women in EE, CpE, and ME? 3. In what way do these pathways vary by gender or institution? 4. What institutional policies and practices promote greater retention of Black engineering students? Methods This study of Black students in CpE, EE, and ME reports initial results from in-depth interviews at one HBCU and one PWI. We asked students about a variety of topics, including their sense of belonging on campus and in the major, experiences with discrimination, the impact of race on their experiences, and experiences with microaggressions. For this paper, we draw on two methodological approaches that allowed us to move beyond a traditional, linear approach to in-depth interviews, allowing for more diverse experiences and narratives to emerge. First, we used an identity circle to gain a better understanding of the relative importance to the participants of racial identity, as compared to other identities. The identity circle is a series of three concentric circles, surrounding an “inner core” representing one’s “core self.” Participants were asked to place various identities from a provided list that included demographic, family-related, and school-related identities on the identity circle to reflect the relative importance of the different identities to participants’ current engineering education experiences. Second, participants were asked to complete an 8-item survey which measured the “centrality” of racial identity as defined by Sellers et al. (1997). Following Enders’ (2018) reflection on the MMRI and Nigrescence Theory, we chose to use the measure of racial centrality as it is generally more stable across situations and best “describes the place race holds in the hierarchy of identities an individual possesses and answers the question ‘How important is race to me in my life?’” (p. 518). Participants completed the MIBI items at the end of the interview to allow us to learn more about the participants’ identification with their racial group, to avoid biasing their responses to the Identity Circle, and to avoid potentially creating a stereotype threat at the beginning of the interview. This paper focuses on the results of the MIBI survey and the identity circles to investigate whether these measures were correlated. Recognizing that Blackness (race) is not monolithic, we were interested in knowing the extent to which the participants considered their Black identity as central to their engineering education experiences. Combined with discussion about the identity circles, this approach allowed us to learn more about how other elements of identity may shape the participants’ educational experiences and outcomes and revealed possible differences in how participants may enact various points of their identity. Findings For this paper, we focus on the results for five HBCU students and 27 PWI students who completed the MIBI and identity circle. The overall MIBI average for HBCU students was 43 (out of a possible 56) and the overall MIBI scores ranged from 36-51; the overall MIBI average for the PWI students was 40; the overall MIBI scores for the PWI students ranged from 24-51. Twenty-one students placed race in the inner circle, indicating that race was central to their identity. Five placed race on the second, middle circle; three placed race on the third, outer circle. Three students did not place race on their identity circle. For our cross-case qualitative analysis, we will choose cases across the two institutions that represent low, medium and high MIBI scores and different ranges of centrality of race to identity, as expressed in the identity circles. Our final analysis will include descriptive quotes from these in-depth interviews to further elucidate the significance of race to the participants’ identities and engineering education experiences. The results will provide context for our larger study of a total of 60 Black students in engineering at our four study institutions. Theoretically, our study represents a new application of Racial Identity Theory and will provide a unique opportunity to apply the theories of intersectionality, critical race theory, and community cultural wealth theory. Methodologically, our findings provide insights into the utility of combining our two qualitative research tools, the MIBI centrality scale and the identity circle, to better understand the influence of race on the education experiences of Black students in engineering. 
    more » « less
  5. https://peer.asee.org/27950 This paper presents results of work completed on our project, Intersectionality of Non-normative Identities in the Cultures of Engineering (InIce). The overarching focus of this project is on how students who hold non-normative identities position themselves, grow through their education, and navigate the cultures of engineering they experience in college. Our goal is to investigate ways to engage students who hold non-normative identities to become more active and lifelong participants in engineering disciplines. Our work is proceeding in three phases: 1) Identify, through a quantitative instrument, the attitudinal profiles of normative and non-normative students in engineering; 2) Characterize students’ normative and non-normative identities through in-depth interviews and analysis of differences between students with normative and non-normative identities in engineering; and 3) Drawing from our findings, develop a workshop and set of courses to incorporate diversity topics into engineering programs to enhance the culture of engineering to be more responsive towards, and inclusive of, a diverse range of student identities. We have completed the first phase of the project in which we quantitatively measured and characterized student groups with normative and non-normative identities in engineering. Our definitions of normative and non-normative for this project are developed through Topological Data Analysis (TDA) of a set of multi-institution survey data (n = 2916). TDA allows identification of groups without imposing a priori hypotheses on how the attitudes of students may group together (nor how they may distinguish between demographic groups). This approach allows the underlying structure of the data to emerge rather than imposing pre-defined definitions of normative attitudes or identities. Our TDA results revealed one group that contains a relatively large number of students (the “normative” group) and a total of seven other distinct, but relatively populated, groups (the “non-normative” groups). We have compiled a summary of the most salient attitudinal constructs in terms of characterizing and distinguishing between all these groups including: motivation (value, goal orientation, future time perspective), engineering and physics identities (performance/competence and recognition beliefs for each), personality traits (neuroticism, extraversion, belongingness) and grit (consistency of interest). We are currently in Phase 2 of our study in which we are conducting a series of qualitative, longitudinal interviews with students selected from normative and non-normative groups to understand how they navigate their engineering experiences and define their educational trajectories over the first two years of college. This data will be deductively analyzed based on our existing attitudinal frameworks as well as inductively coded for emerging themes on how students feel belongingness within engineering culture. This project promises to move traditional measures of demographic data beyond socially constructed perceptions of others and allows for the representation of student diversity from the perspective of each participant. This more accurate reflection of diversity provides novel insight into the experiences of students who might otherwise be ignored or unjustifiably lumped in with other students with whom they share some demographic indicator and how residing at the intersection of multiple measures of diversity can influence students’ experiences in engineering culture. 
    more » « less