More Like this

1. The Influence of Participation in a Multi-Disciplinary Collaborative Service Learning Project on the Effectiveness of Team Members in a 100-level Mechanical Engineering Class

   Ringleb, SI ; Pazos, P ; Noginova, J ; Cima, F ; Ayala, OM ; Kaipa, K ; Kidd, JJ ; Gutierrez, K ( January 2021 , 2021 ASEE Annual Conference)

   null (Ed.)

   Engineers need to develop professional skills, including the ability to work successfully in teams and to communicate within and outside of their discipline, in addition to required technical skills. A collaborative multi-disciplinary service learning project referred to as Ed+gineering was implemented in a 100-level mechanical engineering course. In this collaboration, mechanical engineering students, primarily in the second semester of their freshman year or first semester of their second year, worked over the course of a semester with education students taking a foundations course to develop and deliver engineering lessons to fourth or fifth graders. Students in comparison engineering classes worked on a team project focused on experimental design for a small satellite system. The purpose of this study was to determine if participating in the Ed+gineering collaboration had a positive effect on teamwork effectiveness and satisfaction when compared to the comparison class. In both team projects, the five dimensions of the Comprehensive Assessment of Team Member Effectiveness (CATME) system were used as a quantitative assessment. The five dimensions of CATME Behaviorally Anchored Ratings Scale (BARS) (contribution to the team’s work, interacting with teammates, keeping the team on track, expecting quality, and having relevant Knowledge, Skills, and Abilities - KSAs) were measured. Additionally, within the CATME platform team satisfaction, team interdependence and team cohesiveness were measured. ANCOVA analysis was used to assess the quantitative data from CATME. Preliminary results suggest that students in the treatment classes had higher team member effectiveness and overall satisfaction scores than students in the comparison classes. Qualitative data from reflections written at the completion of the aforementioned projects were used to explore these results. 

   more » « less
2. The impact of gender on individual perceptions and team psychological safety in engineering design teams

   Cole, C. ; Jablokow, K. ; Simkins, S. ; Miller, S. ( August 2022 , International Design Engineering Technical Conferences and Computers and Information in Engineering Conference)

   Improving team interactions in engineering to model gender inclusivity has been at the forefront of many initiatives in both academia and industry. However, there has been limited evidence on the impact of gender-diverse teams on psychological safety. This is important because psychological safety has been shown to be a key facet for the development of innovative ideas, and has also been shown to be a cornerstone of effective teamwork. But how does the gender diversity of a team impact the development of psychological safety? The current study was developed to explore just this through an empirical study with 38 engineering design student teams over the course of an 8-week design project. These teams were designed to be half heterogeneous (either half-male and half-female, or majority male) or other half homogeneous (all male). We captured psychological safety at five time points between the homogenous and heterogenous teams and also explored individual dichotomous (peer-review) ratings of psychological safety at the end of the project. Results indicated that there was no difference in psychological safety between gender homogenous and heterogenous teams. However, females perceived themselves as more psychologically safe with other female team members compared to their ratings of male team members. Females also perceived themselves to be less psychologically safe with male team members compared to male ratings of female team members, indicating a discrepancy in perceptions between genders. These results point to the need to further explore the role of minoritized groups in psychological safety research and to explore how this effect presents itself (or is covered up) at the team level. 

   more » « less
3. The Impact of Gender on Individual Perceptions and Team Psychological Safety in Engineering Design Teams.

   Cole, C. ; Jablokow, K. ; Mohammed, S. ; Improving team interactions in engineering to model gender inclusivity has been at the forefront of many initiatives in both academia and industry. However, there has ( August 2022 , International Design Engineering Technical Conferences and Computers and Information in Engineering Conference)

   Improving team interactions in engineering to model gender inclusivity has been at the forefront of many initiatives in both academia and industry. However, there has been limited evidence on the impact of gender-diverse teams on psychological safety. This is important because psychological safety has been shown to be a key facet for the development of innovative ideas, and has also been shown to be a cornerstone of effective teamwork. But how does the gender diversity of a team impact the development of psychological safety? The current study was developed to explore just this through an empirical study with 38 engineering design student teams over the course of an 8-week design project. These teams were designed to be half heterogeneous (either half-male and half- female, or majority male) or other half homogeneous (all male). We captured psychological safety at five time points between the homogenous and heterogenous teams and also explored individual dichotomous (peer-review) ratings of psychological safety at the end of the project. Results indicated that there was no difference in psychological safety between gender homogenous and heterogenous teams. However , females perceived themselves as more psychologically safe with other female team members compared to their ratings of male team members. Females also perceived themselves to be less psychologically safe with male team members compared to male ratings of female team members, indicating a discrepancy In perceptions between genders. These results point to the need to further explore the role of minoritized groups in psychological safety research and to explore how this effect presents itself (or is covered up) at the team level. 

   more » « less
4. Combining GitHub, Chat, and Peer Evaluation Data to Assess Individual Contributions to Team Software Development Projects

   https://doi.org/10.1145/3593592  

   Hundhausen, Christopher ; Conrad, Phill ; Adesope, Olusola ; Tariq, Ahsun ( September 2023 , ACM Transactions on Computing Education)

   Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (n= 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’contributionsto the team, and theequalityof team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous. 

   more » « less
5. Successes and Challenges in Supporting Undergraduate Peer Educators to Notice and Respond to Equity Considerations within Design Teams

   Turpen, Chandra ; Gupta, Ayush ; Radoff, Jennifer ; Elby, Andrew ; Sabo, Hannah ; Quan, Gina ( June 2018 , ASEE annual conference & exposition proceedings)

   We describe and analyze our efforts to support Learning Assistants (LAs)—undergraduate peer educators who simultaneously take a 3-credit pedagogy course—in fostering equitable team dynamics and collaboration within a project-based engineering design course. Tonso and others have shown that (a) inequities can “live” in mundane interactions such as those among students within design teams and (b) those inequities both reflect and (re)produce broader cultural patterns and narratives (e.g. Wolfe & Powell, 2009; Tonso, 1996, 2006a, 2006b; McLoughlin, 2005). LAs could be well-positioned to notice and potentially disrupt inequitable patterns of participation within design teams. In this paper, we explore (1) How do LAs notice, diagnose, and consider responding to teamwork troubles within design teams, and (2) What ideological assumptions plausibly contribute to LAs’ sensemaking around their students’ teamwork troubles? To do so, we analyze how the LAs notice and consider responding to issues of equitable teamwork and participation, as exhibited in three related activities: (i) an in-class roleplay, (ii) observing and diagnosing teamwork troubles (TTs) in the engineering design teams, and (iii) imagining possible instructional responses to those troubles, and students’ possible reactions. We articulate three modes of thinking that roughly capture patterns in LAs’ descriptions and diagnoses of, and imagined responses to, the teamwork troubles: individual accountability, where the trouble is seen as caused by individual(s) described as “off task” or “checked out” or demonstrating some level of incompetence; delegation of work, where the trouble was located in the team leader’s inability to delegate tasks effectively to team members, or in the group’s general lack of communication about what tasks need to be completed, who should execute the tasks, and what work other groups in the team were doing; and emergent systems, where trouble was described as a group-level phenomenon emerging from the patterns of interaction amongst group members, contextual features, and larger structural forces. We find that LAs drew on individual accountability and delegation of work to evaluate TTs. Much rarer were ascriptions of TTs to interactional dynamics between teammates. We connected these modes to the underlying ideological assumptions that have consequences for how meritocracy and technocracy (Slaton, 2015; Cech, 2014) play out in an engineering design classroom and serve to ameliorate or reify engineering mindsets (Riley, 2008). The modes are asymmetric, in that emergent systems based interpretations hold more potential for elucidating ongoing social processes, for challenging meritocracy and socio-technical duality, and for seeing power differentials within interpersonal and institutional contexts. We argue for the need to better understand the ideological assumptions underlying how peer-educators—and other instructors—interpret classroom events. 

   more » « less