Ability to effectively work in teams is one of the desired outcomes of engineering and engineering technology programs. Unfortunately, working in teams is still challenging for many students. Rather than contributing to team projects, some students resort to social loafing. Social loafing tends to destroy both teamwork performance and individual learning, especially in solving ill-structured problems, such as design. Furthermore, a bad experience on a past team is a significant concern as it could generate negative feelings toward future team projects. Formation of collaborative teams is a critical first step in team-project-based design courses as team composition directly affects not only teamwork processes and outcomes, but also teamwork skills and experience. This NSF-IUSE sponsored project aims to enhance students’ teamwork experiences and teamwork learning through 1) understanding how to form better student design teams and 2) identifying exercises that will effectively improve team member collaboration. We do this by comparing student characteristics and design task characteristics with the quality of the design team outcome, and examining the resulting correlations. Student characteristics cover six categories: 1) background information, 2) work structure preferences, 3) personality, 4) ability, 5) motivation, and 6) attitude. Task characteristics and design team outcomes are characterized using the Creative Product Semantic Scale. In this article, we present correlations between student/team characteristics and design project outcome, and correlations between task characteristics and design project outcome for 2020-2021 senior design teams at two institutions. For both institutions, we will present correlations between individual student characteristics and team outcome. For one institution, we will also present correlation between team-level characteristics and team outcomes.
more »
« less
Approaches to Evidencing Intra-Team Equity in Student Collaborative Design Decision-Making Interactions
Team- and project-based pedagogies are increasingly normative in engineering education and beyond. Student teamwork holds the promise of developing collaborative skills deemed essential for new engineers by professional accreditation bodies such as ABET. The emphasis on these models, furthermore, reflects developments in pedagogical theory, stressing the importance of experiential learning and the social construction of knowledge, repositioning the instructor as a facilitator and guide. Teamwork in an educational context differs from that in professional contexts in that learning outcomes for all team members – both in terms of technical knowledge and team-working skills – are a primary goal of the activity, even while more tangible task-related outcomes might be the main concern of the students themselves. However, team-based learning also holds the potential for team members to have negative experiences, of which instructors may have little or no awareness, especially in real-time. Teams may achieve team-level outcomes required for successful completion, in spite of uneven levels of participation and contribution. Reduced participation on the part of an individual team member may have many causes, pro-active or reactive: it may be a deliberate refusal to engage, a lack of self-confidence, or a response to hostility from other members, among other possibilities. Inequitable team interactions will lead to uneven uptake of desired learning outcomes. Fostering equity in interactions and identifying inequitable practices among team members is therefore an important part of implementing team-based pedagogies, and an essential first step in identifying and challenging systematic patterns of inequity with regard to members of historically marginalized groups. This paper will therefore explore ways in which equity in group decision-making may be conceptualized and observed, laying the foundations for identifying and addressing inequities in the student experience. It will begin by considering different potential manifestations of interactional equity, surveying notions derived from prior education research in the fields of health, mathematics, engineering, and the natural sciences. These notions include: equity of participation on the basis of quantified vocal contributions (in terms of words, utterances, or clausal units); distribution and evolution of interactional roles; equity of idea endorsement and uptake; distribution of inchargeness and influence; equity of access to positional identities and discourse practices; and team member citizenship. In the paper’s empirical component, we trial measures of equity taken or developed from this literature on a small dataset of transcripts showing verbal interactions between undergraduate student team members in a first-year engineering design course. Some measures will be qualitative and others quantitative, depending on the particular form and manifestation of equity they are designed to examine. Measures include manual coding of speech acts and interactional ‘bids’, statistical measures of utterance frequency and length, and computational approaches to modeling interactional features such as social impact and receptivity. Results are compared with the students’ own reflections on the interactions, taken immediately afterward. Recommendations are made for the application of the measures, both from research and practice perspectives. Keywords: Teamwork, Equity, Interaction, Design
more »
« less
- Award ID(s):
- 2120252
- PAR ID:
- 10446599
- Date Published:
- Journal Name:
- American Society for Engineering Education
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The purpose of this research paper is to explore whether participation in an interdisciplinary collaboration program partnering Preservice Teachers (PST) and Undergraduate Engineering Students (UES) results in an increase in teamwork effectiveness. The interdisciplinary collaboration was designed as a service-learning project within existing undergraduate programs that included the development and delivery of engineering content to a K-12 audience. The collaborations were integrated into existing courses in two colleges, engineering and education. The Behaviorally Anchored Rating Scale (BARS) version of the Comprehensive Assessment of Team Member Effectiveness (CATME) was used midway and at the end of the project to evaluate teamwork effectiveness. Results of the analysis indicated that both PST and UES experienced a significant increase in team-member effectiveness over the course of the project in four of the five factors: interacting with team members, keeping the team on track, expecting quality, and having relevant knowledge, skills and abilities. A noticeable positive increase in student attitudes towards the task was also observed between the midway and the end of the project. Analysis also suggests that the gain in the teamwork effectiveness did not differ across majors, with both UES and PST showing similar gains. Findings from this study provide some preliminary evidence that an innovative interdisciplinary service learning experience partnering engineering and education students, had a positive impact on their teamwork skills.more » « less
-
We describe and analyze our efforts to support Learning Assistants (LAs)—undergraduate peer educators who simultaneously take a 3-credit pedagogy course—in fostering equitable team dynamics and collaboration within a project-based engineering design course. Tonso and others have shown that (a) inequities can “live” in mundane interactions such as those among students within design teams and (b) those inequities both reflect and (re)produce broader cultural patterns and narratives (e.g. Wolfe & Powell, 2009; Tonso, 1996, 2006a, 2006b; McLoughlin, 2005). LAs could be well-positioned to notice and potentially disrupt inequitable patterns of participation within design teams. In this paper, we explore (1) How do LAs notice, diagnose, and consider responding to teamwork troubles within design teams, and (2) What ideological assumptions plausibly contribute to LAs’ sensemaking around their students’ teamwork troubles? To do so, we analyze how the LAs notice and consider responding to issues of equitable teamwork and participation, as exhibited in three related activities: (i) an in-class roleplay, (ii) observing and diagnosing teamwork troubles (TTs) in the engineering design teams, and (iii) imagining possible instructional responses to those troubles, and students’ possible reactions. We articulate three modes of thinking that roughly capture patterns in LAs’ descriptions and diagnoses of, and imagined responses to, the teamwork troubles: individual accountability, where the trouble is seen as caused by individual(s) described as “off task” or “checked out” or demonstrating some level of incompetence; delegation of work, where the trouble was located in the team leader’s inability to delegate tasks effectively to team members, or in the group’s general lack of communication about what tasks need to be completed, who should execute the tasks, and what work other groups in the team were doing; and emergent systems, where trouble was described as a group-level phenomenon emerging from the patterns of interaction amongst group members, contextual features, and larger structural forces. We find that LAs drew on individual accountability and delegation of work to evaluate TTs. Much rarer were ascriptions of TTs to interactional dynamics between teammates. We connected these modes to the underlying ideological assumptions that have consequences for how meritocracy and technocracy (Slaton, 2015; Cech, 2014) play out in an engineering design classroom and serve to ameliorate or reify engineering mindsets (Riley, 2008). The modes are asymmetric, in that emergent systems based interpretations hold more potential for elucidating ongoing social processes, for challenging meritocracy and socio-technical duality, and for seeing power differentials within interpersonal and institutional contexts. We argue for the need to better understand the ideological assumptions underlying how peer-educators—and other instructors—interpret classroom events.more » « less
-
Team-based learning is commonly used in engineering introductory courses. As students of a team may be from vastly different backgrounds, academically and non-academically, it is important for faculty members to know what aid or hinder team success. The dataset that is used in this paper includes student personality inputs, self-and-peer-assessments of teamwork, and perceptions of teamwork outcomes. Using this information, we developed several bayesian models that are able to predict if a team is working well. We also constructed and estimated Q-matrices which are crucial in explaining the relationship between latent traits and students’ characteristics in cognitive diagnostic models. The prediction and diagnostic models are able to help faculty members and instructors to gain insights into finding ways to separate students into teams more effectively so that students have a positive team-based learning experience.more » « less
-
ObjectiveWe explore the relationships between objective communication patterns displayed during virtual team meetings and established, qualitative measures of team member effectiveness. BackgroundA key component of teamwork is communication. Automated measures of objective communication patterns are becoming more feasible and offer the ability to measure and monitor communication in a scalable, consistent and continuous manner. However, their validity in reflecting meaningful measures of teamwork processes are not well established, especially in real-world settings. MethodWe studied real-world virtual student teams working on semester-long projects. We captured virtual team meetings using the Zoom video conferencing platform throughout the semester and periodic surveys comprising peer ratings of team member effectiveness. Leveraging audio transcripts, we examined relationships between objective measures of speaking time, silence gap duration and vocal turn-taking and peer ratings of team member effectiveness. ResultsSpeaking time, speaking turn count, degree centrality and (marginally) speaking turn duration, but not silence gap duration, were positively related to individual-level team member effectiveness. Time in dyadic interactions and interaction count, but not interaction length, were positively related to dyad-level team member effectiveness. ConclusionOur study highlights the relevance of objective measures of speaking time and vocal turn-taking to team member effectiveness in virtual project-based teams, supporting the validity of these objective measures and their use in future research. ApplicationOur approach offers a scalable, easy-to-use method for measuring communication patterns and team member effectiveness in virtual teams and opens the opportunity to study these patterns in a more continuous and dynamic manner.more » « less