Commitment is a multi-dimensional construct that has been extensively researched in the context of organizations. Organizational and professional commitment have been positively associated with technical performance, client service, attention to detail, and degree of involvement with one’s job. However, there is a relative dearth of research in terms of team commitment, especially in educational settings. Teamwork is considered a 21stcentury skill and higher education institutions are focusing on helping students to develop teamwork skills by applied projects in the coursework. But studies have demonstrated that creating a team is not enough to help students build teamwork skills. Literature supports the use of team contracts to bolster commitment, among team members. However, the relationship between team contracts and team commitment has not been formally operationalized.This research category study presents a mixed-methods approach towards characterizing and operationalizing team commitment exhibited by students enrolled in a sophomore-level systems analysis and design course by analyzing team contracts and team retrospective reflections. The course covers concepts pertaining to information systems development and includes a semester-long team project where the students work together in four or five member teams to develop the project deliverables. The students have prior software development experiences through an introductory systems development course as well as multiple programming courses. The data for this study was collected through the team contracts signed by students belonging to one of the 23 teams of this course. The study aims to answer the following research question: How can team commitment be characterized in a sophomore-level system analysis and design course among the student teams?A rubric was developed to quantify the team commitment levels of students based on their responses on the team contracts. Students were classified as high or low commitment based on the rubric scores. The emergent themes of high and low commitment teams were also presented. The results indicated that the high commitment teams were focused on setting goals, effective communication, and having mechanisms in place for timely feedback and improvement. On the other hand, low commitment teams did not articulate the goals of the project, they demonstrated a lack of dedication for attending team meetings regularly, working as a team, and had a lack of proper coordination while working together.
more »
« less
Evaluating Commit, Issue and Product Quality in Team Software Development Projects
Providing students with authentic software development experiences is essential to preparing them for careers in industry. To that end, many undergraduate courses include a team-based software development experience in which each team works on a different software project. This raises significant challenges for assessing student work and measuring the impact of pedagogical interventions: What do we measure and how, when each team is working on a different project? To address this question, we present a collection of metrics developed using the Goal-Question-Metric framework from the empirical software engineering literature, and an empirical study in which we applied those metrics to assess 23 team software projects involving 94 students at three institutions. Study results suggest that these metrics, which gauge commit, issue, and overall product quality, are sensitive to differences in the quality of teams' processes and products. This work contributes a new metric-based approach to evaluating key aspects of software development processes and products in a wide variety of computing courses.
more »
« less
- NSF-PAR ID:
- 10297112
- Date Published:
- Journal Name:
- SIGCSE '21: Proceedings of the 52nd ACM Technical Symposium on Computer Science Education
- Page Range / eLocation ID:
- 108 to 114
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Background Effectively facilitating teamwork experiences, particularly in the context of large-size courses, is difficult to implement. This study seeks to address the challenges of implementing effective teamwork experiences in large courses. This study integrated teamwork pedagogy to facilitate a semester-long project in the context of a large-size class comprising 118 students organized into 26 teams. The data for this study were collected from two online teamwork sessions when teams collaborated and self-recorded during the in-class time. The video recordings were qualitatively analyzed to identify patterns in team dynamics processes through visualizations. The study aims to provide insights into the different ways team members engaged in team dynamics processes during different phases of the semester.
Results Findings suggest that members of teams were mostly active and passive during meetings and less constructive and interactive in their engagement. Team members mainly engaged in communication, team orientation, and feedback behaviors. Over time, team members' interactions with one another remained about the same, with feedback behaviors tending to diminish and coordination behaviors staying about the same or slightly increasing over time.
Conclusion The implications of this study extend to both practice and theory. Practically, combining cooperative learning and scrum practices enabled a blend of collaborative and cooperative work, which suggests providing teams with tools and structures to coordinate teamwork processes and promote interaction among team members. From a theoretical perspective, this study contributes to the understanding of temporal aspects of teamwork dynamics by examining how team interactions evolve during working sessions at different points in time. Overall, this research provides valuable insights for educators, practitioners, and researchers aiming to enhance teamwork experiences in large courses, particularly in software development disciplines.
-
Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (more » « less
n = 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’contributions to the team, and theequality of team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous. -
Miller, Eva (Ed.)Nascent Professional Identity Development in Freshman Architecture, Engineering, and Construction (AEC) Women Increasing the persistence of talented women into male-dominated architecture, engineering, and construction (AEC) professions could reduce prevailing workforce shortages and improve gender diversity in AEC industry. Identity theorists advocate that professional identity development (PID) improves students’ persistence to become professionals. However, little empirical research exists to inform and guide AEC educators and professionals on AEC-PID in undergraduate AEC women. As the preliminary part of a larger nationwide and longitudinal research study investigating PID processes in undergraduate AEC women, the objective of this research is to examine the characteristics and nascent AEC-PID in 69 women enrolled in freshman AEC courses in five U.S. institutions. A purposive sampling approach ensures participants have a wide range of demographic characteristics. Data from a recruitment survey is analyzed using the NVivo qualitative data analysis software. Content and relational inductive open coding are conducted vertically for each participant and horizontally across different participants. Results indicate passion/interest, inherent abilities, significant others, benefits from industry, and desire to contribute to industry influence decisions to pursue AEC careers. With 52% of participants having science, technology, engineering, art, and math (STEAM) subject preferences, an in vivo code, Perfect Middle Ground, demonstrated the quest to combine STEM and visual art preferences in AEC career decisions. A participant noted that ‘this major (civil engineering) is the perfect middle ground because I can be creative, but still use my strong gift which happens to be math’. Girls with STEAM strengths and passion, particularly in math and fine art, are most likely to develop nascent AEC-PID. Beyond STEM pre-college programs, AEC educators should consider recruiting from sports, as well as visual and performing arts events for pre-college students. Participants’ positive views focus on the importance and significant societal impact of the AEC industry; while, negative views focus on the lack of gender and racial diversity. A combination of participants’ AEC professional experiences and views reveal four increasing levels of nascent AEC-PID which are categorized as the 4Ps: Plain, Passive, Progressive, and Proactive. As a guide to AEC education and professional communities, recommendations are made to increase the AEC-PID of women in each category. With the highest nascent AEC-PID, women in the Proactive category should serve as leaders in AEC classrooms and student organizations. Considering their AEC professional experience and enthusiasm, they should serve as peer mentors to other students, particularly AEC women. Furthermore, they should be given the opportunity to step into more complex roles during internships and encouraged to pursue co-op opportunities. Insights can guide more targeted recruitment, mentoring, preparation, and retention interventions that strengthen the persistence of the next generation of AEC women professionals. In the long term, this could reduce AEC workforce shortages, improve gender diversity, and foster the innovation and development of more gender friendly AEC products and services.more » « less
-
This project uses an ecological belonging intervention approach [1] that requires one-class or one- recitation/discussion session to implement and has been shown to erase long-standing equity gaps in achievement in introductory STEM courses. However, given the wide social and cultural heterogeneity across US university contexts (e.g., differences in regional demographics, history, political climates), it is an open question if and how the intervention may scale. This project brings together an interdisciplinary team across three strategically selected universities to design, test, and iteratively improve an approach to systematically identify which first and second year courses would most benefit from the intervention, reveal student concerns that may be specific to that course, adapt the intervention to address those concerns, and evaluate the universality versus specificity of the intervention across university contexts. This systematic approach also includes persuasion and training processes for onboarding the instructors of the targeted courses. The instructor onboarding and the intervention adaptation processes are guided by a theory-of-action that is the backbone of the project’s research activities and iterative process improvement. A synergistic mixture of qualitative and quantitative methods is used throughout the study. In this paper, we describe our theoretical framing of this ecological belonging intervention and the current efforts of the project in developing customized student stories for the intervention. We have conducted focus groups across each of the partner institutions (University of Pittsburgh, Purdue University, and University of California Irvine). We describe the process of developing these contextually relevant stories and the lessons learned about how this ecological belonging intervention can be translated across institutional contexts and for various STEM majors and systemically minoritized populations. The results of this work can provide actionable strategies for reducing equity gaps in students' degree attainment and achievement in engineering.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3408877.3432362
