skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: An Empirical Study of the Content and Quality of Sprint Retrospectives in Undergraduate Team Software Projects
The retrospective, or retro, is a fundamental component of the Agile process, widely used in both software engineering courses and industry. In a retro, teams come together at the end of a sprint to reflect on their team's performance. We conducted an empirical study to explore three research questions concerning retros in undergraduate team projects: (1) What do students reflect on? (2) What is the quality of their reflections? (3) How do teams' retros vary in terms of content and quality? Our study analyzed a corpus of 963 statements documented in the retros of 32 undergraduate software teams (n = 182 students) enrolled in four software engineering courses at two North American universities. A content analysis revealed that teams reflected most often on their work, communication, and collaboration practices. Nearly a third of teams' reflections focused on their general work practices, while nearly half focused on specific areas of the software development lifecycle---most prominently, pull requests, issues, and coding/testing/debugging. An analysis of the quality of teams' retro reflections showed that only 13% provided justification for a strategy to be stopped, continued, or started. An analysis of team-by-team results indicated significant differences in teams' retro content and quality. We compare these results to previous studies of retros in academia and industry, and consider their implications for software engineering education.  more » « less
Award ID(s):
1915196 1915198
PAR ID:
10555904
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
ACM
Date Published:
ISBN:
9798400704987
Page Range / eLocation ID:
104 to 114
Subject(s) / Keyword(s):
team software projects software engineering education Agile development retrospectives metacognition reflection content analysis
Format(s):
Medium: X
Location:
Lisbon Portugal
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Providing students with authentic software development experiences is essential to preparing them for careers in industry. To that end, many undergraduate courses include a team-based software development experience in which each team works on a different software project. This raises significant challenges for assessing student work and measuring the impact of pedagogical interventions: What do we measure and how, when each team is working on a different project? To address this question, we present a collection of metrics developed using the Goal-Question-Metric framework from the empirical software engineering literature, and an empirical study in which we applied those metrics to assess 23 team software projects involving 94 students at three institutions. Study results suggest that these metrics, which gauge commit, issue, and overall product quality, are sensitive to differences in the quality of teams' processes and products. This work contributes a new metric-based approach to evaluating key aspects of software development processes and products in a wide variety of computing courses. 
    more » « less
  2. Absent from the undergraduate aerospace curricula at many universities is any acknowledgement of macroethics, the ways in which engineering impacts society positively and negatively. Without putting aerospace engineering in its social context, students are left ill-prepared to recognize and address challenging ethical questions and issues they will encounter in their future engineering careers. Alternatively, aerospace engineering curricula should support the development of the critical consciousness required to reflect on the social impact of the field and students’ present and future roles within it. We are addressing this pressing need with integrated research and curriculum development. Our multi-institutional team is composed of aerospace and engineering education research faculty, graduate students in engineering education, undergraduate students in engineering, and practitioners in the aerospace industry. The overarching objective of our design-based research project is to investigate how a macroethical curriculum can be effectively integrated into aerospace engineering science courses. To do this, we ask two research questions to inform the curriculum: RQ1) What are undergraduate students’ current awareness and perceptions of macroethical issues in aerospace engineering?, and RQ2) In what ways do students feel their education is or is not preparing them to address macroethical issues? We also pose a question to assess our curriculum: RQ3) How does the macroethical curriculum impact students’ perceptions and awareness of macroethical issues and their desire to engage with the macroethical implications of their future work? In this poster, we will describe the development and iteration of macroethics lessons in multiple aerospace engineering courses, along with an assessment of the lessons through instructor reflections and quantitative student feedback. We will also describe the development of a survey to conduct quantitative and qualitative analyses of students’ awareness and perception of macroethical issues in aerospace engineering. We will also present preliminary results of exploratory and confirmatory factor analyses. 
    more » « less
  3. Metacognition is widely acknowledged as a key soft skill in collaborative software development. The ability to plan, monitor, and reflect on cognitive and team processes is crucial to the efficient and effective functioning of a software team. To explore students' use of reflection--one aspect of metacognition--in undergraduate team software projects, we analyzed the online chat channels of teams participating in agile software development projects in two undergraduate courses that took place exclusively online (n = 23 teams, 117 students, and 4,915 chat messages). Teams' online chats were dominated by discussions of work completed and to be done; just two percent of all chat messages showed evidence of reflection. A follow-up analysis of chat vignettes centered around reflection messages (n = 63) indicates that three-fourths of the those messages were prompted by a course requirement; just 14\% arose organically within the context of teams' ongoing project work. Based on our findings, we identify opportunities for computing educators to increase, through pedagogical and technological interventions, teams' use of reflection in team software projects. 
    more » « less
  4. Engineering is fundamentally about design, yet many undergraduate programs offer limited opportunities for students to learn to design. This design case reports on a grant-funded effort to revolutionize how chemical engineering is taught. Prior to this effort, our chemical engineering program was like many, offering core courses primarily taught through lectures and problem sets. While some faculty referenced examples, students had few opportunities to construct and apply what they were learning. Spearheaded by a team that included the department chair, a learning scientist, a teaching-intensive faculty member, and faculty heavily engaged with the undergraduate program, we developed and implemented design challenges in core chemical engineering courses. We began by co-designing with students and faculty, initially focusing on the first two chemical engineering courses students take. We then developed templates and strategies that supported other faculty-student teams to expand the approach into more courses. Across seven years of data collection and iterative refinements, we developed a framework that offers guidance as we continue to support new faculty in threading design challenges through core content-focused courses. We share insights from our process that supported us in navigating through challenging questions and concerns. 
    more » « less
  5. Working in teams has been recognized as an essential 21st-century skill. Introducing teamwork in the undergraduate classroom is crucial as it allows the students to work with individuals with diverse skillsets and learn from one another. It is important to note that just creating a team and allowing the students to work does not foster teamwork skills. Inculcating teamwork skills requires a consciousness on the part of the instructor and the teaching assistants. Pedagogies such as cooperative learning have been recognized as effective in helping students develop teamwork skills. We introduced a joint reflection on action approach to developing teamwork skills among novice students as part of a sophomore-level systems analysis and design course. In this evidence-based practice paper, we report on students’ reflections regarding their perceptions of teamwork. This study approaches the following research questions: What are students' reflections about the role of communication while working in teams in a cooperative project-based learning environment? The guiding pedagogical framework for this course is cooperative learning. The course requires the students to work in teams in a semester-long software development project. To elicit reflection on action about their teamwork experience. Specifically, we exposed students to concrete experiences as part of their teamwork interactions, which became the basis for observations and reflections. For this, the semester-long project was complemented with one reflection-on-action activity. In the activity, students were asked to watch a video of secrets of successful teamwork and were asked to reflect on their perceptions about the role of communication within teams. The students’ reflections on the activity were analyzed using qualitative inductive thematic analysis to understand the students’ perceptions regarding teamwork and communication within teams. 
    more » « less