skip to main content


Title: Collaborative Reflection “in the flow” of Programming: Designing Effective Collaborative Learning Activities in Advanced Computer Science Contexts
Designing activities for maximizing collaborative learning in advanced computer science contexts is of broad interest. While programming exercises remain the dominant form of pedagogy here, prior work showed that collaborative reflection over worked examples is as good or even better for conceptual learning and future programming. This work used a “phased” design, with separate collaborative reflection and programming phases, and varied the time boundary between the two to determine their differential impact. A more effective design, however, could involve collaborative reflection prompted “in the flow” of programming, with benefits similar to self-explanation prompts interleaved into individual problem-solving. While total time-on-task is the same, this “interleaved” design might allow learners to spend a larger proportion of this time on reflection. Thus, this paper compares this novel interleaved approach to the phased design. We determine that interleaving increases the proportion of time available for reflection resulting in performance improvements on future programming.  more » « less
Award ID(s):
1917955 1822831
NSF-PAR ID:
10356434
Author(s) / Creator(s):
Editor(s):
Jun Oshima, Toshio Mochizuki
Date Published:
Journal Name:
General Proceedings of the 2nd Annual Meeting of the International Society of the Learning Sciences 2022
ISSN:
1573-4552
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Purpose In response to the evolving COVID-19 pandemic, many universities have transitioned to online instruction. With learning promising to be online, at least in part, for the near future, instructors may be thinking of providing online collaborative learning opportunities to their students who are increasingly isolated from their peers because of social distancing guidelines. This paper aims to provide design recommendations for online collaborative project-based learning exercises based on this research in a software engineering course at the university level. Design/methodology/approach Through joint work between learning scientists, course instructors and software engineering practitioners, instructional design best practices of alignment between the context of the learners, the learning objectives, the task and the assessment are actualized in the design of collaborative programming projects for supporting learning. The design, first segments a short real-time collaborative exercise into tasks, each with a problem-solving phase where students participate in collaborative programming, and a reflection phase for reflecting on what they learned in the task. Within these phases, a role-assignment paradigm scaffolds collaboration by assigning groups of four students to four complementary roles that rotate after each task. Findings By aligning each task with granular learning objectives, significant pre- to post-test learning from the exercise as well as each task is observed. Originality/value The roles used in the paradigm discourage divide-and-conquer tendencies often associated with collaborative projects. By requiring students to discuss conflicting ideas to arrive at a consensus implementation, their ideas are made explicit, thus providing opportunities for clarifying misconceptions through discussion and learning from the collaboration. 
    more » « less
  2. Computer science pedagogy, especially in the higher education and vocational training context, has long-favored the hands-on practice provided by programming tasks due to the belief that this leads to better performance on hands-on tasks at work. This assumption, however, has not been experimentally tested against other modes of engagement such as worked example-based reflection. While theory suggests that example-based reflection could be better for conceptual learning, the concern is that the lack of practice will leave students unable to implement the learned concepts in practice, thus leaving them unprepared for work. In this paper, therefore, we experimentally contrast programming practice with example-based reflection to observe their differential impact on conceptual learning and performance on a hands-on task in the context of a collaborative programming project. The industry paradigm of Mob Programming, adapted for use in an online and instructional context, is used to structure the collaboration. Keeping with the prevailing view held in pedagogy, we hypothesize that example-based reflection will lead to better conceptual learning but will be detrimental to hands-on task performance. Results support that reflection leads to conceptual learning. Additionally, however, reflection does not pose an impediment to hands-on task performance. We discuss possible explanations for this effect, thus providing an improved understanding of prior theory in this new computer science education context. We also discuss implications for the pedagogy of software engineering education, in light of this new evidence, that impacts student learning as well as work performance in the future. 
    more » « less
  3. Given the infancy of engineering education as an established field and the recent increase in early career faculty aligning themselves with the discipline, it is imperative that the community better understand the experiences of these new faculty members. As a result, we will be able to enhance national efforts to train and develop faculty prepared to drive change in engineering education. Accordingly, this two-phased study will investigate how institutional context influences the agency of our research team and other early career engineering education faculty as it relates to facilitating change in engineering education. Faculty agency is important because faculty play a central role in making change, and there is a need to further understand the factors that influence their ability to do so. This work leverages collaborative inquiry and collaborative autoethnography to explore the lived experiences of our research team, which consists of six engineering education faculty with different roles and responsibilities who are positioned in varied settings at different institutions. We represent diverse perspectives with regard to our goals, visions, and training in engineering education. This project officially started in May 2017; however, we have been collecting data since August 2015. Our poster will present a summary of our current progress, which includes the use of the Q3 Research Quality Workshop to guide our plans for data collection and analysis. This was important to our work, because in Phase I of our study we are combining elements from auto ethnography and collaborative inquiry to explore our research questions. In addition to our study’s methodological impact, the results will provide the engineering education community with evidence-based insights on conditions that facilitate change efforts by early career engineering education faculty. By sharing our findings with current and developing engineering education graduate programs, we will enable them to make programmatic changes to benefit future faculty. These findings also provide a mechanism for divisions within the American Society of Engineering Education to develop programming and resources to support the sustained success of their members. 
    more » « less
  4. Given the infancy of engineering education as an established field and the recent increase in early career faculty aligning themselves with the discipline, it is imperative that the community better understand the experiences of these new faculty members. As a result, we will be able to enhance national efforts to train and develop faculty prepared to drive change in engineering education. Accordingly, this two-phased study will investigate how institutional context influences the agency of our research team and other early career engineering education faculty as it relates to facilitating change in engineering education. Faculty agency is important because faculty play a central role in making change, and there is a need to further understand the factors that influence their ability to do so. This work leverages collaborative inquiry and collaborative autoethnography to explore the lived experiences of our research team, which consists of six engineering education faculty with different roles and responsibilities who are positioned in varied settings at different institutions. We represent diverse perspectives with regard to our goals, visions, and training in engineering education. This project officially started in May 2017; however, we have been collecting data since August 2015. Our poster will present a summary of our current progress, which includes the use of the Q3 Research Quality Workshop to guide our plans for data collection and analysis. This was important to our work, because in Phase I of our study we are combining elements from auto ethnography and collaborative inquiry to explore our research questions. In addition to our study’s methodological impact, the results will provide the engineering education community with evidence-based insights on conditions that facilitate change efforts by early career engineering education faculty. By sharing our findings with current and developing engineering education graduate programs, we will enable them to make programmatic changes to benefit future faculty. These findings also provide a mechanism for divisions within the American Society of Engineering Education to develop programming and resources to support the sustained success of their members. 
    more » « less
  5. Given the infancy of engineering education as an established field and the recent increase in early career faculty aligning themselves with the discipline, it is imperative that the community better understand the experiences of these new faculty members. As a result, we will be able to enhance national efforts to train and develop faculty prepared to drive change in engineering education. Accordingly, this two-phased study investigates how institutional context influences the agency of our research team and other early career engineering education faculty as it relates to facilitating change in engineering education. Faculty play a central role in making change, thus there is a need to further understand the factors that influence their ability to do so. This work leverages collaborative inquiry and collaborative autoethnography to explore the lived experiences of our research team, which consists of six engineering education faculty who have different roles and responsibilities and are positioned in varied settings at diverse institutions. We represent a variety of perspectives with regard to our goals, visions, and training in engineering education. This project officially started in May 2017; however, we began collecting data in August 2015. Our poster will present a summary of our current progress, which includes the use of the Q3 Research Quality workshop to guide data collection and analysis. In addition to the methodological impact of our study, the results will provide the engineering education community with evidence-based insights on conditions that facilitate change efforts by early career engineering education faculty. By sharing our findings with current and developing engineering education graduate programs, we will enable them to make programmatic changes to benefit future faculty. These findings also will provide a mechanism for divisions of the American Society of Engineering Education (ASEE) to develop programming and resources to support the sustained success of their members. 
    more » « less