skip to main content

Attention:

The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 11:00 PM ET on Thursday, October 10 until 2:00 AM ET on Friday, October 11 due to maintenance. We apologize for the inconvenience.


Title: Designing Interactive Scaffolds to Encourage Reflection on Peer Feedback
Feedback is a key element of project-based learning, but only if students reflect on and learn from the feedback they receive. Students often struggle to deeply engage with feedback, whether due to lack of confidence, time, or skill. This work seeks to identify challenges that make reflecting on feedback difficult for students, and to design possible solutions for supporting reflection. Through observing two university game design courses, our research found that without concrete reflection strategies, students tended to be attracted to feedback that looks useful, but does not necessarily them move forward. When we introduced three different reflection scaffolds to support students, we found that the most effective approach promoted interactive learning by allowing time for self-reflection before team reflection, offering time limits, providing activities for feedback prioritization, helping teams align their goals, and equalizing team member participation. We present design guidelines for future systems to support reflection on feedback.  more » « less
Award ID(s):
1821590 1821618
NSF-PAR ID:
10205832
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Designing Interactive Systems
Page Range / eLocation ID:
1143 to 1153
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We present a course design model for applying project-based learning to an online undergraduate object oriented systems course. In our model, projects and reflection are central to the curriculum. Our model challenges students through modularized, repetitive project cycles beginning with analysis and design (i.e. using pseudo- code, flowcharts, diagrams) then coding, debugging, testing, and finally, reflection. We analyzed student reflection responses from two semesters to extract major themes and sub-themes, then mapped these to the MUSIC model (eMpowerment, Usefulness, Success, Interest, Caring) to understand our model's influence on student engagement and motivation. We found that a rhythmic project cycle encourages self-regulation in online students to formulate project plans, track their progress, and evaluate their solutions. Online students feel empowered when course projects promote choice, flexibility, creativity, experimentation, and extensions to other applications. Online student success is dependent on the clarity of instructions, course scaffolding, level of challenge, instructor feedback, and opportunities to reflect on personal failure, success, and challenge. Online students are interested in projects that are familiar, real-world, and fun, but expect to be situated in team-based environments. Students appreciate instructors who are caring and accommodating to personal needs. We recommend six salient strategies for improving online course and project design: design a visible, rhythmic structure; set transparent expectations and instructions; encourage design before implementation; connect to real-world applications and tools; experience happy challenges; infuse sustained reflection. 
    more » « less
  2. Hoadley, C ; Wang, XC (Ed.)
    In this paper, we present a case study of designing AI-human partnerships in a realworld context of science classrooms. We designed a classroom environment where AI technologies, teachers and peers worked synergistically to support students’ writing in science. In addition to an NLP algorithm to automatically assess students’ essays, we also designed (i) feedback that was easier for students to understand; (ii) participatory structures in the classroom focusing on reflection, peer review and discussion, and (iii) scaffolding by teachers to help students understand the feedback. Our results showed that students improved their written explanations, after receiving feedback and engaging in reflection activities. Our case study illustrates that Augmented Intelligence (USDoE, 2023), in which the strengths of AI complement the strengths of teachers and peers, while also overcoming the limitations of each, can provide multiple forms of support to foster learning and teaching. 
    more » « less
  3. Olney, AM ; Chounta, IA ; Liu, Z ; Santos, OC ; Bittencourt, II (Ed.)
    An advantage of Large Language Models (LLMs) is their contextualization capability – providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard feedback. We present a design and evaluation of a proof-of-concept LLM application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT, which offers students contextualized reflection triggers during a collaborative query optimization task in database design. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context. We discuss in depth the exploration of the design space of the triggers and their correspondence with the learning objectives as well as the impact on student learning in a pilot study with 34 students. 
    more » « less
  4. Reflection and reflection activities are potentially valuable components of the instructional experiences educators design in order to support student learning. Published scholarship contains many allusions to students having reactions to reflection activities, but the nature of these reactions are rarely engaged in depth. In this work, we focus on four complications we have encountered while developing a survey to explore student reactions to reflection activities: complex reactions within a single student, complex patterns of reactions between students, students being differentially aware of their reactions to reflection, and students experiencing the reaction survey as a reflection activity itself. Additionally, we discuss potential implications of these complications for educators and researchers. 
    more » « less
  5. This research paper investigates the effectiveness of cooperative learning and co-regulation strategies in promoting teamwork and enhancing students' performance in higher education. The study was conducted in an in-person intermediate-level information system design course with 152 students divided into 31 teams. The students utilized the Scrum framework to manage a semester-long project with three milestones. Retrospective data were collected at the end of each milestone, and the first milestone data were analyzed in this study. Through a thematic analysis of retrospective data collected after the first milestone, the study examines students' planning, monitoring, and reflection strategies. The findings reveal that students demonstrated adaptive planning, equitable contribution, and task allocation based on individual strengths and preferences. In terms of monitoring, students adopted a proactive approach, displayed relational competence, and utilized both synchronous and asynchronous communication channels. Regarding reflection, students valued effective planning and execution but struggled with time management. They developed concrete improvement strategies for the next milestone, emphasizing realistic deadlines, improved communication, and a better understanding of team members' strengths. This research contributes to the understanding of cooperative learning and co-regulation in promoting effective teamwork in higher education. The findings have implications for pedagogical practices and suggest the importance of integrating cooperative learning and co-regulation strategies in team-based learning environments. Future research can further explore the application of these strategies in different educational contexts and investigate their long-term effects on students' performance and engagement. 
    more » « less