skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Designing Interactive Scaffolds to Encourage Reflection on Peer Feedback
Feedback is a key element of project-based learning, but only if students reflect on and learn from the feedback they receive. Students often struggle to deeply engage with feedback, whether due to lack of confidence, time, or skill. This work seeks to identify challenges that make reflecting on feedback difficult for students, and to design possible solutions for supporting reflection. Through observing two university game design courses, our research found that without concrete reflection strategies, students tended to be attracted to feedback that looks useful, but does not necessarily them move forward. When we introduced three different reflection scaffolds to support students, we found that the most effective approach promoted interactive learning by allowing time for self-reflection before team reflection, offering time limits, providing activities for feedback prioritization, helping teams align their goals, and equalizing team member participation. We present design guidelines for future systems to support reflection on feedback.  more » « less
Award ID(s):
1821590 1821618
PAR ID:
10205832
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Designing Interactive Systems
Page Range / eLocation ID:
1143 to 1153
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science Education)
    We present a course design model for applying project-based learning to an online undergraduate object oriented systems course. In our model, projects and reflection are central to the curriculum. Our model challenges students through modularized, repetitive project cycles beginning with analysis and design (i.e. using pseudo- code, flowcharts, diagrams) then coding, debugging, testing, and finally, reflection. We analyzed student reflection responses from two semesters to extract major themes and sub-themes, then mapped these to the MUSIC model (eMpowerment, Usefulness, Success, Interest, Caring) to understand our model's influence on student engagement and motivation. We found that a rhythmic project cycle encourages self-regulation in online students to formulate project plans, track their progress, and evaluate their solutions. Online students feel empowered when course projects promote choice, flexibility, creativity, experimentation, and extensions to other applications. Online student success is dependent on the clarity of instructions, course scaffolding, level of challenge, instructor feedback, and opportunities to reflect on personal failure, success, and challenge. Online students are interested in projects that are familiar, real-world, and fun, but expect to be situated in team-based environments. Students appreciate instructors who are caring and accommodating to personal needs. We recommend six salient strategies for improving online course and project design: design a visible, rhythmic structure; set transparent expectations and instructions; encourage design before implementation; connect to real-world applications and tools; experience happy challenges; infuse sustained reflection. 
    more » « less
  2. ; ; ; (, Cognition, Technology & Work)
    Abstract Considering the criticality of post-simulation debriefings for skill development, more evidence is needed to establish how specific feedback design features might influence teams’ cognitive and metacognitive processing. The current research therefore investigates the effects of multisource feedback (MSF) and guided facilitation with video review, for both cognitive processing and reflective (meta-cognitive) behaviors during post-simulation debriefings. With a sample of 174 s-year dental students, randomly assigned to 20 teams, the authors conducted high-fidelity simulations of patient emergencies, followed by post-simulation debriefings, using a 2 × 2 factorial design to test the effects of MSF (present vs. absent) and guided facilitation with video review (present vs. absent). According to an ordered network analysis, designed to examine feedback processing levels (individual vs. team) and depth (high vs. low), as well as the presence of metacognitive reflective behaviors (evaluative behaviors, exploration of alternatives, decision-oriented behaviors), teams that received both MSF and guided facilitation demonstrated significantly deeper, team-level processing and more frequent evaluative behaviors. Teams that received only guided facilitation exhibited the highest rates of low-level, individual processing. However, facilitation also produced an additive effect that fostered reflection and a shift from individual- to team-oriented processing. In contrast, MSF alone produced the lowest levels of evaluative behaviors; without facilitation, it does not support team reflection. These results establish that combining MSF with guided facilitation and video review creates synergistic effects for team reflection. Even if MSF can highlight perceived performance discrepancies, teams need facilitation to interpret and learn collaboratively from the feedback. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, OSF_preprints_EdArXiv)
    Prior research has found that teacher reflection is important for both teachers’ professional development and students’ learning, but frequent, effective reflection faces many obstacles. Could an analytics-based reflection tool help address these barriers? Reflecto is a novel teacher-facing tool designed to support teachers in reflecting (after-the-fact) on their classroom practices during sessions when students are engaged with intelligent tutoring systems. Whereas many teacher analytics tools support real-time decision-making in class, Reflecto aims to promote teacher agency through out-of-class teacher-initiated, data-driven exploration of possible trends in their classroom practice. Unlike many other analytics tools, it combines learning analytics and teaching analytics. 
    more » « less
  4. ; ; ; (, Proceedings of the 4th Annual Meeting of the International Society of the Learning Sciences 2024)
    Hoadley, C; Wang, XC (Ed.)
    In this paper, we present a case study of designing AI-human partnerships in a realworld context of science classrooms. We designed a classroom environment where AI technologies, teachers and peers worked synergistically to support students’ writing in science. In addition to an NLP algorithm to automatically assess students’ essays, we also designed (i) feedback that was easier for students to understand; (ii) participatory structures in the classroom focusing on reflection, peer review and discussion, and (iii) scaffolding by teachers to help students understand the feedback. Our results showed that students improved their written explanations, after receiving feedback and engaging in reflection activities. Our case study illustrates that Augmented Intelligence (USDoE, 2023), in which the strengths of AI complement the strengths of teachers and peers, while also overcoming the limitations of each, can provide multiple forms of support to foster learning and teaching. 
    more » « less
  5. ; ; ; (, IEEE)
    This research paper investigates the effectiveness of cooperative learning and co-regulation strategies in promoting teamwork and enhancing students' performance in higher education. The study was conducted in an in-person intermediate-level information system design course with 152 students divided into 31 teams. The students utilized the Scrum framework to manage a semester-long project with three milestones. Retrospective data were collected at the end of each milestone, and the first milestone data were analyzed in this study. Through a thematic analysis of retrospective data collected after the first milestone, the study examines students' planning, monitoring, and reflection strategies. The findings reveal that students demonstrated adaptive planning, equitable contribution, and task allocation based on individual strengths and preferences. In terms of monitoring, students adopted a proactive approach, displayed relational competence, and utilized both synchronous and asynchronous communication channels. Regarding reflection, students valued effective planning and execution but struggled with time management. They developed concrete improvement strategies for the next milestone, emphasizing realistic deadlines, improved communication, and a better understanding of team members' strengths. This research contributes to the understanding of cooperative learning and co-regulation in promoting effective teamwork in higher education. The findings have implications for pedagogical practices and suggest the importance of integrating cooperative learning and co-regulation strategies in team-based learning environments. Future research can further explore the application of these strategies in different educational contexts and investigate their long-term effects on students' performance and engagement. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email