skip to main content


Title: Designing Interactive Scaffolds to Encourage Reflection on Peer Feedback
Feedback is a key element of project-based learning, but only if students reflect on and learn from the feedback they receive. Students often struggle to deeply engage with feedback, whether due to lack of confidence, time, or skill. This work seeks to identify challenges that make reflecting on feedback difficult for students, and to design possible solutions for supporting reflection. Through observing two university game design courses, our research found that without concrete reflection strategies, students tended to be attracted to feedback that looks useful, but does not necessarily them move forward. When we introduced three different reflection scaffolds to support students, we found that the most effective approach promoted interactive learning by allowing time for self-reflection before team reflection, offering time limits, providing activities for feedback prioritization, helping teams align their goals, and equalizing team member participation. We present design guidelines for future systems to support reflection on feedback.  more » « less
Award ID(s):
1821590 1821618
NSF-PAR ID:
10205832
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Designing Interactive Systems
Page Range / eLocation ID:
1143 to 1153
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We present a course design model for applying project-based learning to an online undergraduate object oriented systems course. In our model, projects and reflection are central to the curriculum. Our model challenges students through modularized, repetitive project cycles beginning with analysis and design (i.e. using pseudo- code, flowcharts, diagrams) then coding, debugging, testing, and finally, reflection. We analyzed student reflection responses from two semesters to extract major themes and sub-themes, then mapped these to the MUSIC model (eMpowerment, Usefulness, Success, Interest, Caring) to understand our model's influence on student engagement and motivation. We found that a rhythmic project cycle encourages self-regulation in online students to formulate project plans, track their progress, and evaluate their solutions. Online students feel empowered when course projects promote choice, flexibility, creativity, experimentation, and extensions to other applications. Online student success is dependent on the clarity of instructions, course scaffolding, level of challenge, instructor feedback, and opportunities to reflect on personal failure, success, and challenge. Online students are interested in projects that are familiar, real-world, and fun, but expect to be situated in team-based environments. Students appreciate instructors who are caring and accommodating to personal needs. We recommend six salient strategies for improving online course and project design: design a visible, rhythmic structure; set transparent expectations and instructions; encourage design before implementation; connect to real-world applications and tools; experience happy challenges; infuse sustained reflection. 
    more » « less
  2. The creation of high-quality curricular materials requires knowledge of curriculum design and a considerable time commitment. Instructors often have limited time to dedicate to the creation of curricular materials. Additionally, the knowledge and skills needed to develop high-quality materials are often not taught to instructors. Furthermore, similar learning material is often prepared by multiple instructors working at separate institutions, leading to unnecessary duplication of effort and inefficiency that can impact quality. To address these problems, we established the HydroLearn platform and associated professional learning experiences for hydrology and water resources instructors. HydroLearn is an online platform for developing and sharing high-quality curricular materials, or learning modules, focused on hydrology and water resources. The HydroLearn team has worked with three cohorts of instructors from around the world who were dedicated to creating high-quality curricular materials to support both their students and the broader community. In order to overcome some of the aforementioned barriers, we tested and revised several different models of professional learning with these cohorts. These models ranged from (a) instructors working individually with periodic guidance from the HydroLearn team, to (b) small groups of instructors collaborating on topics of shared interests guided through an intensive HydroLearn training workshop. We found the following factors to contribute to the success of instructors in creating modules: (1) instructor pairs co-creating modules enhanced the usability and transferability of modules between universities and courses, (2) dedicating an intensive block of time (∼63 h over 9 days) to both learning about and implementing curriculum design principles, (3) implementing structures for continuous feedback throughout that time, (4) designing modules for use in one’s own course, and (5) instituting a peer-review process to refine modules. A comprehensive set of learning modules were produced covering a wide range of topics that target undergraduate and early graduate students, such as: floodplain analysis, hydrologic droughts, remote sensing applications in hydrology, urbanization and stormwater runoff, evapotranspiration, snow and climate, groundwater flow, saltwater intrusion in coastal regions, and stream solute tracers. We share specifics regarding how we structured the professional learning models, as well as lessons learned and challenges faced. 
    more » « less
  3. Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction. 
    more » « less
  4. A 2019 report from the National Academies on Minority Serving Institutions (MSIs) concluded that MSIs need to change their culture to successfully serve students with marginalized racial and/or ethnic identities. The report recommends institutional responsiveness to meet students “where they are,” metaphorically, creating supportive campus environments and providing tailored academic and social support structures. In recent years, the faculty, staff, and administrators at California State University, Los Angeles have made significant efforts to enhance student success through multiple initiatives including a summer bridge program, first-year in engineering program, etc. However, it has become clear that more profound changes are needed to create a culture that meets students “where they are.” In 2020, we were awarded NSF support for Eco-STEM, an initiative designed to change a system that demands "college-ready" students into one that is "student-ready." Aimed at shifting the deficit mindset prevailing in engineering education, the Eco-STEM project embraces an asset-based ecosystem model that thinks of education as cultivation, and ideas as seeds we are planting, rather than a system of standards and quality checks. This significant paradigm and culture transformation is accomplished through: 1) The Eco-STEM Faculty Fellows’ Community of Practice (CoP), which employs critically reflective dialogue[ ][ ] to enhance the learning environment using asset-based learner-centered instructional approaches; 2) A Leadership CoP with department chairs and program directors that guides cultural change at the department/program level; 3) A Facilitators’ CoP that prepares facilitators to lead, sustain, update, and expand the Faculty and Leadership CoPs; 4) Reform of the teaching evaluation system to sustain the cultural changes. This paper presents the progress and preliminary findings of the Eco-STEM project. During the first project year, the project team formulated the curriculum for the Faculty CoP with a focus on inclusive pedagogy, community cultural wealth, and community building, developed a classroom peer observation tool to provide formative data for teaching reflection, and designed research inquiry tools. The latter investigates the following research questions: 1) To what extent do the Eco-STEM CoPs effectively shift the mental models of participants from a factory-like model to an ecosystem model of education? 2) To what extent does this shift support an emphasis on the assets of our students, faculty, and staff members and, in turn, allow for enhanced motivation, excellence and success? 3) To what extent do new faculty assessment tools designed to provide feedback that reflects ecosystem-centric principles and values allow for individuals within the system to thrive? In Fall 2021, the first cohort of Eco-STEM Faculty Fellows were recruited, and rich conversations and in-depth reflections in our CoP meetings indicated Fellows’ positive responses to both the CoP curriculum and facilitation practices. This paper offers a work-in-progress introduction to the Eco-STEM project, including the Faculty CoP, the classroom peer observation tool, and the proposed research instruments. We hope this work will cultivate broader conversations within the engineering education research community about cultural change in engineering education and methods towards its implementation. 
    more » « less
  5. null (Ed.)
    Many university engineering programs require their students to complete a senior capstone experience to equip them with the knowledge and skills they need to succeed after graduation. Such capstone experiences typically integrate knowledge and skills learned cumulatively in the degree program, often engaging students in projects outside of the classroom. As part of an initiative to completely transform the civil engineering undergraduate program at Clemson University, a capstone-like course sequence is being incorporated into the curriculum during the sophomore year. Funded by a grant from the National Science Foundation’s Revolutionizing Engineering Departments (RED) program, this departmental transformation (referred to as the Arch initiative) is aiming to develop a culture of adaptation and a curriculum support for inclusive excellence and innovation to address the complex challenges faced by our society. Just as springers serve as the foundation stones of an arch, the new courses are called “Springers” because they serve as the foundations of the transformed curriculum. The goal of the Springer course sequence is to expose students to the “big picture” of civil engineering while developing student skills in professionalism, communication, and teamwork through real-world projects and hands-on activities. The expectation is that the Springer course sequence will allow faculty to better engage students at the beginning of their studies and help them understand how future courses contribute to the overall learning outcomes of a degree in civil engineering. The Springer course sequence is team-taught by faculty from both civil engineering and communication, and exposes students to all of the civil engineering subdisciplines. Through a project-based learning approach, Springer courses mimic capstone in that students work on a practical application of civil engineering concepts throughout the semester in a way that challenges students to incorporate tools that they will build on and use during their junior and senior years. In the 2019 spring semester, a pilot of the first of the Springer courses (Springer 1; n=11) introduced students to three civil engineering subdisciplines: construction management, hydrology, and transportation. The remaining subdisciplines will be covered in a follow-on Springer 2 pilot.. The project for Springer 1 involved designing a small parking lot for a church located adjacent to campus. Following initial instruction in civil engineering topics related to the project, students worked in teams to develop conceptual project designs. A design charrette allowed students to interact with different stakeholders to assess their conceptual designs and incorporate stakeholder input into their final designs. The purpose of this paper is to describe all aspects of the Springer 1 course, including course content, teaching methods, faculty resources, and the design and results of a Student Assessment of Learning Gains (SALG) survey to assess students’ learning outcomes. An overview of the Springer 2 course is also provided. The feedback from the SALG indicated positive attitudes towards course activities and content, and that students found interaction with project stakeholders during the design charrette especially beneficial. Challenges for full scale implementation of the Springer course sequence as a requirement in the transformed curriculum are also discussed. 
    more » « less