skip to main content

This content will become publicly available on July 1, 2023

Title: Developing an Observation Protocol for Cooperative Learning
Use of structured roles to facilitate cooperative learning is an evidence-based practice that has been shown to improve student performance, attitude, and persistence. The combination of structured roles and activities also helps build students’ process skills including communication and metacognition. While these benefits have been shown in a variety of disciplines, most prior work has focused on in-person, synchronous settings, and few studies have looked at online, synchronous settings. With the ongoing COVID-19 pandemic, we need a better understanding of how cooperative learning takes place online and what differences may exist between online and in-person modalities. This work-in-progress serves to document our development of an observation protocol to help us answer research questions such as the following: Do group members participate equally? Do group members’ contributions match their role? How do groups connect and bond with each other? How do groups seek help?
Authors:
; ; ;
Award ID(s):
2121412
Publication Date:
NSF-PAR ID:
10379678
Journal Name:
American Society for Engineering Education Annual Conference & Exposition
Sponsoring Org:
National Science Foundation
More Like this
  1. Collaborative learning can improve student learning, student persistence, and the classroom climate. While work has documented the tradeoffs of face-to-face collaboration and asynchronous, online learning, the trade-offs between asynchronous (student-scheduled) and synchronous (instructor-scheduled) collaborative and online learning have not been explored. Structured roles can maximize the effectiveness of collaborative learning by helping all students participate, but structured roles have not been studied in online settings. We performed a quasi-experimental study in two courses—Computer Architecture and Numerical Methods—to compare the effects of asynchronous collaborative learning without structured roles to synchronous collaborative learning with structured roles. We use a data-analytics approach to examine how these approaches affected the student learning experience during formative collaborative learning assessments. Teams in the synchronous offering made higher scoring submissions (5-10% points better on average), finished assessments more efficiently (11-16 minutes faster on average), and had greater equality in the total number of submissions each student made (for example, significant increase of 13% in the mean equality score among all groups).
  2. Objective Over the past decade, we developed and studied a face-to-face video-based analysis-of-practice professional development (PD) model. In a cluster randomized trial, we found that the face-to-face model enhanced elementary science teacher knowledge and practice and resulted in important improvements to student science achievement (student treatment effect, d = 0.52; Taylor et al, 2017; Roth et al, 2018). The face-to-face PD model is expensive and difficult to scale. In this paper, we present the results of a two-year design-based research study to translate the face-to-face PD into a facilitated online PD experience. The purpose is to create an effective, flexible, and cost-efficient PD model that will reach a broader audience of teachers. Perspective/Theoretical Framework The face-to-face PD model is grounded in situated cognition and cognitive apprenticeship frameworks. Teachers engage in learning science content and effective science teaching practices in the context in which they will be teaching. There are scaffolded opportunities for teachers to learn from analysis of model videos by experienced teachers, to try teaching model units, to analyze video of their own teaching efforts, and ultimately to develop their own unit, with guidance. The PD model attends to the key features of effective PD as described by Desimonemore »(2009) and others. We adhered closely to the design principles of the face-to-face model as described by Authors, 2019. Methods We followed a design-based research approach (DBR; Cobb et al., 2003; Shavelson et al., 2003) to examine the online program components and how they promoted or interfered with the development of teachers’ knowledge and reflective practice. Of central interest was the examination of mechanisms for facilitating teacher learning (Confrey, 2006). To accomplish this goal, design researchers engaged in iterative cycles of problem analysis, design, implementation, examination, and redesign (Wang & Hannafin, 2005) in phase one of the project before studying its effect. Data Three small pilot groups of teachers engaged in both synchronous and asynchronous components of the larger online course which began implementation with a 10-week summer course that leads into study groups of participants meeting through one academic year. We iteratively designed, tested, and revised 17 modules across three pilot versions. On average, pilot groups completed one module every two weeks. Pilot 1 began the work in May 2019; Pilot 2 began in August 2019, and Pilot 3 began in October 2019. Pilot teachers responded to surveys and took part in interviews related to the PD. The PD facilitators took extensive notes after each iteration. The development team met weekly to discuss revisions. We revised all modules between each pilot group and used what we learned to inform our development of later modules within each pilot. For example, we applied what we learned from testing Module 3 with Pilot 1 to the development of Module 3 for Pilots 2, and also applied what we learned from Module 3 with Pilot 1 to the development of Module 7 for Pilot 1. Results We found that community building required the same incremental trust-building activities that occur in face-to-face PD. Teachers began with low-risk activities and gradually engaged in activities that required greater vulnerability (sharing a video of themselves teaching a model unit for analysis and critique by the group). We also identified how to contextualize technical tools with instructional prompts to allow teachers to productively interact with one another about science ideas asynchronously. As part of that effort, we crafted crux questions to surface teachers’ confusions or challenges related to content or pedagogy. We called them crux questions because they revealed teachers’ uncertainty and deepened learning during the discussion. Facilitators leveraged asynchronous responses to crux questions in the synchronous sessions to push teacher thinking further than would have otherwise been possible in a 2-hour synchronous video-conference. Significance Supporting teachers with effective, flexible, and cost-efficient PD is difficult under the best of circumstances. In the era of covid-19, online PD has taken on new urgency. NARST members will gain insight into the translation of an effective face-to-face PD model to an online environment.« less
  3. It has been well-established that concept-based active learning strategies increase student retention, improve engagement and student achievement, and reduce the performance gap of underrepresented students. Despite the evidence supporting concept-based instruction, many faculty continue to stress algorithmic problem solving. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. Our project aims to propagate the Concept Warehouse (CW), an online innovation tool that was developed in the Chemical Engineering community, into Mechanical Engineering (ME). A portion of our work focuses on content development in mechanics, and includes statics, dynamics, and to a lesser extent strength of materials. Our content development teams had created 170 statics and 253 dynamics questions. Additionally, we have developed four different simulations to be embedded in online Instructional Tools – these are interactive modules that provided different physical scenarios to help students understand important concepts in mechanics. During initial interviews, we found that potential adopters needed coaching on the benefits of concept-based instruction, training on how to use the CW, and support on how to best implement the different affordances offered bymore »the CW. This caused a slight shift in our initial research plans, and much of our recent work has concentrated on using faculty development activities to help us advertise the CW and encourage evidence-based practices. From these activities, we are recruiting participants for surveys and interviews to help us investigate how different contexts affect the adoption of educational innovations. A set of two summer workshops attracted over 270 applicants, and over 60 participants attended each synchronous offering. Other applicants were provided links to recordings of the workshop. From these participants, we recruited 20 participants to join our Community of Practice (CoP). These members are sharing how they use the CW in their classes, especially in the virtual environment. Community members discuss using evidence-based practices, different things that the CW can do, and suggest potential improvements to the tool. They will also be interviewed to help us determine barriers to adoption, how their institutional contexts and individual epistemologies affect adoption, and how they have used the CW in their classes. Our research will help us formulate strategies that others can use when attempting to propagate pedagogical innovations.« less
  4. Objective Over the past decade, we developed and studied a face-to-face video-based analysis-of-practice PD model. In a cluster randomized trial, we found that the face-to-face model enhanced elementary science teacher knowledge and practice, and resulted in important improvements to student science achievement (student treatment effect, d = 0.52; Taylor et al., 2017: Roth et al., 2018). The face-to-face PD model is expensive and difficult to scale. In this poster, we present the results of a two-year design-based research study to translate the face-to-face PD into a facilitated online PD experience. The purpose is to create an effective, flexible, and cost-efficient PD model that will reach a broader audience of teachers. Perspective/Theoretical Framework The face-to-face PD model is grounded in situated cognition and cognitive apprenticeship frameworks. Teachers engage in learning science content and practices in the context in which they will be teaching. In addition, there are scaffolded opportunities for teachers to learn from model videos by experienced teachers, try model units, and ultimately develop their own unit, with guidance. The PD model also attends to the key features of effective PD as described by Desimone (2009) and others. We adhered closely to the design principles of the face-to-face model asmore »described by Roth et al., 2018. Methods We followed a design-based research approach (DBR: Cobb et al., 2003: Shavelson et al., 2003) to examine the online program components and how they promoted or interfered with the development of teachers’ knowledge and reflective practice. Of central interest was the examination of mechanisms for facilitating teacher learning (Confrey, 2006). To accomplish this goal, design researchers engaged in iterative cycles of problem analysis, design, implementation, examination, and redesign (Wang & Hannafin, 2005). Data We iteratively designed, tested, and revised 17 modules across three pilot versions. Three small groups of teachers engaged in both synchronous and asynchronous components of the larger online course. They responded to surveys and took part in interviews related to the PD. The PD facilitators took extensive notes after each iteration. The development team met weekly to discuss revisions. Results We found that community building required the same incremental trust-building activities that occur in face-to-face PD. Teachers began with low-risk activities and gradually engaged in activities that required greater vulnerability (sharing a video of themselves teaching a model unit for analysis and critique by the group). We also identified how to contextualize technical tools with instructional prompts to allow teachers to productively interact with one another about science ideas asynchronously. As part of that effort, we crafted crux questions to surface teachers’ confusions or challenges related to content or pedagogy. Facilitators leveraged asynchronous responses to crux questions in the synchronous sessions to push teacher thinking further than would have otherwise been possible in a 2-hour synchronous video-conference. Significance Supporting teachers with effective, flexible, and cost-efficient PD is difficult under the best of circumstances. In the era of COVID-19, online PD has taken on new urgency. AERA members will gain insight into the construction of an online PD for elementary science teachers/ Full digital poster available at: https://aera21-aera.ipostersessions.com/default.aspx?s=64-5F-86-2E-15-F8-C3-C0-45-C6-A0-B7-1D-90-BE-46« less
  5. CONTEXT With the onset of the COVID-19 pandemic, and the resulting response from universities, engineering students find themselves in an unprecedented situation. In addition to stressors related to the curriculum, residential students across the United States are being asked to relocate away from campus and engage in distance learning. At the same time, social distancing requirements are limiting students’ ability to socialize, procure food and supplies, exercise, and remain employed and financially solvent. Some students will fall ill while others face the prospect of sick family members, and even deaths in the family. Prior research suggests that individuals living through this pandemic are likely to face stress, uncertainty, and fear that affects their mental health and academic performance for years to come. PURPOSE OR GOAL The purpose of this study was to understand the ways in which the COVID-19 pandemic is affecting engineering students’ mental wellness, specifically stress, and how the effects differ for different groups of students. The research questions addressed are: 1) What effects has the pandemic had on baseline stress levels, and how do those vary by demographic group? 2) What effects has the pandemic had on quality of life, such as sleep habits and financial security,more »and how do those vary by demographic group? METHODS An online survey was conducted in the United States in May and June of 2020. More than 800 4-year engineering students who represented many engineering disciplines and universities responded. The survey used a modified version of the Holmes-Rahe Social Readjustment Rating Scale, which is a widely used and validated instrument to measure the effects of certain life events on stress. The data was analysed to determine the average increase in stress levels for students resulting from COVID-19, and which demographic groups have seen the most negative impact. We also report on which stress-inducing life-events were experienced most. OUTCOMES Latinx individuals and international students report statistically significantly higher levels of stress than the baseline population. Engineering students from other historically excluded identities, however,are not facing statistically significantly worse stress than their peers from historically over represented identities. Veterans fare better than the majority population on this metric.The data also indicates that different groups are more likely to experience different negative life-events because of COVID. CONCLUSIONS No previous research has examined the impacts of a global pandemic on engineering student stress and mental wellness. Our findings show that stress and mental wellness need to be understood intersectionally and that some underrepresented groups are disproportionately impacted by COVID-19. Understanding the impacts on students can help universities strategize and allocate limited resources most effectively to support student success. KEYWORDS Mental wellness; COVID-19; stress« less