skip to main content


Title: Remote learning slightly decreased student performance in an introductory undergraduate course on climate change
Abstract

Public understanding about complex issues such as climate change relies heavily on online resources. Yet the role that online instruction should assume in post-secondary science education remains contentious despite its near ubiquity during the COVID-19 pandemic. The objective here was to compare the performance of 1790 undergraduates taking either an online or face-to-face version of an introductory course on climate change. Both versions were taught by a single instructor, thus, minimizing instructor bias. Women, seniors, English language learners, and humanities majors disproportionately chose to enroll in the online version because of its ease of scheduling and accessibility. After correcting for performance-gaps among different demographic groups, the COVID-19 pandemic had no significant effect on online student performance and students in the online version scored 2% lower (on a scale of 0–100) than those in the face-to-face version, a penalty that may be a reasonable tradeoff for the ease of scheduling and accessibility that these students desire.

 
more » « less
Award ID(s):
1655810 1904535
NSF-PAR ID:
10381859
Author(s) / Creator(s):
; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Communications Earth & Environment
Volume:
3
Issue:
1
ISSN:
2662-4435
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Student perceptions of the complete online transition of two CS courses in response to the COVID-19 pandemic Due to the COVID-19 pandemic, universities across the globe switched from traditional Face-to-Face (F2F) course delivery to completely online. Our university declared during our Spring break that students would not return to campus, and that all courses must be delivered fully online starting two weeks later. This was challenging to both students and instructors. In this evidence-based practice paper, we present results of end-of-semester student surveys from two Spring 2020 CS courses: a programming intensive CS2 course, and a senior theory course in Formal Languages and Automata (FLA). Students indicated course components they perceived as most beneficial to their learning, before and then after the online transition, and preferences for each regarding online vs. F2F. By comparing student reactions across courses, we gain insights on which components are easily adapted to online delivery, and which require further innovation. COVID was unfortunate, but gave a rare opportunity to compare students’ reflections on F2F instruction with online instructional materials for half a semester vs. entirely online delivery of the same course during the second half. The circumstances are unique, but we were able to acquire insights for future instruction. Some course components were perceived to be more useful either before or after the transition, and preferences were not the same in the two courses, possibly due to differences in the courses. Students in both courses found prerecorded asynchronous lectures significantly less useful than in-person lectures. For CS2, online office hours were significantly less useful than in-person office hours, but we found no significant difference in FLA. CS2 students felt less supported by their instructor after the online transition, but no significant difference was indicated by FLA students. FLA students found unproctored online exams offered through Canvas more stressful than in-person proctored exams, but the opposite was indicated by CS2 students. CS2 students indicated that visual materials from an eTextbook were more useful to them after going online than before, but FLA students indicated no significant difference. Overall, students in FLA significantly preferred the traditional F2F version of the course, while no significant difference was detected for CS2 students. We did not find significant effects from gender on the preference of one mode over the other. A serendipitous outcome was learning that some changes forced by circumstance should be considered for long term adoption. Offering online lab sessions and online exams where the questions are primarily multiple choice are possible candidates. However, we found that students need to feel the presence of their instructor to feel properly supported. To determine what course components need further improvement before transitioning to fully online mode, we computed a logistic regression model. The dependent variable is the student's preference for F2F or fully online. The independent variables are the course components before and after the online transition. For both courses, in-person lectures were a significant factor negatively affecting students' preferences of the fully online mode. Similarly, for CS2, in-person labs and in-person office hours were significant factors pushing students’ preferences toward F2F mode. 
    more » « less
  2. Most chemical engineering core classes are best taught when students are exposed to a face-to-face learning/teaching environment. With the arrival of coronavirus disease 2019 (COVID-19), the whole education system and the setting were disrupted at Hampton University (HU). Traditional in-person face-to-face classes were forced to move to remote instructions to maintain a healthy and safe campus environment and minimize the spread of COVID-19 on campus and in the community. As an instructor teaching core courses and unit operations laboratory in the Department of Chemical Engineering, it was challenging to move completely virtual and deliver instructions remotely without affecting students' learning outcomes. However, with the appropriate modern technologies and adapting to the students' change and needs, online teaching can be done efficiently and can still have efficient learning outcomes. Various activities were introduced to make the online/virtual class environment engaging in developing technical and professional skills and inducing learning for students. Using the latest educational tools and online resources, formative assessments were conducted throughout the course in an effort to improve student learning and instructor teaching. In addition to that, innovative ways of technology were also used to evaluate student learning and understanding of the material for grading and reporting purposes. Many of the modern educational tools, including Blackboard Collaborate Ultra, Ka-hoot, linoit, surveys, polls, and chemical engineering processes’ simulations and videos were in-troduced to make the synchronous sessions interactive. Likert-like surveys conducted were anal-yses to gauge the effectiveness of incorporation of technology during remote learning. This paper describes the innovative use of technologies to adapt to the COVID-19 pandemic in the Chemical Engineering Classes. It will also explain the strategies to assess the mode of delivery efficacy and how to change the course of teaching to adapt to the students' changing needs. 
    more » « less
  3. null (Ed.)
    Engineering instructors often use physical manipulatives such as foam beams, rolling cylinders, and large representations of axis systems to demonstrate mechanics concepts and help students visualize systems. Additional benefits are possible when manipulatives are in the hands of individual students or small teams of students who can explore concepts at their own pace and focus on their specific points of confusion. Online learning modalities require new strategies to promote spatial visualization and kinesthetic learning. Potential solutions include creating videos of the activities, using CAD models to demonstrate the principles, programming computer simulations, and providing hands-on manipulatives to students for at-home use. This Work-in-Progress paper discusses our experiences with this last strategy in statics courses two western community colleges and a western four-year university where we supplied students with their own hands-on kits. We have previously reported on the successful implementation of a hands-on statics kit consisting of 3D printed components and standard hardware. The kit was originally designed for use by teams of students during class to engage with topics such as vectors, moments, and rigid body equilibrium. With the onset of the COVID-19 pandemic and shift to online instruction, the first author developed a scaled down version of the kit for at-home use by individual students and modified the associated activity worksheets accordingly. For the community college courses, local students picked up their models at the campus bookstore. We also shipped some of the kits to students who were unable to come to campus, including some in other countries. Due to problems with printing and availability of materials, only 18 kits were available for the class of 34 students at the university implementation. Due to this circumstance, students were placed in teams and asked to work together virtually, one student showing the kit to the other student as they worked through the worksheet prompts. One community college instructor took this approach as well for a limited number of international students who did not receive their kits in a timely manner due to shipping problems. Two instructors assigned the hands-on kits as asynchronous learning activities in their respective online courses, with limited guidance on their use. The third used the kits primarily in synchronous online class meetings. We found that students’ reaction to the models varied by pilot site and presume that implementation differences contributed to this variation. In all cases, student feedback was less positive than it has been for face-to-face courses that used the models from which the take home kit was adapted. Our main conclusion is that implementation matters. Doing hands-on learning in an online course requires some fundamental rethinking about how the learning is structured and scaffolded. 
    more » « less
  4. null (Ed.)
    CONTEXT With the onset of the COVID-19 pandemic, and the resulting response from universities, engineering students find themselves in an unprecedented situation. In addition to stressors related to the curriculum, residential students across the United States are being asked to relocate away from campus and engage in distance learning. At the same time, social distancing requirements are limiting students’ ability to socialize, procure food and supplies, exercise, and remain employed and financially solvent. Some students will fall ill while others face the prospect of sick family members, and even deaths in the family. Prior research suggests that individuals living through this pandemic are likely to face stress, uncertainty, and fear that affects their mental health and academic performance for years to come. PURPOSE OR GOAL The purpose of this study was to understand the ways in which the COVID-19 pandemic is affecting engineering students’ mental wellness, specifically stress, and how the effects differ for different groups of students. The research questions addressed are: 1) What effects has the pandemic had on baseline stress levels, and how do those vary by demographic group? 2) What effects has the pandemic had on quality of life, such as sleep habits and financial security, and how do those vary by demographic group? METHODS An online survey was conducted in the United States in May and June of 2020. More than 800 4-year engineering students who represented many engineering disciplines and universities responded. The survey used a modified version of the Holmes-Rahe Social Readjustment Rating Scale, which is a widely used and validated instrument to measure the effects of certain life events on stress. The data was analysed to determine the average increase in stress levels for students resulting from COVID-19, and which demographic groups have seen the most negative impact. We also report on which stress-inducing life-events were experienced most. OUTCOMES Latinx individuals and international students report statistically significantly higher levels of stress than the baseline population. Engineering students from other historically excluded identities, however,are not facing statistically significantly worse stress than their peers from historically over represented identities. Veterans fare better than the majority population on this metric.The data also indicates that different groups are more likely to experience different negative life-events because of COVID. CONCLUSIONS No previous research has examined the impacts of a global pandemic on engineering student stress and mental wellness. Our findings show that stress and mental wellness need to be understood intersectionally and that some underrepresented groups are disproportionately impacted by COVID-19. Understanding the impacts on students can help universities strategize and allocate limited resources most effectively to support student success. KEYWORDS Mental wellness; COVID-19; stress 
    more » « less
  5. Field learning is fundamental in geoscience, but cost, accessibility, and other constraints limit equal access to these experiences. As technological advances afford ever more immersive and student-centered virtual field experiences, they are likely to have a growing role across geoscience education. They also serve as an important tool for providing high-quality online instruction, whether to fully online degree students, students in hybrid in-person/remote programs, or students experiencing disruptions to in-person learning, such as during the COVID-19 pandemic. This mixed-methods study compared learning outcomes of an in-person (ipFT) and a virtual (iVFT) geoscience field trip to Grand Canyon National Park, each of which highlighted the Great Unconformity. Participants included introductory and advanced geology students. In the ipFT, students collectively explored the Canyon through the interpretive Trail of Time along the Canyon rim, guided by the course instructor. In the iVFT, students individually explored the Canyon and studied its geology at river level. 360° spherical images anchor the iVFTs and serve as a framework for programmed overlays that enable active learning and allow for adaptive feedback. We assessed cognitive and affective outcomes in both trips using common measures. Regression analysis showed the iVFT to be associated with significantly greater learning gains. The ipFT students had significantly higher positive affect scores pre-trip, reflecting their excitement for the trip. Overall, our results provide clear evidence that high-quality iVFTs can lead to better learning gains than ipFTs. Although field trips are employed for more than just content learning, this finding may encourage greater use of iVFTs in coursework. 
    more » « less