This research evaluates the impact of switching college engineering courses from in-person instruction to emergency remote learning among engineering students at a university in the Midwest. The study aimed to answer the question: What were the concerns and perceived challenges students faced when traditional in-person engineering courses suddenly transitioned to remote learning? The goal of this study is to uncover the challenges students were facing in engineering online courses and to understand students’ concerns. Our findings can help improve teaching instruction to provide students with previously unavailable educational assistance for online engineering courses.
We collected online survey responses during weeks 8 and 9 of the academic semester, shortly after the COVID-19 shutdown and emergency transition to remote learning in Spring 2020. The survey included two open-ended questions which inquired about students’ feedback about moving the class online, and one two-item scale which assessed students’ confidence in online engineering learning. Data analysis for the open-ended questions was guided by the theoretical framework - Social Cognitive Career Theory [1] that explores how context, person factors and social cognitions contribute to career goals, interests and actions. A phenomenological approach [2] was conducted to understand the experience of these students. Open coding and axial coding [2] methods were used to create initial categories then themes related to students' concerns and challenges. Data from the two-item scale was evaluated using descriptive statistics: means, standard deviations, and ranges.
Four main themes with separate sub-categories emerged from the student responses: 1) Instructor’s ability to teach course online (Instructional limitations, Seeking help, Increased Workload), 2) Student’s ability to learn online (Time Management, Lower engagement and motivation, Harder to absorb material, Hard to focus, Worry about performance), 3) Difficulties outside of class (Technology issues), and 4) No concerns. Students seemed more concerned about their ability to learn the material (48% of responses) than the instructor’s ability to teach the material (36% of responses). The instructional limitations or lack of instructional support (22% of responses) and time management (12% of responses) were among the major concerns in the sub-categories.
The results from two-item scale indicated participants' s confidence in their ability to master their classroom knowledge was at an intermediate level via online instruction (6/10), and participants' confidence in the instructor's ability to teach knowledge in online classes is moderate to high (7/10). The results align with the open-ended question response in which students were somewhat more concerned about their ability to learn than the instructor’s ability to teach. The themes and analysis will be a valuable tool to help institutions and instructors improve student learning experiences.
more »
« less
Surfacing Equity Issues in Large Computing Courses with Peer-Ranked, Demographically-Labeled Student Feedback
As computing courses become larger, students of minoritized groups continue to disproportionately face challenges that hinder their academic and professional success (e.g. implicit bias, microaggressions, lack of resources, assumptions of preparatory privilege). This can impact career aspirations and sense of belonging in computing communities. Instructors have the power to make immediate changes to support more equitable learning, but they are often unaware of students' challenges. To help both instructors and students understand the inequities in their classes, we developed StudentAmp, an interactive system that uses student feedback and self-reported demographic information (e.g. gender, ethnicity, disability, educational background) to show challenges and how they affect students differently. To help instructors make sense of feedback, StudentAmp ranks challenges by student-perceived disruptiveness. We conducted formative evaluations with five large college computing courses (150 - 750 students) being taught remotely during the COVID-19 pandemic. We found that students shared challenges beyond the scope of the course, perceived sharing information about who they were as useful but potentially dangerous, and that teaching teams were able to use this information to consider the positionality of students sharing challenges. Our findings relate to a central design tension of supporting equity by sharing contextualized information about students while also ensuring their privacy and well-being.
more »
« less
- NSF-PAR ID:
- 10349243
- Date Published:
- Journal Name:
- Proceedings of the ACM on Human-Computer Interaction
- Volume:
- 6
- Issue:
- CSCW1
- ISSN:
- 2573-0142
- Page Range / eLocation ID:
- 1 to 39
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction.more » « less
-
more » « less
Abstract Background The first day of class helps students learn about what to expect from their instructors and courses. Messaging used by instructors, which varies in content and approach on the first day, shapes classroom social dynamics and can affect subsequent learning in a course. Prior work established the non-content Instructor Talk Framework to describe the language that instructors use to create learning environments, but little is known about the extent to which students detect those messages. In this study, we paired first day classroom observation data with results from student surveys to measure how readily students in introductory STEM courses detect non-content Instructor Talk.
Results To learn more about the instructor and student first day experiences, we studied 11 introductory STEM courses at two different institutions. The classroom observation data were used to characterize course structure and use of non-content Instructor Talk. The data revealed that all instructors spent time discussing their instructional practices, building instructor/student relationships, and sharing strategies for success with their students. After class, we surveyed students about the messages their instructors shared during the first day of class and determined that the majority of students from within each course detected messaging that occurred at a higher frequency. For lower frequency messaging, we identified nuances in what students detected that may help instructors as they plan their first day of class.
Conclusions For instructors who dedicate the first day of class to establishing positive learning environments, these findings provide support that students are detecting the messages. Additionally, this study highlights the importance of instructors prioritizing the messages they deem most important and giving them adequate attention to more effectively reach students. Setting a positive classroom environment on the first day may lead to long-term impacts on student motivation and course retention. These outcomes are relevant for all students, but in particular for students in introductory STEM courses which are often critical prerequisites for being in a major.
-
An enormous reserve of information about the subglacial bedrock, tectonic and topographic evolution of Marie Byrd Land (MBL) exists within glaciomarine sediments of the Amundsen Sea shelf, slope and deep sea, and MBL marine shelf. Investigators of the NSF ICI-Hot and NSF Linchpin projects partnered with Arizona Laserchron Center to provide course-based undergraduate research experiences (CUREs) for from groups who do not ordinarily find access points to Antarctic science. Our courses enlist BIPOC and gender-expansive undergraduates in studies of ice-rafted debris (IRD) and bedrock samples, in order to impart skills, train in the use of research instrumentation, help students to develop confidence in their scientific abilities, and collaboratively address WAIS research questions at an early academic stage. CUREs afford benefits to graduate researchers and postdoctoral scientists, also, who join in as instructional faculty: CUREs allow GRs and PDs to engage in teaching that closely ties to their active research, yet provides practical experience to strengthen the academic portfolio (Cascella & Jez, 2018). Team members also develop art-science initiatives that engage students and community members who may not ordinarily engage with science, forging connections that make science relatable. Re-casting science topics through art centers personal connections and humanizes science, to promote understanding that goes beyond the purely analytical. Academic research shows that diverse undergraduates gain markedly from the convergence of art and science, and from involvement in collaborative research conducted within a CURE cohort, rather than as an individualized experience (e.g. Shanahan et al. 2022). The CUREs are offered as regular courses for credit, making access equitable via course enrollment. The course designation carries a legitimacy that is sought by students who balance academics with part-time employment. Course information is disseminated via STEM Bridge programs and/or an academic advising hub that reaches students from groups that are insufficiently represented within STEM and cryosphere science. CURE investigation of Amundsen Sea and WAIS problems is worthy objective because: 1) A variety of sample preparation, geochemical methods, and scientific best-practices can be imparted, while educating students about Antarctica’s geological configuration and role in the Earth climate system. 2) Individual projects that are narrowly defined can readily scaffold into collaborative science at the time of data synthesis and interpretation. 3) There is a high likelihood of scientific discovery that contributes to grant objectives. 4) Enrolled students will experience ambiguity and instrumentation setbacks alongside their faculty and instructors, and will likely have an opportunity to withstand/overcome challenges in a manner that trains students in complex problem solving and imparts resilience (St John et al., 2019). Based on our experiences, we consider CUREs as a means to create more inclusive and equitable spaces for learning to do research, and a basis for a broadening future WAIS community. Our groups have yet to assess student learning gains and STEM entry in a robust way, but we can report that two presenters at WAIS 2022 came from our 2021 CURE, and four polar science graduate researchers gained experience via CURE teaching. Data obtained by CURE students is contributing to our NSF projects’ aims to obtain isotope, age, and petrogenetic criteria with bearing on the subglacial bedrock geology, tectonic and landscape evolution, and ice sheet history of MBL. Cited and recommended works: Cascella & Jez, 2018, doi: 10.1021/acs.jchemed.7b00705 Gentile et al., 2017, doi: 10.17226/24622 Shanahan et al. 2022, https://www.cur.org/assets/1/23/01-01_TOC_SPUR_Winter21.pdf Shortlidge & Brownell, 2016, doi: 10.1128/jmbe.v17i3.1103 St. John et al. 2019, EOS, doi: 10.1029/2019EO127285.more » « less
-
null (Ed.)This research paper studies the challenges that mathematics faculty and graduate teaching assistants (GTAs) faced when moving active and collaborative calculus courses from in-person to virtual instruction. As part of a larger pedagogical change project (described below), the math department at a public Research-1 university began transitioning pre-calculus and calculus courses to an active and collaborative learning (ACL) format in Fall 2019. The change began with the introduction of collaborative worksheets in recitations which were led by GTAs and supported by undergraduate learning assistants (LAs). Students recitation periods collaboratively solving the worksheet problems on whiteboards. When COVID-19 forced the rapid transition to online teaching, these ACL efforts faced an array of challenges. Faculty and GTA reflections on the changes to teaching and learning provide insight into how instructional staff can be supported in implementing ACL across various modes of instruction. The calculus teaching change efforts discussed in this paper are part of an NSF-supported project that aims to make ACL the default method of instruction in highly enrolled gateway STEM courses across the institution. The theoretical framework for the project builds on existing work on grassroots change in higher education (Kezar and Lester, 2011) to study the effect of communities of practice on changing teaching culture. The project uses course-based communities of practice (Wenger, 1999) that include instructors, GTAs, and LAs working together to design and enact teaching change in the targeted courses alongside ongoing professional development for GTAs and LAs. Six faculty and five GTAs involved in the teaching change effort in mathematics were interviewed after the Spring 2020 semester ended. Interview questions focused on faculty and GTA experiences implementing active learning after the rapid transition to online teaching. A grounded coding scheme was used to identify common themes in the challenges faced by instructors and GTAs as they moved online and in the impacts of technology, LA support, and the department community of practice on the move to online teaching. Technology, including both access and capabilities, emerged as a common barrier to student engagement. A particular barrier was students’ reluctance to share video or participate orally in sessions that were being recorded, making group work more difficult than it had been in a physical classroom. In addition, most students lacked access to a tablet for freehand writing, presenting a significant hurdle for sharing mathematical notation when physical whiteboards were no longer an option. These challenges point to the importance of incorporating flexibility in active learning implementation and in the professional development that supports teaching changes toward active learning, since what is conceived for a collaborative physical classroom may be implemented in a much different environment. The full paper will present a detailed analysis of the data to better understand how faculty and GTA experiences in the transition to online delivery can inform planning and professional development as the larger institutional change effort moves forward both in mathematics and in other STEM fields.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1145/3512912
