skip to main content


Title: Access to Online Formative Assessments in Lower-Division Undergraduate Biology Courses: Investigating Barriers to Student Engagement
Instructors use a variety of online formative assessment (FA) activities to support learning outside class. Previous studies have revealed barriers for students in online courses, but little is known about the barriers students experience when completing online FA assignments. Understanding these barriers to access is critical to fostering more inclusive learning for all students. Using a framework from previous work in online learning, we examined student perceptions of online FA access with respect to five barrier categories: technical resources, instructor organization, social interactions, personal engagement, and learning environment. We developed and administered a survey to more than 1200 undergraduate biology students at 2-year and 4-year institutions. Students responded to statements using Likert scales and open-ended prompts. Statistical models indicated differences in access across the barrier categories and revealed that demographic characteristics were associated with certain barrier categories. Furthermore, technical resources, instructor organization, and personal engagement barriers were associated with lower course performance. In open-ended responses, students most frequently suggested that changes to scheduling logistics, course delivery, and FA format would improve their online FA experience. We discuss how these findings and student suggestions can inform instruction, particularly how instructors can alter their FA characteristics to better suit their student populations.  more » « less
Award ID(s):
2044243 2043875
NSF-PAR ID:
10436383
Author(s) / Creator(s):
; ; ; ; ; ;
Editor(s):
Coffman, Clark
Date Published:
Journal Name:
CBE—Life Sciences Education
Volume:
21
Issue:
4
ISSN:
1931-7913
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This research evaluates the impact of switching college engineering courses from in-person instruction to emergency remote learning among engineering students at a university in the Midwest. The study aimed to answer the question: What were the concerns and perceived challenges students faced when traditional in-person engineering courses suddenly transitioned to remote learning? The goal of this study is to uncover the challenges students were facing in engineering online courses and to understand students’ concerns. Our findings can help improve teaching instruction to provide students with previously unavailable educational assistance for online engineering courses. We collected online survey responses during weeks 8 and 9 of the academic semester, shortly after the COVID-19 shutdown and emergency transition to remote learning in Spring 2020. The survey included two open-ended questions which inquired about students’ feedback about moving the class online, and one two-item scale which assessed students’ confidence in online engineering learning. Data analysis for the open-ended questions was guided by the theoretical framework - Social Cognitive Career Theory [1] that explores how context, person factors and social cognitions contribute to career goals, interests and actions. A phenomenological approach [2] was conducted to understand the experience of these students. Open coding and axial coding [2] methods were used to create initial categories then themes related to students' concerns and challenges. Data from the two-item scale was evaluated using descriptive statistics: means, standard deviations, and ranges. Four main themes with separate sub-categories emerged from the student responses: 1) Instructor’s ability to teach course online (Instructional limitations, Seeking help, Increased Workload), 2) Student’s ability to learn online (Time Management, Lower engagement and motivation, Harder to absorb material, Hard to focus, Worry about performance), 3) Difficulties outside of class (Technology issues), and 4) No concerns. Students seemed more concerned about their ability to learn the material (48% of responses) than the instructor’s ability to teach the material (36% of responses). The instructional limitations or lack of instructional support (22% of responses) and time management (12% of responses) were among the major concerns in the sub-categories. The results from two-item scale indicated participants' s confidence in their ability to master their classroom knowledge was at an intermediate level via online instruction (6/10), and participants' confidence in the instructor's ability to teach knowledge in online classes is moderate to high (7/10). The results align with the open-ended question response in which students were somewhat more concerned about their ability to learn than the instructor’s ability to teach. The themes and analysis will be a valuable tool to help institutions and instructors improve student learning experiences. 
    more » « less
  2. null (Ed.)
    Over the past two decades, educators have used computer-supported collaborative learning (CSCL) to integrate technology with pedagogy to improve student engagement and learning outcomes. Researchers have also explored the diverse affordances of CSCL, its contributions to engineering instruction, and its effectiveness in K-12 STEM education. However, the question of how students use CSCL resources in undergraduate engineering classrooms remains largely unexplored. This study examines the affordances of a CSCL environment utilized in a sophomore dynamics course with particular attention given to the undergraduate engineering students’ use of various CSCL resources. The resources include a course lecturebook, instructor office hours, a teaching assistant help room, online discussion board, peer collaboration, and demonstration videos. This qualitative study uses semi-structured interview data collected from nine mechanical engineering students (four women and five men) who were enrolled in a dynamics course at a large public research university in Eastern Canada. The interviews focused on the individual student’s perceptions of the school, faculty, students, engineering courses, and implemented CSCL learning environment. The thematic analysis was conducted to analyze the transcribed interviews using a qualitative data analysis software (Nvivo). The analysis followed a six step process: (1) reading interview transcripts multiple times and preliminary in vivo codes; (2) conducting open coding by coding interesting or salient features of the data; (3) collecting codes and searching for themes; (4) reviewing themes and creating a thematic map; (5) finalizing themes and their definitions; and (6) compiling findings. This study found that the students’ use of CSCL resources varied depending on the students’ personal preferences, as well as their perceptions of the given resource’s value and its potential to enhance their learning. For example, the dynamics lecturebook, which had been redesigned to encourage problem solving and note-taking, fostered student collaborative problem solving with their peers. In contrast, the professor’s example video solutions had much more of an influence on students’ independent problem-solving processes. The least frequently used resource was the course’s online discussion forum, which could be used as a means of communication. The findings reveal how computer-supported collaborative learning (CSCL) environments enable engineering students to engage in multiple learning opportunities with diverse and flexible resources to both address and to clarify their personal learning needs. This study strongly recommends engineering instructors adapt a CSCL environment for implementation in their own unique classroom context. 
    more » « less
  3. Introduction: The work reported here subscribes to the idea that the best way to learn - and thus, improve student educational outcomes - is through solving problems, yet recognizes that engineering students are generally provided insufficient opportunities to engage problems as they will be engaged in practice. Attempts to incorporate more open-ended, ill-structured experiences have increased but are challenging for faculty to implement because there are no systematic methods or approaches that support the educator in designing these learning experiences. Instead, faculty often start from the anchor of domain-specific concepts, an anchoring that is further reinforced by available textbook problems that are rarely open in nature. Open-ended problems are then created in ad-hoc ways, and in doing so, the problem-solving experience is often not realized as the instructor intended. Approach: The focus in this work is the development and preliminary implementation of a reflective approach to support instructors in examining the design intent of problem experiences. The reflective method combines concept mapping as developed by Joseph Novak with the work of David Jonassen and his characterization of problems and the forms of knowledge required to solve them. Results: We report on the development of a standard approach – a template -- for concept mapping of problems. As a demonstration, we applied the approach to a relatively simple, well-structured problem used in an introductory aerospace engineering course. Educator-created concept maps provided a visual medium for examining the connectivity of problem elements and forms of knowledge. Educator reflection after looking at and discussing the concept map revealed ways in which the problem engagement may differ from the perceived design intent. Implications: We consider the potential for the proposed method to support design and facilitation activities in problem-based learning (PBL) environments. We explore broader implications of the approach as it relates to 1) facilitating a priori faculty insights regarding student navigation of problem solving, 2) instructor reflection on problem design and facilitation, and 3) supporting problem design and facilitation. Additionally, we highlight important issues to be further investigated toward quantifying the value and limitations of the proposed approach. 
    more » « less
  4. We present a course design model for applying project-based learning to an online undergraduate object oriented systems course. In our model, projects and reflection are central to the curriculum. Our model challenges students through modularized, repetitive project cycles beginning with analysis and design (i.e. using pseudo- code, flowcharts, diagrams) then coding, debugging, testing, and finally, reflection. We analyzed student reflection responses from two semesters to extract major themes and sub-themes, then mapped these to the MUSIC model (eMpowerment, Usefulness, Success, Interest, Caring) to understand our model's influence on student engagement and motivation. We found that a rhythmic project cycle encourages self-regulation in online students to formulate project plans, track their progress, and evaluate their solutions. Online students feel empowered when course projects promote choice, flexibility, creativity, experimentation, and extensions to other applications. Online student success is dependent on the clarity of instructions, course scaffolding, level of challenge, instructor feedback, and opportunities to reflect on personal failure, success, and challenge. Online students are interested in projects that are familiar, real-world, and fun, but expect to be situated in team-based environments. Students appreciate instructors who are caring and accommodating to personal needs. We recommend six salient strategies for improving online course and project design: design a visible, rhythmic structure; set transparent expectations and instructions; encourage design before implementation; connect to real-world applications and tools; experience happy challenges; infuse sustained reflection. 
    more » « less
  5. null (Ed.)
    This research paper studies the challenges that mathematics faculty and graduate teaching assistants (GTAs) faced when moving active and collaborative calculus courses from in-person to virtual instruction. As part of a larger pedagogical change project (described below), the math department at a public Research-1 university began transitioning pre-calculus and calculus courses to an active and collaborative learning (ACL) format in Fall 2019. The change began with the introduction of collaborative worksheets in recitations which were led by GTAs and supported by undergraduate learning assistants (LAs). Students recitation periods collaboratively solving the worksheet problems on whiteboards. When COVID-19 forced the rapid transition to online teaching, these ACL efforts faced an array of challenges. Faculty and GTA reflections on the changes to teaching and learning provide insight into how instructional staff can be supported in implementing ACL across various modes of instruction. The calculus teaching change efforts discussed in this paper are part of an NSF-supported project that aims to make ACL the default method of instruction in highly enrolled gateway STEM courses across the institution. The theoretical framework for the project builds on existing work on grassroots change in higher education (Kezar and Lester, 2011) to study the effect of communities of practice on changing teaching culture. The project uses course-based communities of practice (Wenger, 1999) that include instructors, GTAs, and LAs working together to design and enact teaching change in the targeted courses alongside ongoing professional development for GTAs and LAs. Six faculty and five GTAs involved in the teaching change effort in mathematics were interviewed after the Spring 2020 semester ended. Interview questions focused on faculty and GTA experiences implementing active learning after the rapid transition to online teaching. A grounded coding scheme was used to identify common themes in the challenges faced by instructors and GTAs as they moved online and in the impacts of technology, LA support, and the department community of practice on the move to online teaching. Technology, including both access and capabilities, emerged as a common barrier to student engagement. A particular barrier was students’ reluctance to share video or participate orally in sessions that were being recorded, making group work more difficult than it had been in a physical classroom. In addition, most students lacked access to a tablet for freehand writing, presenting a significant hurdle for sharing mathematical notation when physical whiteboards were no longer an option. These challenges point to the importance of incorporating flexibility in active learning implementation and in the professional development that supports teaching changes toward active learning, since what is conceived for a collaborative physical classroom may be implemented in a much different environment. The full paper will present a detailed analysis of the data to better understand how faculty and GTA experiences in the transition to online delivery can inform planning and professional development as the larger institutional change effort moves forward both in mathematics and in other STEM fields. 
    more » « less