skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Access to Online Formative Assessments in Lower-Division Undergraduate Biology Courses: Investigating Barriers to Student Engagement
Instructors use a variety of online formative assessment (FA) activities to support learning outside class. Previous studies have revealed barriers for students in online courses, but little is known about the barriers students experience when completing online FA assignments. Understanding these barriers to access is critical to fostering more inclusive learning for all students. Using a framework from previous work in online learning, we examined student perceptions of online FA access with respect to five barrier categories: technical resources, instructor organization, social interactions, personal engagement, and learning environment. We developed and administered a survey to more than 1200 undergraduate biology students at 2-year and 4-year institutions. Students responded to statements using Likert scales and open-ended prompts. Statistical models indicated differences in access across the barrier categories and revealed that demographic characteristics were associated with certain barrier categories. Furthermore, technical resources, instructor organization, and personal engagement barriers were associated with lower course performance. In open-ended responses, students most frequently suggested that changes to scheduling logistics, course delivery, and FA format would improve their online FA experience. We discuss how these findings and student suggestions can inform instruction, particularly how instructors can alter their FA characteristics to better suit their student populations.  more » « less
Award ID(s):
2044243 2043875
PAR ID:
10436383
Author(s) / Creator(s):
; ; ; ; ; ;
Editor(s):
Coffman, Clark
Date Published:
Journal Name:
CBE—Life Sciences Education
Volume:
21
Issue:
4
ISSN:
1931-7913
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. MacDonald, Laura J (Ed.)
    ABSTRACT Building rapport between instructors and students is a challenge, especially in large classes and in online environments. Previous work has shown that non-content Instructor Talk can foster positive student-teacher relationships, but less is known about non-content talk in electronic instructor messages. Here, we used the established Instructor Talk framework to craft positively phrased electronic messages that were sent through the course’s learning management system to students enrolled in an introductory biology course at a large public institution. We examined both close- and open-ended survey responses (n= 226) to assess students’ perceptions of the electronic messages, the course, and their instructor. Of the established Instructor Talk categories, the building student/instructor relationship category was most memorable to students. Encouragingly, 61% of students indicated they “liked the course more” and 88% indicated they “liked the instructor more” in response to the electronic messages. This demonstrates that implementing positively phrased Instructor Talk into electronic communication is an effective way to build rapport between instructors and students. 
    more » « less
  2. Abstract While formative assessments (FAs) can facilitate learning within undergraduate STEM courses, their impact likely depends on many factors, including how instructors implement them, whether students buy-in to them, and how students utilize them. FAs have many different implementation characteristics, including what kinds of questions are asked, whether questions are asked before or after covering the material in class, how feedback is provided, how students are graded, and other logistical considerations. We conducted 38 semi-structured interviews with students from eight undergraduate biology courses to explore how various implementation characteristics of in-class and out-of-class FAs can influence student perceptions and behaviors. We also interviewed course instructors to provide context for understanding student experiences. Using thematic analysis, we outlined various FA implementation characteristics, characterized the range of FA utilization behaviors reported by students, and identified emergent themes regarding the impact of certain implementation characteristics on student buy-in and utilization. Furthermore, we found that implementation characteristics have combined effects on student engagement and that students will tolerate a degree of “acceptable discomfort” with implementation features that contradict their learning preferences. These results can aid instructor reflection and guide future research on the complex connections between activity implementation and student engagement within STEM disciplines. 
    more » « less
  3. We present a course design model for applying project-based learning to an online undergraduate object oriented systems course. In our model, projects and reflection are central to the curriculum. Our model challenges students through modularized, repetitive project cycles beginning with analysis and design (i.e. using pseudo- code, flowcharts, diagrams) then coding, debugging, testing, and finally, reflection. We analyzed student reflection responses from two semesters to extract major themes and sub-themes, then mapped these to the MUSIC model (eMpowerment, Usefulness, Success, Interest, Caring) to understand our model's influence on student engagement and motivation. We found that a rhythmic project cycle encourages self-regulation in online students to formulate project plans, track their progress, and evaluate their solutions. Online students feel empowered when course projects promote choice, flexibility, creativity, experimentation, and extensions to other applications. Online student success is dependent on the clarity of instructions, course scaffolding, level of challenge, instructor feedback, and opportunities to reflect on personal failure, success, and challenge. Online students are interested in projects that are familiar, real-world, and fun, but expect to be situated in team-based environments. Students appreciate instructors who are caring and accommodating to personal needs. We recommend six salient strategies for improving online course and project design: design a visible, rhythmic structure; set transparent expectations and instructions; encourage design before implementation; connect to real-world applications and tools; experience happy challenges; infuse sustained reflection. 
    more » « less
  4. null (Ed.)
    Students belonging to marginalized groups experience positive impacts when taught by a teacher of the same race, ethnicity, and gender. The unique nature of standardized, asynchronous online course taking allows for greater separation of any possible educational benefits of student versus teacher-driven mechanisms contributing to these improved outcomes. Using a student-by-course fixed effect strategy on data from a large urban school district, I examined associations between whether students experienced racial/ethnic or gender congruence with their remote instructor and both engagement and learning outcomes. Students who identified as Black demonstrated higher rates of engagement, although no difference in achievement, within lessons taught by a same-race remote instructor. I find that representation is associated with engagement even when instructors follow closely scripted lessons, representation occurs in only small doses, and instruction occurs in an impersonal setting. 
    more » « less
  5. This research evaluates the impact of switching college engineering courses from in-person instruction to emergency remote learning among engineering students at a university in the Midwest. The study aimed to answer the question: What were the concerns and perceived challenges students faced when traditional in-person engineering courses suddenly transitioned to remote learning? The goal of this study is to uncover the challenges students were facing in engineering online courses and to understand students’ concerns. Our findings can help improve teaching instruction to provide students with previously unavailable educational assistance for online engineering courses. We collected online survey responses during weeks 8 and 9 of the academic semester, shortly after the COVID-19 shutdown and emergency transition to remote learning in Spring 2020. The survey included two open-ended questions which inquired about students’ feedback about moving the class online, and one two-item scale which assessed students’ confidence in online engineering learning. Data analysis for the open-ended questions was guided by the theoretical framework - Social Cognitive Career Theory [1] that explores how context, person factors and social cognitions contribute to career goals, interests and actions. A phenomenological approach [2] was conducted to understand the experience of these students. Open coding and axial coding [2] methods were used to create initial categories then themes related to students' concerns and challenges. Data from the two-item scale was evaluated using descriptive statistics: means, standard deviations, and ranges. Four main themes with separate sub-categories emerged from the student responses: 1) Instructor’s ability to teach course online (Instructional limitations, Seeking help, Increased Workload), 2) Student’s ability to learn online (Time Management, Lower engagement and motivation, Harder to absorb material, Hard to focus, Worry about performance), 3) Difficulties outside of class (Technology issues), and 4) No concerns. Students seemed more concerned about their ability to learn the material (48% of responses) than the instructor’s ability to teach the material (36% of responses). The instructional limitations or lack of instructional support (22% of responses) and time management (12% of responses) were among the major concerns in the sub-categories. The results from two-item scale indicated participants' s confidence in their ability to master their classroom knowledge was at an intermediate level via online instruction (6/10), and participants' confidence in the instructor's ability to teach knowledge in online classes is moderate to high (7/10). The results align with the open-ended question response in which students were somewhat more concerned about their ability to learn than the instructor’s ability to teach. The themes and analysis will be a valuable tool to help institutions and instructors improve student learning experiences. 
    more » « less