An official website of the United States government
In response to the Covid-19 pandemic, educational institutions quickly transitioned to remote learning. The problem of how to perform student assessment in an online environment has become increasingly relevant, leading many institutions and educators to turn to online proctoring services to administer remote exams. These services employ various student monitoring methods to curb cheating, including restricted ("lockdown") browser modes, video/screen monitoring, local network traffic analysis, and eye tracking. In this paper, we explore the security and privacy perceptions of the student test-takers being proctored. We analyze user reviews of proctoring services' browser extensions and subsequently perform an online survey (n=102). Our findings indicate that participants are concerned about both the amount and the personal nature of the information shared with the exam proctoring companies. However, many participants also recognize a trade-off between pandemic safety concerns and the arguably invasive means by which proctoring services ensure exam integrity. Our findings also suggest that institutional power dynamics and students' trust in their institutions may dissuade students' opposition to remote proctoring.
more »
« less
“Out of my control”: science undergraduates report mental health concerns and inconsistent conditions when using remote proctoring software
Abstract Efforts to discourage academic misconduct in online learning environments frequently include the use of remote proctoring services. While these services are relatively commonplace in undergraduate science courses, there are open questions about students’ remote assessment environments and their concerns related to remote proctoring services. Using a survey distributed to 11 undergraduate science courses engaging in remote instruction at three American, public, research-focused institutions during the spring of 2021, we found that the majority of undergraduate students reported testing in suboptimal environments. Students’ concerns about remote proctoring services were closely tied to technological difficulties, fear of being wrongfully accused of cheating, and negative impacts on mental health. Our results suggest that remote proctoring services can create and perpetuate inequitable assessment environments for students, and additional research is required to understand the efficacy of their intended purpose to prevent cheating. We also advocate for continued conversations about the broader social and institutional conditions that can pressure students into cheating. While changes to academic culture are difficult, these conversations are necessary for higher education to remain relevant in an increasingly technological world.
more »
« less
- Award ID(s):
- 1919462
- PAR ID:
- 10474023
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- International Journal for Educational Integrity
- Volume:
- 19
- Issue:
- 1
- ISSN:
- 1833-2595
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The onset of the COVID-19 pandemic changed the landscape of education and led to increased usage of remote proctoring tools that are designed to monitor students when they take assessments outside the classroom. While prior work has explored students' privacy and security concerns regarding online proctoring tools, the perspective of educators is under explored. Notably, educators are the decision makers in the classrooms and choose which remote proctoring services and the level of observations they deem appropriate. To explore how educators balance the security and privacy of their students with the requirements of remote exams, we sent survey requests to over 3,400 instructors at a large private university that taught online classes during the 2020/21 academic year. We had n=125 responses: 21% of the educators surveyed used online exam proctoring services during the remote learning period, and of those, 35% plan to continue using the tools even when there is a full return to in-person learning. Educators who use exam proctoring services are often comfortable with their monitoring capabilities. However, educators are concerned about students sharing certain types of information with exam proctoring companies, particularly when proctoring services collect identifiable information to validate students' identities. Our results suggest that many educators developed alternative assessments that did not require online proctoring and that those who did use online proctoring services often considered the tradeoffs between the potential risks to student privacy and the utility or necessity of exam proctoring services.more » « less
-
This work-in-progress paper presents an innovative practice of using oral exams to maintain academic integrity and promote student engagement in large-enrollment engineering courses during remote instruction. With the abrupt and widespread transition to distance learning and assessment brought on by the COVID-19 pandemic, there has been a registered upsurge in academic integrity violations globally. To address the challenge of compromised integrity, in the winter quarter of 2021 we have implemented oral exams across six mostly high-enrollment mechanical and electrical engineering undergraduate courses. We present our oral exam design parameters in each of the courses and discuss how oral exams relate to academic integrity, student engagement, stress, and implicit bias. We also address the challenge of scalability, as most of our oral exams were implemented in large classes, where academic integrity and student-instructor disconnection have generally gotten disproportionately worse during remote learning. Our survey results indicate that oral exams have positively contributed to academic integrity in our courses. Based on our preliminary study and experiences, we expect oral exams can be effectively leveraged to hinder cheating and foster academic honesty in students, even when in-person instruction and assessment resumes.more » « less
-
Battestilli, Lina; Rebelsky, Samuel A; Shoop, Libby (Ed.)We compare the exam security of three proctoring regimens of Bring-Your-Own-Device, synchronous, computer-based exams in a computer science class: online un-proctored, online proctored via Zoom, and in-person proctored. We performed two randomized crossover experiments to compare these proctoring regimens. The first study measured the score advantage students receive while taking un-proctored online exams over Zoom-proctored online exams. The second study measured the score advantage of students taking Zoom-proctored online exams over in-person proctored exams. In both studies, students took six 50-minute exams using their own devices, which included two coding questions and 8–10 non-coding questions. We find that students score 2.3% higher on non-coding questions when taking exams in the un-proctored format compared to Zoom proctoring. No statistically significant advantage was found for the coding questions. While most of the non-coding questions had randomization such that students got different versions, for the few questions where all students received the same exact version, the score advantage escalated to 5.2%. From the second study, we find no statistically significant difference between students’ performance on Zoom-proctored vs. in-person proctored exams. With this, we recommend educators incorporate some form of proctoring along with question randomization to mitigate cheating concerns in BYOD exams.more » « less
-
Abstract BackgroundDue to the COVID-19 pandemic, many universities moved to emergency remote teaching (ERT). This allowed institutions to continue their instruction despite not being in person. However, ERT is not without consequences. For example, students may have inadequate technological supports, such as reliable internet and computers. Students may also have poor learning environments at home and may need to find added employment to support their families. In addition, there are consequences to faculty. It has been shown that female instructors are more disproportionately impacted in terms of mental health issues and increased domestic labor. This research aims to investigate instructors’ and students’ perceptions of their transition to ERT. Specifically, during the transition to ERT at a research-intensive, Minority-Serving Institution (MSI), we wanted to: (1) Identify supports and barriers experienced by instructors and students. (2) Compare instructors’ experiences with the students’ experiences. (3) Explore these supports and barriers within the context ofsocial presence,teaching presence, and/orcognitive presenceas well as how these supports and barriers relate toscaffoldingin STEM courses. ResultsInstructors identified twice as many barriers as supports in their teaching during the transition to ERT and identified casual and formal conversations with colleagues as valuable supports. Emerging categories for barriers consisted of academic integrity concerns as well as technological difficulties. Similarly, students identified more barriers than supports in their learning during the transition to ERT. More specifically, students described pre-existing course structure, classroom technology, and community as best supporting their learning. Barriers that challenged student learning included classroom environment, student availability, and student emotion and comfort. ConclusionsTogether, this research will help us understand supports and barriers to teaching and learning during the transition to ERT. This understanding can help us better plan and prepare for future emergencies, particularly at MSIs, where improved communication and increased access to resources for both students and instructors are key.more » « less
