An official website of the United States government
In response to the Covid-19 pandemic, educational institutions quickly transitioned to remote learning. The problem of how to perform student assessment in an online environment has become increasingly relevant, leading many institutions and educators to turn to online proctoring services to administer remote exams. These services employ various student monitoring methods to curb cheating, including restricted ("lockdown") browser modes, video/screen monitoring, local network traffic analysis, and eye tracking. In this paper, we explore the security and privacy perceptions of the student test-takers being proctored. We analyze user reviews of proctoring services' browser extensions and subsequently perform an online survey (n=102). Our findings indicate that participants are concerned about both the amount and the personal nature of the information shared with the exam proctoring companies. However, many participants also recognize a trade-off between pandemic safety concerns and the arguably invasive means by which proctoring services ensure exam integrity. Our findings also suggest that institutional power dynamics and students' trust in their institutions may dissuade students' opposition to remote proctoring.
more »
« less
This content will become publicly available on April 13, 2027
Re-Examining the Examiners: Changes in Privacy and Security Perceptions of Exam Proctoring
With the shift to remote learning during the COVID-19 pandemic, educators turned to remote exam proctoring software to support integrity for online tests. However, due to the mechanisms used to surveil test-takers, these systems come with significant privacy and security tradeoffs. At the height of the pandemic, Balash et al. (SOUPS ’21) found that test-takers had privacy concerns with remote proctoring but acquiesced due to a number of factors. We investigate how perceptions have changed four years later. To gain a fuller perspective on how users experience these tools now, we replicate Balash et al.’s study with 127 participants who have experienced exam proctoring. We found a significant shift in favor of proctoring software, with greater acceptance of all monitoring methods compared to 2020. This is likely due to the convenience of remote exams and a growing resignation to privacy trade-offs. We discuss these implications and suggest future directions.
more »
« less
- Award ID(s):
- 2138654
- PAR ID:
- 10685581
- Publisher / Repository:
- ACM
- Date Published:
- ISBN:
- 9798400722783
- Page Range / eLocation ID:
- 1 to 19
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The onset of the COVID-19 pandemic changed the landscape of education and led to increased usage of remote proctoring tools that are designed to monitor students when they take assessments outside the classroom. While prior work has explored students' privacy and security concerns regarding online proctoring tools, the perspective of educators is under explored. Notably, educators are the decision makers in the classrooms and choose which remote proctoring services and the level of observations they deem appropriate. To explore how educators balance the security and privacy of their students with the requirements of remote exams, we sent survey requests to over 3,400 instructors at a large private university that taught online classes during the 2020/21 academic year. We had n=125 responses: 21% of the educators surveyed used online exam proctoring services during the remote learning period, and of those, 35% plan to continue using the tools even when there is a full return to in-person learning. Educators who use exam proctoring services are often comfortable with their monitoring capabilities. However, educators are concerned about students sharing certain types of information with exam proctoring companies, particularly when proctoring services collect identifiable information to validate students' identities. Our results suggest that many educators developed alternative assessments that did not require online proctoring and that those who did use online proctoring services often considered the tradeoffs between the potential risks to student privacy and the utility or necessity of exam proctoring services.more » « less
-
With the rapid shift to remote learning in the early days of the COVID-19 pandemic, parents, teachers, and students had to quickly adapt to what scholars have called emergency remote learning (ERL). This transition required increased reliance on digital tools, exacerbating privacy and security threats associated with expanded data collection and new vulnerabilities. In this study, we adopt a sociotechnical and infrastructural perspective to understand how these threats emerged through breakdowns and tensions in elementary school ERL. Through interviews with 29 US-based teachers and parents of elementary school students (grades PreK-6), we identify two core findings related to privacy and security. First, we detail three breakdowns in the ERL sociotechnical infrastructure: (1) reduced attention to privacy and security issues as parents and teachers cobbled together a patchwork of tools needed to make ERL work; (2) privacy and security risks that emerged from ambiguous and shifting school policies; and (3) the failure to adapt standard authentication mechanisms (e.g., passwords) to be usable by young children. Second, we identify tensions between parents' and teachers' desire to help children advance in their education and their desire for children's privacy and security in ERL, as well as tensions resulting from the collapse of home and school contexts. These findings collectively suggest that ERL exacerbated existing--and created new--privacy and security challenges for young students, and we argue these challenges will carry beyond the pandemic due to the increasing use of technology to supplement traditional education. In light of these findings, we recommend researchers and educators use a framework of care to develop social and technical approaches to improving remote learning in order to protect children's privacy and security.more » « less
-
The increasing number of online courses and programs available worldwide has elevated the importance of reliable online exam proctoring. The typical proctoring process relies on webcam surveillance. However, this traditional method of proctoring is vulnerable to numerous types of face occlusions used for religious reasons or otherwise. We present a robust biometric authentication framework that combines advanced eye and face recognition, resulting in a much better live proctoring system that is further augmented by including fingerprinting. We have used cutting-edge deep learning techniques, specifically the Siamese network for fingerprint analysis and a ResNet-based eye recognition model tested with and without Gabor filters. Furthermore, our system offers much better performance compared to previously existing models. Notably, our system maintains high accuracy, approximately 98.04% for custom eye recognition, 99.01% for publicly available labeled faces dataset, 82% for niqab dataset and 87.04% for publicly available fingerprint dataset. Moreover, our model demonstrates a 10–20% improvement in face recognition under occlusion. Our solution is highly effective for not only online proctoring but also allows use in other similar situations, such as employee authentication for remote presence verification. Our system supports scenarios involving partial occlusions, such as masks and sunglasses, to full occlusions with veils, without requiring any additional hardware.more » « less
-
Battestilli, Lina; Rebelsky, Samuel A; Shoop, Libby (Ed.)We compare the exam security of three proctoring regimens of Bring-Your-Own-Device, synchronous, computer-based exams in a computer science class: online un-proctored, online proctored via Zoom, and in-person proctored. We performed two randomized crossover experiments to compare these proctoring regimens. The first study measured the score advantage students receive while taking un-proctored online exams over Zoom-proctored online exams. The second study measured the score advantage of students taking Zoom-proctored online exams over in-person proctored exams. In both studies, students took six 50-minute exams using their own devices, which included two coding questions and 8–10 non-coding questions. We find that students score 2.3% higher on non-coding questions when taking exams in the un-proctored format compared to Zoom proctoring. No statistically significant advantage was found for the coding questions. While most of the non-coding questions had randomization such that students got different versions, for the few questions where all students received the same exact version, the score advantage escalated to 5.2%. From the second study, we find no statistically significant difference between students’ performance on Zoom-proctored vs. in-person proctored exams. With this, we recommend educators incorporate some form of proctoring along with question randomization to mitigate cheating concerns in BYOD exams.more » « less
