skip to main content

Explore Research Products in the NSF-PAR

Title: Student Perceptions of Fairness and Security in a Versioned Programming Exam
Using multiple versions of exams is a common exam security technique to prevent cheating in a variety of contexts. While psycho-metric techniques are routinely used by large high-stakes testing companies to ensure equivalence between exam versions, such approaches are generally cost and effort prohibitive for individual classrooms. As such, exam versions practically present a tension between exam security (which is enhanced by the versioning) and fairness (which results from difficulty variation between versions). In this work, we surveyed students on their perceptions of this trade-off between exam security and fairness on a versioned programming exam and found that significant populations value each aspect over the other. Furthermore, we found that students' expression of concerns about unfairness was not correlated to whether they had received harder versions of the course's most recent exam, but was correlated to lower overall course performance.  more » « less
Award ID(s):
1915257
NSF-PAR ID:
10200295
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Proceedings of the 2020 ACM Conference on International Computing Education Research
Page Range / eLocation ID:
25 to 35
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ( , PLOS ONE)
    Carvalho, Paulo F. (Ed.)
    Evidence-based teaching practices are associated with improved student academic performance. However, these practices encompass a wide range of activities and determining which type, intensity or duration of activity is effective at improving student exam performance has been elusive. To address this shortcoming, we used a previously validated classroom observation tool, Practical Observation Rubric to Assess Active Learning (PORTAAL) to measure the presence, intensity, and duration of evidence-based teaching practices in a retrospective study of upper and lower division biology courses. We determined the cognitive challenge of exams by categorizing all exam questions obtained from the courses using Bloom’s Taxonomy of Cognitive Domains. We used structural equation modeling to correlate the PORTAAL practices with exam performance while controlling for cognitive challenge of exams, students’ GPA at start of the term, and students’ demographic factors. Small group activities, randomly calling on students or groups to answer questions, explaining alternative answers, and total time students were thinking, working with others or answering questions had positive correlations with exam performance. On exams at higher Bloom’s levels, students explaining the reasoning underlying their answers, students working alone, and receiving positive feedback from the instructor also correlated with increased exam performance. Our study is the first to demonstrate a correlation between the intensity or duration of evidence-based PORTAAL practices and student exam performance while controlling for Bloom’s level of exams, as well as looking more specifically at which practices correlate with performance on exams at low and high Bloom’s levels. This level of detail will provide valuable insights for faculty as they prioritize changes to their teaching. As we found that multiple PORTAAL practices had a positive association with exam performance, it may be encouraging for instructors to realize that there are many ways to benefit students’ learning by incorporating these evidence-based teaching practices. 
    more » « less
  2. ; ; ; ( , American Society for Engineering Education)
    In this research-based paper, we explore the relationships among Rice University STEM students’ high school preparation, psychological characteristics, and career aspirations. Although greater high school preparation in STEM coursework predicts higher STEM retention and performance in college [1], objective academic preparation and college performance do not fully explain STEM retention decisions, and the students who leave STEM are often not the lowest performing students [2]. Certain psychosocial experiences may also influence students’ STEM decisions. We explored the predictive validity of 1) a STEM diagnostic exam as an objective measure of high school science and math preparation and 2) self-efficacy as a psychological measure on long-term (three years later) STEM career aspirations and STEM identity of underprepared Rice STEM students. University administrators use diagnostic exam scores (along with other evidence of high school underpreparation) to identify students who might benefit from additional support. Using linear regression to explore the link between diagnostic exam scores and self-efficacy, exam scores predicted self-efficacy a semester after students’ first semester in college; exam scores were also marginally correlated with self-efficacy three years later. Early STEM career aspirations predicted later career aspirations, accounting for 21.3% of the variance of career outcome expectations three years later (β=.462, p=.006). Scores on the math diagnostic exam accounted for an additional 10.1% of the variance in students’ three-year STEM career aspirations (p=.041). Self-efficacy after students’ first semester did not predict future STEM aspirations. Early STEM identity explained 28.8% of the variance in three-year STEM identity (p=.001). Math diagnostic exam scores accounted for only marginal incremental variance after STEM identity, and self-efficacy after students’ first semester did not predict three-year STEM aspirations. Overall, we found that the diagnostic exam provided incremental predictive validity in STEM career aspirations after students’ sixth semester of college, indicating that early STEM preparation has long-lasting ramifications for students’ STEM career intentions. Our next steps include examining whether students’ diagnostic exam scores predict STEM graduation rates and final GPAs for science and math versus engineering majors. 
    more » « less
  3. ; ; ; ; ( , 2021 IEEE Frontiers in Education Conference (FIE))
    This full research paper explores students’ attitudes toward second-chance testing and how second-chance testing influences students’ behavior. Second-chance testing refers to giving students the opportunity to take a second instance of each exam for some sort of grade replacement. Previous work has demonstrated that second-chance testing can lead to improved student outcomes in courses, but how to best structure second-chance testing to maximize its benefits remains an open question. We complement previous work by interviewing a diverse group of 23 students that have taken courses that use second-chance testing. From the interviews, we sought to gain insight into students’ views and use of second-chance testing. We found that second-chance testing was almost universally viewed positively by the students and was frequently cited as helping to reduce test takers’ anxiety and boost their confidence. Overall, we find that the majority of students prepare for second-chance exams in desirable ways, but we also note ways in which second-chance testing can potentially lead to undesirable behaviors including procrastination, over-reliance on memorization, and attempts to game the system. We identified emergent themes pertaining to various facets of second-chance test-taking, including: 1) concerns about the time commitment required for second-chance exams; 2) a belief that second-chance exams promoted fairness; and 3) how second-chance testing incentivized learning. This paper will provide instructors and other stakeholders with detailed insights into students’ behavior regarding second-chance testing, enabling instructors to develop better policies and avoid unintended consequences. 
    more » « less
  4. ( , Applied economics teaching resources)
    null (Ed.)
    This paper describes an innovative graduate course in agricultural economics that has evolved over the past decade and attracts students from across the Purdue University campus. Its novel combination of guest lectures on key sustainability topics, and intensive, computer-based lab assignments with the SIMPLE model of global food and environmental security, prepares students to undertake innovative projects. These independent projects are presented to the class, written up, and submitted in lieu of a final exam. The topics covered are quite diverse and range from the impacts of women empowerment on food security, to the consequences of heat stress on farm workers, and the impact of reducing food waste. The course has spawned two dozen published journal articles, inspired MS and PhD theses, and facilitated a number of important interdisciplinary projects. The complete syllabus, lab assignments, and detailed course design are made available for others to use and adapt to their own circumstances. Future versions of the course will seek to incorporate explicitly spatial analysis of agriculture, land, water, and environmental quality outcomes. 
    more » « less
  5. ; ; ; ; ( , USENIX Security)
    The onset of the COVID-19 pandemic changed the landscape of education and led to increased usage of remote proctoring tools that are designed to monitor students when they take assessments outside the classroom. While prior work has explored students' privacy and security concerns regarding online proctoring tools, the perspective of educators is under explored. Notably, educators are the decision makers in the classrooms and choose which remote proctoring services and the level of observations they deem appropriate. To explore how educators balance the security and privacy of their students with the requirements of remote exams, we sent survey requests to over 3,400 instructors at a large private university that taught online classes during the 2020/21 academic year. We had n=125 responses: 21% of the educators surveyed used online exam proctoring services during the remote learning period, and of those, 35% plan to continue using the tools even when there is a full return to in-person learning. Educators who use exam proctoring services are often comfortable with their monitoring capabilities. However, educators are concerned about students sharing certain types of information with exam proctoring companies, particularly when proctoring services collect identifiable information to validate students' identities. Our results suggest that many educators developed alternative assessments that did not require online proctoring and that those who did use online proctoring services often considered the tradeoffs between the potential risks to student privacy and the utility or necessity of exam proctoring services. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email