skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Dual‐Purpose Model for Binary Data: Estimating Ability and Misconceptions
Abstract Most existing diagnostic models are developed to detect whether students have mastered a set of skills of interest, but few have focused on identifying what scientific misconceptions students possess. This article developed a general dual‐purpose model for simultaneously estimating students' overall ability and the presence and absence of misconceptions. The expectation‐maximization algorithm was developed to estimate the model parameters. A simulation study was conducted to evaluate to what extent the parameters can be accurately recovered under varied conditions. A set of real data in science education was also analyzed to examine the viability of the proposed model in practice.  more » « less
Award ID(s):
2150601
PAR ID:
10485267
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Journal of Educational Measurement
Volume:
61
Issue:
2
ISSN:
0022-0655
Format(s):
Medium: X Size: p. 179-197
Size(s):
p. 179-197
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Middle school students (n = 144) worked with an applet specially designed to introduce the concept of function without using algebraic representations. The purpose of the study was to examine whether the applet would help students understand function as a relationship between a set of inputs and a set of outputs and to begin to develop a definition of function based on that relationship. Results indicate that, by focusing on consistency of the outputs, the students, at a rate of approximately 80%, are able to distinguish functions from nonfunctions. Also, students showed some promise in recognizing constant functions as functions, a known area of common misconceptions. Students' main conceptual difficulty, likely caused by the context, was accepting nonintuitive outputs even if those outputs were consistent. 
    more » « less
  2. Creative exercises (CEs) consist of open-ended prompts to which students provide a series of relevant, distinct, and accurate statements, thus requiring that students make connections between concepts. In this study, CEs were incorporated into a one-semesterSurvey of Organic Chemistrycourse to identify what connections between chemistry concepts students made and what incorrect conceptions or misconceptions about chemistry students held. Students (N= 79) enrolled in the course first completed a practice CE as an in-class group activity followed by individually responding to a CE bonus problem on each of their four course exams. The number of different concepts students addressed for each CE increased over the semester, indicating that students made increasing content connections about course material; however, misconceptions about early concepts, such as nomenclature and assigning configurations, remained consistent throughout the semester. Furthermore, the CEs were found to be instrumental in shedding light on misconceptions and knowledge structures of students across varying performance levels. Overall, students reported that they viewed the CEs favorably and would like to see CEs incorporated in future courses. 
    more » « less
  3. Security failures in software arising from failures to practice secure programming are commonplace. Improving this situation requires that practitioners have a clear understanding of the foundational concepts in secure programming to serve as a basis for building new knowledge and responding to new challenges. We developed a Secure Programing Concept Inventory (SPCI) to measure students' understanding of foundational concepts in secure programming. The SPCI consists of thirty-five multiple choice items targeting ten concept areas of secure programming. The SPCI was developed by establishing the content domain of secure programming, developing a pool of test items, multiple rounds of testing and refining the items, and finally testing and inventory reduction to produce the final scale. Scale development began by identifying the core concepts in secure programming. A Delphi study was conducted with thirty practitioners from industry, academia, and government to establish the foundational concepts of secure programming and develop a concept map. To build a set of misconceptions in secure programming, the researchers conducted interviews with students and instructors in the field. These interviews were analyzed using content analysis. This resulted in a taxonomy of misconceptions in secure programming covering ten concept areas. An item pool of multiple-choice questions was developed. The item pool of 225 was administered to a population of 690 students across four institutions. Item discrimination and item difficulty scores were calculated, and the best performing items were mapped to the misconception categories to create subscales for each concept area resulting in a validated 35 item scale. 
    more » « less
  4. Misconceptions about core linguistic concepts like mutable variables, mutable compound data, and their interaction with scope and higher-order functions seem to be widespread. But how do we detect them, given that experts have blind spots and may not realize the myriad ways in which students can misunderstand programs? Furthermore, once identified, what can we do to correct them? In this paper, we present a curated list of misconceptions, and an instrument to detect them. These are distilled from student work over several years and match and extend prior research. We also present an automated, self-guided tutoring system. The tutor builds on strategies in the education literature and is explicitly designed around identifying and correcting misconceptions. We have tested the tutor in multiple settings. Our data consistently show that (a) the misconceptions we tackle are widespread, and (b) the tutor appears to improve understanding. 
    more » « less
  5. Abstract Students possess informal, intuitive ways of reasoning about the world, including biological phenomena. Although useful in some cases, intuitive reasoning can also lead to the development of scientifically inaccurate ideas that conflict with central concepts taught in formal biology education settings, including evolution. Using antibiotic resistance as an example of evolution, we developed a set of reading interventions and an assessment tool to examine the extent to which differences in instructional language affect undergraduate student misconceptions and intuitive reasoning. We find that readings that confront intuitive misconceptions can be more effective in reducing those misconceptions than factual explanations of antibiotic resistance that fail to confront misconceptions. Overall, our findings build upon investigations of intuitive reasoning in biology, examine possible instructional interventions, and raise questions about effective implementation of reading interventions in addressing persistent misconceptions about biology. 
    more » « less