skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Student evaluation of more or better experimental data in classical and quantum mechanics
Prior research has shown that physics students often think about experimental procedures and data analysis very differently from experts. One key framework for analyzing student thinking has found that student thinking is more point-like, putting emphasis on the results of a single experimental trial, whereas set-like thinking relies on the results of many trials. Recent work, however, has found that students rarely fall into one of these two extremes, which may be a limitation of how student thinking is evaluated. Measurements of student thinking have focused on probing students’ procedural knowledge by asking them, for example, what steps they might take next in an experiment. Two common refrains are to collect more data, or to improve the experiment and collect better data. In both of these cases, the underlying reasons behind student responses could be based in point-like or set-like thinking. In this study we use individual student interviews to investigate how advanced physics students believe the collection of more and better data will affect the results of a classical and a quantum mechanical experiment. The results inform future frameworks and assessments for characterizing students thinking between the extremes of point and set reasoning in both classical and quantum regimes. 2020  more » « less
Award ID(s):
1809178 1808945
PAR ID:
10225446
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2020 PERC Proceedings
Page Range / eLocation ID:
575 to 580
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Measurement uncertainty is an important topic in the undergraduate laboratory curriculum. Previous research on student thinking about experimental measurement uncertainty has focused primarily on introductory-level students’ procedural reasoning about data collection and interpretation. In this paper, we extended this prior work to study upper-level students’ thinking about sources of measurement uncertainty across experimental contexts, with a particular focus on classical and quantum mechanics contexts. We developed a survey to probe students’ thinking in the generic question “What comes to mind when you think about measurement uncertainty in [classical/quantum] mechanics?” as well as in a range of specific experimental scenarios and interpreted student responses through the lens of availability and accessibility of knowledge pieces. We found that limitations of the experimental setup were most accessible to students in classical mechanics while principles of the underlying physics theory were most accessible to students in quantum mechanics, even in a context in which this theory was not relevant. We recommend that future research probe which sources of uncertainty experts believe are relevant in which contexts and how instruction in both classical and quantum contexts can help students draw on appropriate sources of uncertainty in classical and quantum experiments. 
    more » « less
  2. null; null; null (Ed.)
    Measurement uncertainty and experimental error are important concepts taught in undergraduate physics laboratories. Although student ideas about error and uncertainty in introductory classical mechanics lab experiments have been studied extensively, there is relatively limited research on student thinking about experimental measurement uncertainty in quantum mechanics. In this work, we used semi-structured interviews to study advanced physics students’ interpretations of fictitious data distributions from two common undergraduate laboratory experiments in quantum mechanics and one in classical mechanics. To analyze these interpretations, we developed a coding scheme that classifies student responses based on what factors they believe create un- certainty and differentiates between different types of uncertainty (e.g. imprecision, inaccuracy). We found that participants in our study expressed a variety of ideas about measurement uncertainty that varied with the context (classical/quantum) and the type of uncertainty. 
    more » « less
  3. Frank, B. W.; Jones, D. L.; and Ryan, Q. X. (Ed.)
    Significant attention in the PER community has been paid to student cognition and reasoning processes in undergraduate quantum mechanics. Until recently, however, these same topics have remained largely unexplored in the context of emerging interdisciplinary quantum information science (QIS) courses. We conducted exploratory interviews with 22 students in an upper-division quantum computing course at a large R1 university crosslisted in physics and computer science, as well as 6 graduate students in a similar graduate-level QIS course offered in physics. We classify and analyze students' responses to a pair of questions regarding the fundamental differences between classical and quantum computers. We specifically note two key themes of importance to educators: (1) when reasoning about computational power, students often struggled to distinguish between the relative effects of exponential and linear scaling, resulting in students frequently focusing on distinctions that are arguably better understood as analog-digital than classical-quantum, and (2) introducing the thought experiment of analog classical computers was a powerful tool for helping students develop a more expertlike perspective on the differences between classical and quantum computers. 
    more » « less
  4. Pamucar, Dragan (Ed.)
    Critical thinking is the process by which people make decisions about what to trust and what to do. Many undergraduate courses, such as those in biology and physics, include critical thinking as an important learning goal. Assessing critical thinking, however, is non-trivial, with mixed recommendations for how to assess critical thinking as part of instruction. Here we evaluate the efficacy of assessment questions to probe students’ critical thinking skills in the context of biology and physics. We use two research-based standardized critical thinking instruments known as the Biology Lab Inventory of Critical Thinking in Ecology (Eco-BLIC) and Physics Lab Inventory of Critical Thinking (PLIC). These instruments provide experimental scenarios and pose questions asking students to evaluate what to trust and what to do regarding the quality of experimental designs and data. Using more than 3000 student responses from over 20 institutions, we sought to understand what features of the assessment questions elicit student critical thinking. Specifically, we investigated (a) how students critically evaluate aspects of research studies in biology and physics when they are individually evaluating one study at a time versus comparing and contrasting two and (b) whether individual evaluation questions are needed to encourage students to engage in critical thinking when comparing and contrasting. We found that students are more critical when making comparisons between two studies than when evaluating each study individually. Also, compare-and-contrast questions are sufficient for eliciting critical thinking, with students providing similar answers regardless of if the individual evaluation questions are included. This research offers new insight on the types of assessment questions that elicit critical thinking at the introductory undergraduate level; specifically, we recommend instructors incorporate more compare-and-contrast questions related to experimental design in their courses and assessments. 
    more » « less
  5. Measurements in quantum mechanics are often taught in an abstract, theoretical context. Compared to what is known about student understanding of experimental data in classical mechanics, it is unclear how students think about measurement and uncertainty in the context of experimental data from quantum mechanical systems. In this paper, we tested how students interpret the variability in data from hypothetical experiments in classical and quantum mechanics. We conducted semi-structured interviews with 20 students who had taken quantum mechanics courses and analyzed to which sources they attribute variability in the data. We found that in the quantum mechanics context, most students interpret any variability in the data as irreducible and inherent to the theory. While acknowledging the influence of experimenter error, limited resolution of measurement equipment, and confounding variables (like air resistance) in classical mechanics, many students did not recognize the influence of such effects in quantum mechanics. Some students expressed the view that there are inherently fewer confounding variables in Quantum Mechanics and the equipment used is more precise. We derive tentative implications for instruction and propose further research to test the influence of framing on the responses to our interview protocol. 
    more » « less