An official website of the United States government
There is currently little physics education literature examining thinking and learning in graduate education and even less literature characterizing problem solving among physics graduate students despite this being an essential professional skill for physicists. Given reports of discrepancies between physics problem solving in the undergraduate classroom and “real-world” problem solving, we sought to investigate whether this discrepancy exists at the graduate level. We first investigate the problem-solving skills present in first-year graduate physics assignments. A recent framework that characterizes problem solving as decisions-to-be-made was used. Assignments were taken from the four core courses of one academic year at one research-intensive university and coded by two researchers. We found that only 4 of the 29 decisions in the framework were present in most of the assignments. We then interviewed 11 instructors from 3 universities and asked which decisions they expected of first-year graduate students. Eleven decisions were expected by eight or more of the participants, but only four of these decisions were commonly practiced on assignments. Therefore, there seems to be a mismatch between instructor expectations and practice of problem solving on assignments. This suggests that graduate physics courses may not be aligned with the problem-solving skills that physics graduate students will need in their research or future careers. Published by the American Physical Society2025
more »
« less
This content will become publicly available on March 1, 2026
Assessment of expert decisions in graduate quantum mechanics
[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few investigations of at the graduate level. Additionally, existing studies of learning in physics graduate programs frequently focus on content knowledge rather than professional skills such as problem solving. Given that over 90% of physics Ph.D. graduates report solving technical problems regularly in the workplace, we sought to develop an assessment to measure how well graduate programs are training students to solve problems. Using a framework that characterizes expert-like problem-solving skills as a set of decisions to be made, we developed and validated such an assessment in graduate quantum mechanics (QM) following recently developed design frameworks for measuring problem solving and best practices for assessment validation. We collected validity evidence through think-aloud interviews with practicing physicists and physics graduate students, as well as written solutions provided by physics graduate and undergraduate students. The assessment shows strong potential in differentiating novice and expert problem solving in QM and showed reliability in repeated testing with similar populations. These results show the promise of measuring expert decision making in graduate QM and provide baseline measurements for future educational interventions to more effectively teach these skills. Published by the American Physical Society2025
more »
« less
- Award ID(s):
- 2429155
- PAR ID:
- 10584652
- Publisher / Repository:
- Physical Review Physics Education Research
- Date Published:
- Journal Name:
- Physical Review Physics Education Research
- Volume:
- 21
- Issue:
- 1
- ISSN:
- 2469-9896
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
[This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] We discuss an investigation of student sensemaking and reasoning in the context of degenerate perturbation theory (DPT) in quantum mechanics. We find that advanced undergraduate and graduate students in quantum physics courses often struggled with expertlike sensemaking and reasoning to solve DPT problems. The sensemaking and reasoning were particularly challenging for students as they tried to integrate physical and mathematical concepts to solve DPT problems. Their sensemaking showed local coherence but lacked global consistency with different knowledge resources getting activated in different problem-solving tasks even if the same concepts were applicable. Depending upon the issues involved in the DPT problems, students were sometimes stuck in the “physics mode” or “math mode” and found it challenging to coordinate and integrate the physics and mathematics appropriately to solve quantum mechanics problems involving DPT. Their sensemaking shows the use of various reasoning primitives. It also shows that some advanced students struggled with self-monitoring and checking their answers to make sure they were consistent across different problems. Some also relied on memorized information, invoked authority, and did not make appropriate connections between their DPT problem solutions and the outcomes of experiments. Advanced students in quantum mechanics often displayed analogous patterns of challenges in sensemaking and reasoning as those that have been found in introductory physics. Student sensemaking and reasoning show that these advanced students are still developing expertise in this novel quantum physics domain as they learn to integrate physical and mathematical concepts. Published by the American Physical Society2024more » « less
-
Over the course of the introductory calculus-based physics course, students are often expected to build conceptual understanding and develop and refine skills in problem solving and qualitative inferential reasoning. Many of the research-based materials developed over the past 30 years by the physics education research community use sequences of scaffolded questions to step students through a qualitative inferential reasoning chain. It is often tacitly assumed that, in addition to building conceptual understanding, such materials improve qualitative reasoning skills. However, clear documentation of the impact of such materials on qualitative reasoning skills is critical. New methodologies are needed to better study reasoning processes and to disentangle, to the extent possible, processes related to physics content from processes general to all human reasoning. As a result, we have employed network analysis methodologies to examine student responses to reasoning-related tasks in order to gain deeper insight into the nature of student reasoning in physics. In this paper, we show that network analysis metrics are both interpretable and valuable when applied to student reasoning data generated from . We also demonstrate that documentation of improvements in the articulation of specific lines of reasoning can be obtained from a network analysis of responses to reasoning chain construction tasks. Published by the American Physical Society2024more » « less
-
Despite knowing physics and astronomy doctoral programs are laden with identity-based inequities, they continue to push minoritized students to the margins. This qualitative social network analysis of 100 women and/or lesbian, gay, bisexual, transgender, queer, and more ( ) physics and astronomy Ph.D.’s explores how minoritized physics and astronomy students utilize social networks to navigate departmental exclusion. Our findings indicate that many of the participants’ identities were often unacknowledged or negatively addressed within their graduate education, with only four participants reporting a positive or favorable experience during this period of their career. Direct support from peers, faculty, and identity-based affinity groups was necessary for participants to navigate their educations. This study demonstrated that generic best practices often cannot fully support the diverse range of persons who come to physics and that identity-neutral values in physics further isolate students by insinuating that their own minoritized experiences are not valid. Published by the American Physical Society2024more » « less
-
[This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] One hallmark of expertise in physics is the ability to translate between different representations of knowledge and use the representations that make the problem-solving process easier. In quantum mechanics, students learn about several ways to represent quantum states, e.g., as state vectors in Dirac notation and as wave functions in position and momentum representation. Many advanced students in upper-level undergraduate and graduate quantum mechanics courses have difficulty translating state vectors in Dirac notation to wave functions in the position or momentum representation and vice versa. They also struggle when translating the wave function between the position and momentum representations. The research presented here describes the difficulties that students have with these concepts and how the research was used as a guide in the development, validation, and evaluation of a Quantum Interactive Learning Tutorial (QuILT) to help students develop a functional understanding of these concepts. The QuILT strives to help students with different representations of quantum states as state vectors in Dirac notation and as wave functions in position and momentum representation and with translating between these representations. We discuss the effectiveness of the QuILT from in-class implementation and evaluation. Published by the American Physical Society2024more » « less
