skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Making expert cognitive processes visible: planning and preliminary analysis in theoretical physics research
Many of the activities and cognitive processes that physicists use while solving problems are "invisible" to students, which can hinder their acquisition of important expert-like skills. Whereas the detailed calculations performed by researchers are often published in journals and textbooks, other activities such as those undertaken while planning how to approach a problem are rarely discussed in published research. Hence, these activities are especially hidden from students. To better understand how physicists solve problems in their professional research, we leveraged the framework of cognitive task analysis to conduct semi-structured interviews with theoretical physicists (N=11). Here we elucidate the role of planning and preliminary analysis in theorists' work. Theorists described using a variety of activities in order to decide if their project was doable while also generating possible solution paths. These actions included doing cursory calculations, reflecting on previous knowledge, gaining intuition and understanding by studying prior work, and reproducing previous results. We found that theorists typically did not pursue projects unless they had a clear idea of what the outcome of their project would be, or at least knew that they would be able to make progress on the problem. Thus, this preliminary design and analysis phase was highly important for theorists despite being largely hidden from students. We conclude by suggesting potential ways to incorporate our findings into the classroom to give students more numerous opportunities to engage in these expert-like practices.  more » « less
Award ID(s):
1846321
PAR ID:
10409048
Author(s) / Creator(s):
; ; ;
Editor(s):
Frank, Brian W.; Jones, Dyan L.; Ryan, Qing X.
Date Published:
Journal Name:
Physics Education Research Conference 2022
Page Range / eLocation ID:
469 to 474
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper describes the results from an ongoing project where hands-on models and associated activities are integrated throughout an undergraduate statics course with the goal of deepening students’ conceptual understanding, scaffolding spatial skills, and therefore developing representational competence with foundational concepts such as vectors, forces, moments, and free-body diagrams. Representational competence refers to the fluency with which a subject expert can move between different representations of a concept (e.g. mathematical, symbolic, graphical, 2D vs. 3D, pictorial) as appropriate for communication, reasoning, and problem solving. This study sought to identify the characteristics of modeling activities that make them effective for all learners. Student volunteers engaged in individual interviews in which they solved problems that included 2D diagrams, 3D models, and worked calculations. Participating students had prior experience with the models and related activity sheets earlier in the course. Data was collected at the end of the quarter and the activities emphasized conceptual understanding. Thematic analysis was used to develop codes and identify themes in students’ use of the models as it relates to developing representational competence. Students used the models in a variety of ways. They wrote directly on the models, touched and gestured with the model, adjusted components, and observed the model from multiple orientations. They added new elements and deconstructed the models to feel the force or imagine how measurements would be impacted if one parameter was changed while all others held constant. In interviews students made connections to previous courses as well as previous activities and experiences with the models. In addition to using the 3D models, participants also used more than one representation (e.g. symbolic or 2D diagram) to solve problems and communicate thinking. While the use of models and manipulatives is commonplace in mechanics instruction, this work seeks to provide more nuanced information about how students use these learning aids to develop and reinforce their own understanding of key concepts. The authors hope these findings will be useful for others interested in designing and refining hands-on mechanics activities toward specific learning goals. 
    more » « less
  2. Abstract This paper describes the results from an ongoing project where hands-on models and associated activities are integrated throughout an undergraduate statics course with the goal of deepening students’ conceptual understanding, scaffolding spatial skills, and therefore developing representational competence with foundational concepts such as vectors, forces, moments, and free-body diagrams. Representational competence refers to the fluency with which a subject expert can move between different representations of a concept (e.g. mathematical, symbolic, graphical, 2D vs. 3D, pictorial) as appropriate for communication, reasoning, and problem solving. This study sought to identify the characteristics of modeling activities that make them effective for all learners. Student volunteers engaged in individual interviews in which they solved problems that included 2D diagrams, 3D models, and worked calculations. Participating students had prior experience with the models and related activity sheets earlier in the course. Data was collected at the end of the quarter and the activities emphasized conceptual understanding. Thematic analysis was used to develop codes and identify themes in students’ use of the models as it relates to developing representational competence. Students used the models in a variety of ways. They wrote directly on the models, touched and gestured with the model, adjusted components, and observed the model from multiple orientations. They added new elements and deconstructed the models to feel the force or imagine how measurements would be impacted if one parameter was changed while all others held constant. In interviews students made connections to previous courses as well as previous activities and experiences with the models. In addition to using the 3D models, participants also used more than one representation (e.g. symbolic or 2D diagram) to solve problems and communicate thinking. While the use of models and manipulatives is commonplace in mechanics instruction, this work seeks to provide more nuanced information about how students use these learning aids to develop and reinforce their own understanding of key concepts. The authors hope these findings will be useful for others interested in designing and refining hands-on mechanics activities toward specific learning goals. 
    more » « less
  3. [This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few investigations of at the graduate level. Additionally, existing studies of learning in physics graduate programs frequently focus on content knowledge rather than professional skills such as problem solving. Given that over 90% of physics Ph.D. graduates report solving technical problems regularly in the workplace, we sought to develop an assessment to measure how well graduate programs are training students to solve problems. Using a framework that characterizes expert-like problem-solving skills as a set of decisions to be made, we developed and validated such an assessment in graduate quantum mechanics (QM) following recently developed design frameworks for measuring problem solving and best practices for assessment validation. We collected validity evidence through think-aloud interviews with practicing physicists and physics graduate students, as well as written solutions provided by physics graduate and undergraduate students. The assessment shows strong potential in differentiating novice and expert problem solving in QM and showed reliability in repeated testing with similar populations. These results show the promise of measuring expert decision making in graduate QM and provide baseline measurements for future educational interventions to more effectively teach these skills. Published by the American Physical Society2025 
    more » « less
  4. In preparing engineering students for the workplace, capstone classes provide unique opportunities for students to develop their professional identities and learn critical skills such as engineering design, teamwork, and self-directed learning (Lutz & Paretti). But while existing research explores what and how students learn within these courses, we know much less about how capstone courses affect students’ transitions into the workplace. To address this gap, we are following 62 new graduates across 4 institutions during the participants’ first 12 weeks of work. Participants were drawn from 3 mechanical engineering programs and one general engineering program. Women were intentionally oversampled in the study, with 29 participants identifying as female. Weekly surveys were used to collect quantitative data on what types of workplace activities participants engaged in (e.g., team meetings, project budgeting, CAD modeling, engineering calculations) and qualitative data on what challenges they experience in their early work experience. In this paper, we present a descriptive analysis of the data to identify patterns across participants. Preliminary analysis of the quantitative data suggests that the most common activities for our participants were team meetings and project planning (mentioned by >70% of participants) compared to formal presentations and project budgeting (mentioned by <30% of participants). Preliminary analysis of the qualitative data suggests that participants’ most challenging experiences clustered into two dominant groups: 1) self-directed learning, and 2) teamwork and communication. The results are intended to inform both capstone faculty and industry to identify areas of strength within current practices and areas for improvement in course design and structure and/or in industry onboarding practices. 
    more » « less
  5. null (Ed.)
    Whether to engage student preconceptions to facilitate conceptual change is an area of debate among conceptual change theorists. Here, we evaluate the efficacy of a preconceptions-based instructional sequence about groundwater previously described by (Arthurs, 2019). To assess the impact this instructional sequence had on facilitating the development of more expert-like mental models about groundwater among college students, this research is rooted in the design study methodology and framed within the knowledge integration perspective of conceptual change. The relation of the instructional sequence to conceptual change is investigated in terms of cognitive, temporal, and social considerations. Students’ responses to items in in-class activities, homework, exams, and pre- and post-course surveys; the instructor’s lesson plans and notes; and classroom observations provide evidence of the preconceptions-based instructional sequence’s impact. We conclude the sequence has a significant positive impact on facilitating conceptual change for a range of student demographics, including gender and race. 
    more » « less