skip to main content


Title: Making expert cognitive processes visible: planning and preliminary analysis in theoretical physics research
Many of the activities and cognitive processes that physicists use while solving problems are "invisible" to students, which can hinder their acquisition of important expert-like skills. Whereas the detailed calculations performed by researchers are often published in journals and textbooks, other activities such as those undertaken while planning how to approach a problem are rarely discussed in published research. Hence, these activities are especially hidden from students. To better understand how physicists solve problems in their professional research, we leveraged the framework of cognitive task analysis to conduct semi-structured interviews with theoretical physicists (N=11). Here we elucidate the role of planning and preliminary analysis in theorists' work. Theorists described using a variety of activities in order to decide if their project was doable while also generating possible solution paths. These actions included doing cursory calculations, reflecting on previous knowledge, gaining intuition and understanding by studying prior work, and reproducing previous results. We found that theorists typically did not pursue projects unless they had a clear idea of what the outcome of their project would be, or at least knew that they would be able to make progress on the problem. Thus, this preliminary design and analysis phase was highly important for theorists despite being largely hidden from students. We conclude by suggesting potential ways to incorporate our findings into the classroom to give students more numerous opportunities to engage in these expert-like practices.  more » « less
Award ID(s):
1846321
NSF-PAR ID:
10409048
Author(s) / Creator(s):
; ; ;
Editor(s):
Frank, Brian W.; Jones, Dyan L.; Ryan, Qing X.
Date Published:
Journal Name:
Physics Education Research Conference 2022
Page Range / eLocation ID:
469 to 474
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Engineering problem solving has become more complex and reliant on technology making engineering judgement an increasingly important and essential skill for engineers. Educators need to ensure that students do not become rote learners with little ability to critically analyze the result of solutions. This suggests that greater focus should be placed on developing engineering judgement, specifically engineering intuition, in our students who will be the future engineering workforce. This project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? Literature from the fields of nursing (Smith), management (Simon), and expertise development (Dreyfus) suggest intuition plays a role in both decision making and becoming an expert. This literature is used to support our definition of engineering intuition which is defined as the ability to: 1) assess the feasibility of a solution or response, and 2) predict outcomes and/or options within an engineering scenario (Authors). This paper serves as an update on the progress of our work to date. The first three research questions have been addressed through interviews with engineering practitioners at various stages in their careers, from early career to retired. Emergent findings have allowed us to construct a modified definition of engineering intuition, while also identifying related constructs. In Spring 2021, we created and tested an instrument to measure intuition. This instrument was re-deployed in Fall 2021. Preliminary results from the project’s qualitative and quantitative efforts will be presented. Our ultimate aim of this project is to inform the creation of classroom practices that improve students’ ability to develop, recognize, and improve their own engineering intuition. Select References: Authors (2020). Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64. 
    more » « less
  2. This paper describes the results from an ongoing project where hands-on models and associated activities are integrated throughout an undergraduate statics course with the goal of deepening students’ conceptual understanding, scaffolding spatial skills, and therefore developing representational competence with foundational concepts such as vectors, forces, moments, and free-body diagrams. Representational competence refers to the fluency with which a subject expert can move between different representations of a concept (e.g. mathematical, symbolic, graphical, 2D vs. 3D, pictorial) as appropriate for communication, reasoning, and problem solving. This study sought to identify the characteristics of modeling activities that make them effective for all learners. Student volunteers engaged in individual interviews in which they solved problems that included 2D diagrams, 3D models, and worked calculations. Participating students had prior experience with the models and related activity sheets earlier in the course. Data was collected at the end of the quarter and the activities emphasized conceptual understanding. Thematic analysis was used to develop codes and identify themes in students’ use of the models as it relates to developing representational competence. Students used the models in a variety of ways. They wrote directly on the models, touched and gestured with the model, adjusted components, and observed the model from multiple orientations. They added new elements and deconstructed the models to feel the force or imagine how measurements would be impacted if one parameter was changed while all others held constant. In interviews students made connections to previous courses as well as previous activities and experiences with the models. In addition to using the 3D models, participants also used more than one representation (e.g. symbolic or 2D diagram) to solve problems and communicate thinking. While the use of models and manipulatives is commonplace in mechanics instruction, this work seeks to provide more nuanced information about how students use these learning aids to develop and reinforce their own understanding of key concepts. The authors hope these findings will be useful for others interested in designing and refining hands-on mechanics activities toward specific learning goals. 
    more » « less
  3. Abstract This paper describes the results from an ongoing project where hands-on models and associated activities are integrated throughout an undergraduate statics course with the goal of deepening students’ conceptual understanding, scaffolding spatial skills, and therefore developing representational competence with foundational concepts such as vectors, forces, moments, and free-body diagrams. Representational competence refers to the fluency with which a subject expert can move between different representations of a concept (e.g. mathematical, symbolic, graphical, 2D vs. 3D, pictorial) as appropriate for communication, reasoning, and problem solving. This study sought to identify the characteristics of modeling activities that make them effective for all learners. Student volunteers engaged in individual interviews in which they solved problems that included 2D diagrams, 3D models, and worked calculations. Participating students had prior experience with the models and related activity sheets earlier in the course. Data was collected at the end of the quarter and the activities emphasized conceptual understanding. Thematic analysis was used to develop codes and identify themes in students’ use of the models as it relates to developing representational competence. Students used the models in a variety of ways. They wrote directly on the models, touched and gestured with the model, adjusted components, and observed the model from multiple orientations. They added new elements and deconstructed the models to feel the force or imagine how measurements would be impacted if one parameter was changed while all others held constant. In interviews students made connections to previous courses as well as previous activities and experiences with the models. In addition to using the 3D models, participants also used more than one representation (e.g. symbolic or 2D diagram) to solve problems and communicate thinking. While the use of models and manipulatives is commonplace in mechanics instruction, this work seeks to provide more nuanced information about how students use these learning aids to develop and reinforce their own understanding of key concepts. The authors hope these findings will be useful for others interested in designing and refining hands-on mechanics activities toward specific learning goals. 
    more » « less
  4. Engineering judgement has become an increasingly more important skill for engineers as engineering problem solving has grown more complex and reliant on technology. Judging the feasibility of solutions is required to solve 21st century problems, making this an essential 21st century engineering skill. Those tasked with preparing the future engineering workforce should avoid educating students to become rote learners who simply take output at face value without critical analysis. Engineering educators need to instead focus efforts toward developing students with improved engineering judgement, specifically engineering intuition. The project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? The idea or notion of engineering intuition is based in literature from nursing (Smith) and management (Simon) and links expert development to intuition (Dreyfus). This literature is used to support the hypothesis that engineering intuition is defined as the ability to: 1) assess whether engineering solutions are reasonable or ridiculous, and 2) predict outcomes and/or options within an engineering scenario. We seek to answer research questions 1-3 using interviews with engineering practitioners at various stages in their careers (early to retired). These interviews will allow us to construct a modified definition of engineering intuition and identify related constructs. These results will be leveraged to subsequently create an instrument to reliably measure intuition. The ultimate goal of this project is to use what is learned via research to create classroom practices that improve students’ ability to develop, recognize, and improve their own engineering intuition. Select References: Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64. 
    more » « less
  5. Engineering judgement has become an increasingly more important skill for engineers as engineering problem solving has grown more complex and reliant on technology. Judging the feasibility of solutions is required to solve 21st century problems, making this an essential 21st century engineering skill. Those tasked with preparing the future engineering workforce should avoid educating students to become rote learners who simply take output at face value without critical analysis. Engineering educators need to instead focus efforts toward developing students with improved engineering judgement, specifically engineering intuition. The project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? The idea or notion of engineering intuition is based in literature from nursing (Smith) and management (Simon) and links expert development to intuition (Dreyfus). This literature is used to support the hypothesis that engineering intuition is defined as the ability to: 1) assess whether engineering solutions are reasonable or ridiculous, and 2) predict outcomes and/or options within an engineering scenario. We seek to answer research questions 1-3 using interviews with engineering practitioners at various stages in their careers (early to retired). These interviews will allow ability to develop, recognize, and improve their own engineering intuition. Select References: Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64. 
    more » « less