More Like this

1. Is it Rocket Science or Brain Science? Developing an Approach to Measure Engineering Intuition

   Miskioglu, E. ; Martin, K. M. ; Carberry, A. R. ; Bolton, C. ; Aaron, C. ( January 2021 , ASEE Annual Conference proceedings)

   Engineering judgement has become an increasingly more important skill for engineers as engineering problem solving has grown more complex and reliant on technology. Judging the feasibility of solutions is required to solve 21st century problems, making this an essential 21st century engineering skill. Those tasked with preparing the future engineering workforce should avoid educating students to become rote learners who simply take output at face value without critical analysis. Engineering educators need to instead focus efforts toward developing students with improved engineering judgement, specifically engineering intuition. The project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? The idea or notion of engineering intuition is based in literature from nursing (Smith) and management (Simon) and links expert development to intuition (Dreyfus). This literature is used to support the hypothesis that engineering intuition is defined as the ability to: 1) assess whether engineeringmore »solutions are reasonable or ridiculous, and 2) predict outcomes and/or options within an engineering scenario. We seek to answer research questions 1-3 using interviews with engineering practitioners at various stages in their careers (early to retired). These interviews will allow ability to develop, recognize, and improve their own engineering intuition. Select References: Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64.« less
2. Update on is it Rocket Science or Brain Science? Developing an Approach to Measure Engineering Intuition

   Miskioglu, Elif ; Carberry, Adam ; Martin, Kaela ; Kavale, Sanjeev ; Bolton, Caroline ; Aaron, Caitlyn ; Roth, Madeline ( August 2022 , 2022 ASEE Annual Conference & Exposition)

   Engineering problem solving has become more complex and reliant on technology making engineering judgement an increasingly important and essential skill for engineers. Educators need to ensure that students do not become rote learners with little ability to critically analyze the result of solutions. This suggests that greater focus should be placed on developing engineering judgement, specifically engineering intuition, in our students who will be the future engineering workforce. This project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? Literature from the fields of nursing (Smith), management (Simon), and expertise development (Dreyfus) suggest intuition plays a role in both decision making and becoming an expert. This literature is used to support our definition of engineering intuition which is defined as the ability to: 1) assess the feasibility of a solution or response, and 2) predict outcomes and/or options within an engineering scenariomore »(Authors). This paper serves as an update on the progress of our work to date. The first three research questions have been addressed through interviews with engineering practitioners at various stages in their careers, from early career to retired. Emergent findings have allowed us to construct a modified definition of engineering intuition, while also identifying related constructs. In Spring 2021, we created and tested an instrument to measure intuition. This instrument was re-deployed in Fall 2021. Preliminary results from the project’s qualitative and quantitative efforts will be presented. Our ultimate aim of this project is to inform the creation of classroom practices that improve students’ ability to develop, recognize, and improve their own engineering intuition. Select References: Authors (2020). Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64.« less
3. Predicting and Evaluating Engineering Problem Solving (PEEPS): Instrument Development

   Martin, Kaela M. ; Miskioglu, Elif ; Noble, Cooper ; McIntyre, Allison ; Bolton, Caroline ; Carberry, Adam R. ( December 2021 , Research in Engineering Education Symposium & Australasian Association for Engineering Education Conference)

   CONTEXT - Judging the feasibility of solutions has become an increasingly important engineering skill as engineering problem solving has become more complex and technology-dependent. Engineering education must take care to foster engineering judgement in our students to produce robust problem solvers primed to critically evaluate and interpret output. Our work uses expertise development and dual-cognition processing theories (Dreyfus & Dreyfus, 1980; Smith, 2009; Simon, 1987) to frame such engineering judgement as engineering intuition or the ability to assess the outcome of an engineering solution and predict outcomes within an engineering scenario (Miskioğlu and Martin, 2019). PURPOSE OR GOAL - Our overarching goal is to create classroom interventions that explicitly recognize and enhance the development of engineering intuition. Accomplishing this goal requires a means of measuring engineering intuition before and after such interventions. This paper discusses our process to develop the Predicting and Evaluating Engineering Problem Solving (PEEPS) tool for measuring engineering intuition. APPROACH OR METHODOLOGY/METHODS - PEEPS is built directly on our prior qualitative work with practicing engineers, which revealed the construct of engineering intuition (Aaron et al., 2020). The emergent findings were combined with questions adapted from the Concept Assessment Tool for Statics (Steif & Dantzler, 2005) to createmore »a preliminary survey assessing intuition. Additional items asked participants to assess their level of confidence in their answers. The survey was designed such that the statics problems could be switched out for other forms of engineering problems. Think-aloud sessions were used to check face validity and usability prior to full deployment in Spring 2021. ACTUAL OR ANTICIPATED OUTCOMES - This study details the process used to create PEEPS. Modifications were made following 19 think aloud sessions. The initial deployment in Spring 2021 resulted in 88 completed responses with responses primarily coming from white, male, aerospace engineering students who had previously performed well in their statics courses. CONCLUSIONS/RECOMMENDATIONS/SUMMARY - This work showcases a new survey designed to assess the engineering intuition of engineering students. Next steps include expanding the work to a more diverse sample of engineering students, further validity checks of the instrument, and pairing the instrument with newly created educational interventions designed to better foster engineering intuition development in students. KEYWORDS - engineering judgement, problem solving, survey development« less
4. Predicting and Evaluating Engineering Problem Solving (PEEPS): Instrument Development

   Martin, Kaela M. ; Miskioglu, Elif ; Noble, Cooper ; McIntyre, Allison ; Bolton, Caroline ; Carberry, Adam R. ( December 2021 , Research in Engineering Education Symposium & Australasian Association for Engineering Education Conference)

   CONTEXT - Judging the feasibility of solutions has become an increasingly important engineering skill as engineering problem solving has become more complex and technology-dependent. Engineering education must take care to foster engineering judgement in our students to produce robust problem solvers primed to critically evaluate and interpret output. Our work uses expertise development and dual-cognition processing theories (Dreyfus & Dreyfus, 1980; Smith, 2009; Simon, 1987) to frame such engineering judgement as engineering intuition or the ability to assess the outcome of an engineering solution and predict outcomes within an engineering scenario (Miskioğlu and Martin, 2019). PURPOSE OR GOAL - Our overarching goal is to create classroom interventions that explicitly recognize and enhance the development of engineering intuition. Accomplishing this goal requires a means of measuring engineering intuition before and after such interventions. This paper discusses our process to develop the Predicting and Evaluating Engineering Problem Solving (PEEPS) tool for measuring engineering intuition. APPROACH OR METHODOLOGY/METHODS - PEEPS is built directly on our prior qualitative work with practicing engineers, which revealed the construct of engineering intuition (Aaron et al., 2020). The emergent findings were combined with questions adapted from the Concept Assessment Tool for Statics (Steif & Dantzler, 2005) to createmore »a preliminary survey assessing intuition. Additional items asked participants to assess their level of confidence in their answers. The survey was designed such that the statics problems could be switched out for other forms of engineering problems. Think-aloud sessions were used to check face validity and usability prior to full deployment in Spring 2021. ACTUAL OR ANTICIPATED OUTCOMES - This study details the process used to create PEEPS. Modifications were made following 19 think aloud sessions. The initial deployment in Spring 2021 resulted in 88 completed responses with responses primarily coming from white, male, aerospace engineering students who had previously performed well in their statics courses. CONCLUSIONS/RECOMMENDATIONS/SUMMARY - This work showcases a new survey designed to assess the engineering intuition of engineering students. Next steps include expanding the work to a more diverse sample of engineering students, further validity checks of the instrument, and pairing the instrument with newly created educational interventions designed to better foster engineering intuition development in students. KEYWORDS - engineering judgement, problem solving, survey development« less
5. Work In Progress: Experts’ Perceptions of Engineering Intuition

   https://doi.org/10.18260/1-2--35633  

   Miskioğlu, Elif ; Martin, Kaela M. ; Carberry, Adam R. ( July 2020 , 2020 ASEE Virtual Annual Conference)

   This work in progress paper describes preliminary findings from interviews intending to develop a definition of and method for measuring “engineering intuition.” Engineers are asked regularly in their profession to judge situations and predict or estimate results in order to minimize the potential for error. The need for this ability has been amplified with the pervasiveness of computer-aided problem solving in engineering. It is now mandatory for practicing engineers to quickly and accurately evaluate software results as part of the problem-solving process. We hypothesize that the ability to undertake such actions is heavily influenced by discipline-specific intuition, which has been previously explored in the disciplines of nursing and business management. The following study presents preliminary results attempting to define the construct of “engineering intuition.” Semi-structured interviews with practicing nurses, business managers, and engineers were conducted using: 1) implicit discussion around intuition informed by literature, and 2) critical incident technique, i.e., explicit discussion around the concept of intuition. Each interview sought to identify practitioner decision-making and problem-solving processes on the job. The combined dataset and supporting literature are planned to be used as the basis of our future work, which ultimately aims to develop a psychometrically tested instrument capable of accuratelymore »measuring engineering intuition. Dissemination of these preliminary results are intended to elicit feedback on our methodologies and findings before moving to the second phase of our research study.« less