skip to main content


Title: Measuring problem-solving skills with virtual reality
Problem-solving is an iterative process that requires brainstorming, analysis of the problem, development and testing of solutions. It relies on under-standing what is known and what is unknown about the problem. That knowledge of the knowns and unknowns is called metacognition. Today’s engineers must understand their own metacognition and that of other team members to derive the best solutions for engineering problems given the different constraints. Engineers working in design and manufacturing fields confront challenges due to a lack of important metacognitive understanding of their own and their team’s problem-solving skills. This research suggests measuring metacognition within teams by using manufacturing simulations with virtual reality and eye tracking  more » « less
Award ID(s):
1830741
NSF-PAR ID:
10133726
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Industrial engineer
Volume:
52
Issue:
2
ISSN:
2168-9210
Page Range / eLocation ID:
40-45
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Metacognition is the understanding of your own knowledge including what knowledge you do not have and what knowledge you do have. This includes knowledge of strategies and regulation of one’s own cognition. Studying metacognition is important because higher-order thinking is commonly used, and problem-solving skills are positively correlated with metacognition. A positive previous disposition to metacognition can improve problem-solving skills. Metacognition is a key skill in design and manufacturing, as teams of engineers must solve complex problems. Moreover, metacognition increases individual and team performance and can lead to more original ideas. This study discusses the assessment of metacognitive skills in engineering students by having the students participate in hands-on and virtual reality activities related to design and manufacturing. The study is guided by two research questions: (1) do the proposed activities affect students’ metacognition in terms of monitoring, awareness, planning, self-checking, or strategy selection, and (2) are there other components of metacognition that are affected by the design and manufacturing activities? The hypothesis is that the participation in the proposed activities will improve problem-solving skills and metacognitive awareness of the engineering students. A total of 34 undergraduate students participated in the study. Of these, 32 were male and 2 were female students. All students stated that they were interested in pursuing a career in engineering. The students were divided into two groups with the first group being the initial pilot run of the data. In this first group there were 24 students, in the second group there were 10 students. The groups’ demographics were nearly identical to each other. Analysis of the collected data indicated that problem-solving skills contribute to metacognitive skills and may develop first in students before larger metacognitive constructs of awareness, monitoring, planning, self-checking, and strategy selection. Based on this, we recommend that the problem-solving skills and expertise in solving engineering problems should be developed in students before other skills emerge or can be measured. While we are sure that the students who participated in our study have awareness as well as the other metacognitive skills in reading, writing, science, and math, they are still developing in relation to engineering problems. 
    more » « less
  2. Engineering judgement has become an increasingly more important skill for engineers as engineering problem solving has grown more complex and reliant on technology. Judging the feasibility of solutions is required to solve 21st century problems, making this an essential 21st century engineering skill. Those tasked with preparing the future engineering workforce should avoid educating students to become rote learners who simply take output at face value without critical analysis. Engineering educators need to instead focus efforts toward developing students with improved engineering judgement, specifically engineering intuition. The project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? The idea or notion of engineering intuition is based in literature from nursing (Smith) and management (Simon) and links expert development to intuition (Dreyfus). This literature is used to support the hypothesis that engineering intuition is defined as the ability to: 1) assess whether engineering solutions are reasonable or ridiculous, and 2) predict outcomes and/or options within an engineering scenario. We seek to answer research questions 1-3 using interviews with engineering practitioners at various stages in their careers (early to retired). These interviews will allow us to construct a modified definition of engineering intuition and identify related constructs. These results will be leveraged to subsequently create an instrument to reliably measure intuition. The ultimate goal of this project is to use what is learned via research to create classroom practices that improve students’ ability to develop, recognize, and improve their own engineering intuition. Select References: Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64. 
    more » « less
  3. Engineering judgement has become an increasingly more important skill for engineers as engineering problem solving has grown more complex and reliant on technology. Judging the feasibility of solutions is required to solve 21st century problems, making this an essential 21st century engineering skill. Those tasked with preparing the future engineering workforce should avoid educating students to become rote learners who simply take output at face value without critical analysis. Engineering educators need to instead focus efforts toward developing students with improved engineering judgement, specifically engineering intuition. The project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? The idea or notion of engineering intuition is based in literature from nursing (Smith) and management (Simon) and links expert development to intuition (Dreyfus). This literature is used to support the hypothesis that engineering intuition is defined as the ability to: 1) assess whether engineering solutions are reasonable or ridiculous, and 2) predict outcomes and/or options within an engineering scenario. We seek to answer research questions 1-3 using interviews with engineering practitioners at various stages in their careers (early to retired). These interviews will allow ability to develop, recognize, and improve their own engineering intuition. Select References: Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64. 
    more » « less
  4. The devastation caused by recent natural disasters, such as earthquakes, tsunamis, and hurricanes, has increased awareness regarding the importance of providing interdisciplinary solutions to complex infrastructure challenges. In October 2018, the University of Puerto Rico received a Hispanic Serving Institution (HSI) collaborative award from the National Science Foundation (NSF) to develop an integrated curriculum on resilient and sustainable infrastructure. The project titled “Resilient Infrastructure and Sustainability Education – Undergraduate Program (RISE-UP) aims to educate future environmental designers and engineers to design and build a more resilient and sustainable infrastructure for Puerto Rico. This paper presents the design, initial implementation, and assessment of a curriculum encompassing synergistic interactions among these four domains: integrated project delivery, user-centered design, interdisciplinary problem-solving, and sustainability and resiliency. The project seeks to foster interdisciplinary problem-solving skills involving architects, engineers and construction managers, in order to better prepare them to face and provide solutions to minimize the impact of extreme natural environment events on infrastructure. The new curriculum stresses on problem-settings, the role that participants have on defining the characteristics of the problems that have to be solved, learning in action, reflecting on the process, and communication between the different stakeholders. This multisite and interdisciplinary program provides students with the necessary support, knowledge, and skills necessary to design and build resilient and sustainable infrastructure. This instructional endeavor consists of four courses designed to reduce gradually the difference between what students are able to accomplish with support structures and what students are able to accomplish on their own. To maximize and enhance the educational experience, the program blends a technology-infused classroom learning with broad co-curricular opportunities such as site visits, undergraduate research, and internships. As students advance in the program, they will be exposed and required to perform increasingly complex tasks. During the first year of the program, the following outcomes were achieved: 1) implementation of the faculty teamwork process to develop courses and analyze cases from an interdisciplinary perspective, 2) development and approval of an interdisciplinary curriculum on resilient and sustainable infrastructure, 3) development of case studies on situations associated with disaster and interdisciplinary responses, 4) development of a case study database, 5) establishment of an Advisory Board with government agency representatives and faculty, and 6) recruitment and enrollment of 30 students as the first RISE-UP cohort. In summary, the body of knowledge acquired from this project can serve as a model that can be replicated to develop and enhance academic programs at other institutions. 
    more » « less
  5. Engineering problem solving has become more complex and reliant on technology making engineering judgement an increasingly important and essential skill for engineers. Educators need to ensure that students do not become rote learners with little ability to critically analyze the result of solutions. This suggests that greater focus should be placed on developing engineering judgement, specifically engineering intuition, in our students who will be the future engineering workforce. This project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? Literature from the fields of nursing (Smith), management (Simon), and expertise development (Dreyfus) suggest intuition plays a role in both decision making and becoming an expert. This literature is used to support our definition of engineering intuition which is defined as the ability to: 1) assess the feasibility of a solution or response, and 2) predict outcomes and/or options within an engineering scenario (Authors). This paper serves as an update on the progress of our work to date. The first three research questions have been addressed through interviews with engineering practitioners at various stages in their careers, from early career to retired. Emergent findings have allowed us to construct a modified definition of engineering intuition, while also identifying related constructs. In Spring 2021, we created and tested an instrument to measure intuition. This instrument was re-deployed in Fall 2021. Preliminary results from the project’s qualitative and quantitative efforts will be presented. Our ultimate aim of this project is to inform the creation of classroom practices that improve students’ ability to develop, recognize, and improve their own engineering intuition. Select References: Authors (2020). Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64. 
    more » « less