skip to main content


Title: A Qualitative Analysis of How a Student, Faculty, and Practicing Engineer Approach an Ill-structured Engineering Problem
Solving open-ended complex problems is an essential part of being an engineer and one of the qualities needed in an engineering workplace. In order to help undergraduate engineering students develop such qualities and better prepare them for their future careers, this study is a preliminary effort to explore the problem solving approaches adopted by a student, faculty, and practicing engineer in civil engineering. As part of an ongoing NSF-funded study, this paper qualitatively investigates how three participants solve an ill-structured engineering problem. This study is guided by the following research question: What are the similarities and differences between a student, faculty, and practicing engineer in the approach to solve an ill-structured engineering problem? Verbal protocol analysis was used to answer this research question. Participants were asked to verbalize their response while they worked on the proposed problem. This paper includes a detailed analysis of the observed problem solving processes of the participants. Our preliminary findings indicate some distinct differences between the student, professor, and practicing engineer in their problem solving approaches. The student and practicing engineer used their prior knowledge to develop a solution, while the faculty did not make any connection to outside knowledge. It was also observed that the faculty and practicing engineer spent a great deal of time on feasibility and safety issues, whereas the student spent more time detailing the tool that would be used as their solution. Through additional data collection and analysis, we will better understand the similarities and differences between students, professionals, and faculty in terms of how they approach an ill-structured problem. This study will provide insights that will lead to the development of ways to better prepare engineering students to solve complex problems.  more » « less
Award ID(s):
2013144
NSF-PAR ID:
10173161
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2020 ASEE Virtual Annual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Solving open-ended complex problems is an essential skill for part of being an engineer and a common activity in the one of the qualities needed in an engineering workplace. In order to help undergraduate engineering students develop such qualities and better prepare them for their future careers, this study is a preliminary effort to explore the problem solving approaches adopted by a student, faculty, and practicing engineer in civil engineering. As part of an ongoing NSF-funded study, this paper qualitatively investigates how three participants solve the following research question: What are the similarities and differences between a student, faculty, and practicing engineer in the approach to solve an ill-structured engineering problem? Verbal protocol analysis was used to answer this research question. Participants were asked to verbalize their response while they worked on the proposed problem. This paper includes a detailed analysis of the observed problem-solving processes of the participants. Our preliminary findings indicate some distinct differences between the student, professor, and practicing engineer in their problem-solving approaches. The student and practicing engineer used their prior knowledge to develop a solution, while the faculty did not make any connection to outside knowledge. It was also observed that the faculty and practicing engineer spent a great deal of time on feasibility and safety issues, whereas the student spent more time detailing the tool that would be used as their solution. Through additional data collection and analysis, we will better understand the similarities and differences between students, professionals, and faculty in terms of how they approach an ill-structured problem. This study will provide insights that will lead to the development of ways to better prepare engineering students to solve complex problems. 
    more » « less
  2. One of the main skills of engineers is to be able to solve problems. It is generally recognized that real-world engineering problems are inherently ill-structured in that they are complex, defined by non-engineering constraints, are missing information, and contain conflicting information. Therefore, it is very important to prepare future engineering students to be able to anticipate the occurrence of such problems, and to be prepared to solve them. However, most courses are taught by academic professors and lecturers whose focus is on didactic teaching of fundamental principles and code-based design approaches leading to predetermined “right” answers. Most classroom-taught methods to solve well-structured problems and the methods needed to solve ill-structured problems are strikingly different. The focus of our current effort is to compare and contrast the problem solving approaches employed by students, academics and practicing professionals in an attempt to determine if students are developing the necessary skills to tackle ill-structured problems. To accomplish this, an ill-structured problem is developed, which will later be used to determine, based on analysis of oral and written responses of participants in semi-structured interviews, attributes of the gap between student, faculty, and professional approaches to ill-structured problem solving. Based on the results of this analysis, we will identify what pedagogical approaches may limit and help students’ abilities to develop fully-formed solutions to ill-structured problems. This project is currently ongoing. This work-in-progress paper will present the study and proposed methods. Based on feedback obtained at the conference from the broader research community, the studies will be refined. The current phase includes three parts, (1) problem formulation; (2) protocol development; and (3) pilot study. For (1), two different ill-structured problems were developed in the Civil Engineering domain. The problem difficulty assessment method was used to determine the appropriateness of each problem developed for this study. For (2), a protocol was developed in which participants will be asked to first solve a simple problem to become familiar with the interview format, then are given 30 minutes to solve the provided ill-structured problem, following a semi-structured interview format. Participants will be encouraged to speak out loud and also write down what they are thinking and their thought processes throughout the interview period. Both (1) and (2) will next be used for (3) the pilot study. The pilot study will include interviewing three students, three faculty members and three professional engineers. Each participant will complete both problems following the same protocol developed. Post-interview discussion will be held with the pilot study participants individually to inquire if there were any portions of the tasks that are unclearly worded or could be improved to clarify what was being asked. Based on these results the final problem will be chosen and refined. 
    more » « less
  3. One of the main skills of engineers is to be able to solve problems. It is generally recognized that real-world engineering problems are inherently ill structured in that they are complex, defined by non-engineering constraints, are missing information, and contain conflicting information. Therefore, it is very important to prepare future engineering students to be able to anticipate the occurrence of such problems, and to be prepared to solve them. However, most courses are taught by academic professors and lecturers whose focus is on didactic teaching of fundamental principles and code-based design approaches leading to predetermined “right” answers. Most classroom taught methods to solve well-structured problems and the methods needed to solve ill-structured problems are strikingly different. The focus of our current effort is to compare and contrast the problem solving approaches employed by students, academics and practicing professionals in an attempt to determine if students are developing the necessary skills to tackle ill-structured problems. To accomplish this, an ill-structured problem is developed, which will later be used to determine, based on analysis of oral and written responses of participants in semi-structured interviews, attributes of the gap between student, faculty, and professional approaches to ill-structured problem solving. Based on the results of this analysis, we will identify what pedagogical approaches may limit and help students’ abilities to develop fully-formed solutions to ill-structured problems. 
    more » « less
  4. Creativity plays an important role in engineering problem solving, particularly when solving an ill-structured problem, and has been a topic of increasing research interest in recent years. Prior research on creativity has been conducted in problem solving settings, predominantly focusing on undergraduate engineering students, including how faculty can foster creativity in engineering students, how engineering faculty perceive their students’ creativity, and how to measure it. However, more work is needed to examine engineering faculty and practitioner perspectives on the role of creativity when they solve an engineering problem themselves. Since engineering students learn problem solving, at least initially, mainly from their professors, it is essential to understand how faculty perceive their own creativity in problem solving. Similarly, given that practitioners solve ill-structured engineering problems on a regular basis in the workplace and that most of the students go on to work in the engineering industry when they graduate and ultimately become practitioners, it is also important to explore practitioner perspectives on creativity in problem solving settings. As part of an ongoing NSF-funded study, this paper investigates how engineering faculty’s and practitioners’ creativity influences their problem solving processes, how their perspectives on creativity in a problem solving environment differ, and what factors impact their creativity. Five tenure-track faculty in civil engineering and five practitioners were interviewed after they solved an ill-structured engineering problem. Participants’ responses were transcribed and coded using initial coding. This paper discusses their responses to semi-structured interview questions. The findings suggest that faculty and practitioners feel more creative when they are familiar with the subject area of a problem. If they are aware of a particular solution that has been developed and used before or have access to resources to look them up, they may not necessarily embrace creativity. The findings indicated differences not only across faculty and practitioners but also within the faculty and practitioner participants. Similarities and differences between faculty and practitioners in creative problem solving and the themes emerged are discussed and recommendations for educators are provided. 
    more » « less
  5. Problem-solving is a critical skill in the workplace, but recent college graduates are often deficient in problem-solving skills. Introductory STEM courses present engineering students with well-structured problems with single-path solutions that do not prepare students with the problem-solving skills they will need to solve complex problems within authentic engineering contexts. When presented with complex problems in authentic contexts, engineering students find it difficult to transfer the scientific knowledge learned in their STEM courses to solve these integrated and ill structured problems. By integrating physics laboratories with engineering design problems, students are taught to apply physics principles to solve ill-structured and complex engineering problems. The integration of engineering design processes to physics labs is meant to help students transfer physics learning to engineering problems, as well as to transfer the design skills learned in their engineering courses to the physics lab. We hypothesize this integration will help students become better problem solvers when they go out to industry after graduation. The purpose of this study is to examine how students transfer their understanding of physics concepts to solve ill-structured engineering problems by means of an engineering design project in a physics laboratory. We use a case-study methodology to examine two cases and analyze the cases using a lens of co-regulated learning and transfer between physics and engineering contexts. Observations were conducted using transfer lenses. That is, we observed groups during the physics labs for evidence of transfer. The research question for this study was, to what extent do students relate physics concepts with concepts from other materials (classes) through an engineering design project incorporated in a physics laboratory? Teams were observed over the course of 6 weeks as they completed the second design challenge. The cases presented in this study were selected using observations from the lab instructors of the team’s work in the first design project. Two teams, one who performed well, and one that performed poorly, were selected to be observed to provide insight on how students use physics concepts to engage in the design process. The second design challenge asked students to design an eco-friendly way of delivering packages of food to an island located in the middle of the river, which is home to critically endangered species. They are given constraints that the solution cannot disrupt the habitat in any way, nor can the animals come into contact directly with humans or loud noises. Preliminary results indicate that both teams successfully demonstrated transfer between physics and engineering contexts, and integrated physics concepts from multiple labs to complete the design project. Teams that struggle seem to be less connected with the design process at the beginning of the project and are less organized. In contrast, teams that are successful demonstrate greater co-regulated learning (communication, reflection, etc.) and focus on making connections between the physics concepts and principles of engineering design from their engineering course work. 
    more » « less