skip to main content


Title: WIP: Understanding Ambiguity in Engineering Problem Solving
This work in progress paper poses the research question: what are the qualitatively different ways that novice and expert engineers experience ambiguity? Engineers are frequently confronted with complex, unique, and challenging problems. Many of our most pressing engineering problems contain ambiguous elements, and a core activity of engineering is solving these complex problems effectively. We present a pilot study consisting of four in-depth interviews with senior civil engineering students. The data collection is ongoing; therefore, our results are not complete. Some preliminary categories of ambiguity have been identified. Once the data set is complete, we will analyze it using phenomenography in order to better understand the variations in these individuals’ experiences of ambiguity in engineering problem solving.  more » « less
Award ID(s):
1824610
NSF-PAR ID:
10174733
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
ASEE'S VIRTUAL CONFERENCE
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract— Engineers are frequently confronted with complex, unique, and challenging problems. Many of our most pressing engineering problems contain ambiguous elements, and a core activity of engineering is being able to solve these complex problems effectively. While engineering problems are often described as ambiguous, ambiguity has not been clearly defined in the literature in the context of engineering problem solving. This work-in-progress paper describes our initial results to understand how ambiguity is experienced during engineering problem solving. We interviewed both engineering students and engineering professionals about ambiguous problems they have encountered. We found that both groups identified technical ambiguity as the core element of engineering problem solving. They also described differences between classroom and workplace problems, with students describing classroom problems as “purposefully” ambiguous. Students had strong negative emotional reactions to ambiguity, in contrast to professionals who seemed to accept ambiguity as a common element in engineering problem. Our initial findings suggest that changes to engineering education practice that allow students to become comfortable with ambiguity would better prepare them for the ambiguous problems they will face in the workplace. Keywords—problem solving, ambiguity, qualitative 
    more » « less
  2. One of the main skills of engineers is to be able to solve problems. It is generally recognized that real-world engineering problems are inherently ill-structured in that they are complex, defined by non-engineering constraints, are missing information, and contain conflicting information. Therefore, it is very important to prepare future engineering students to be able to anticipate the occurrence of such problems, and to be prepared to solve them. However, most courses are taught by academic professors and lecturers whose focus is on didactic teaching of fundamental principles and code-based design approaches leading to predetermined “right” answers. Most classroom-taught methods to solve well-structured problems and the methods needed to solve ill-structured problems are strikingly different. The focus of our current effort is to compare and contrast the problem solving approaches employed by students, academics and practicing professionals in an attempt to determine if students are developing the necessary skills to tackle ill-structured problems. To accomplish this, an ill-structured problem is developed, which will later be used to determine, based on analysis of oral and written responses of participants in semi-structured interviews, attributes of the gap between student, faculty, and professional approaches to ill-structured problem solving. Based on the results of this analysis, we will identify what pedagogical approaches may limit and help students’ abilities to develop fully-formed solutions to ill-structured problems. This project is currently ongoing. This work-in-progress paper will present the study and proposed methods. Based on feedback obtained at the conference from the broader research community, the studies will be refined. The current phase includes three parts, (1) problem formulation; (2) protocol development; and (3) pilot study. For (1), two different ill-structured problems were developed in the Civil Engineering domain. The problem difficulty assessment method was used to determine the appropriateness of each problem developed for this study. For (2), a protocol was developed in which participants will be asked to first solve a simple problem to become familiar with the interview format, then are given 30 minutes to solve the provided ill-structured problem, following a semi-structured interview format. Participants will be encouraged to speak out loud and also write down what they are thinking and their thought processes throughout the interview period. Both (1) and (2) will next be used for (3) the pilot study. The pilot study will include interviewing three students, three faculty members and three professional engineers. Each participant will complete both problems following the same protocol developed. Post-interview discussion will be held with the pilot study participants individually to inquire if there were any portions of the tasks that are unclearly worded or could be improved to clarify what was being asked. Based on these results the final problem will be chosen and refined. 
    more » « less
  3. Tolerance for Ambiguity (TA) is the ability to seek out, enjoy, and excel in ambiguous tasks. This is a skill or mindset that today’s engineering graduates must possess in order to address the problems they must be prepared to solve—problems that are complex, fraught with uncertainty, and given to conflicting interpretations by varying constituents. It can be argued that students with a higher tolerance for ambiguity will be better suited to proactively engage in, enjoy, and excel in finding solutions to the contemporary problems faced by 21st-century engineers. In contrast, students with a lower tolerance for ambiguity may be unmotivated in the modern engineering work environment and struggle to perform well. Given this reality, pedagogical innovations shown to increase students’ tolerance for ambiguity have the potential to better prepare the future engineering workforce. However, there are few examples of how to do this in engineering and/or how to measure the effectiveness of our efforts. This paper briefly describes the development of a pedagogical intervention designed to increase sophomore engineering students’ tolerance for ambiguity. The context of this study is an undergraduate engineering statistics course offered by the Industrial Engineering department at a large university located in the southeast. Students will be given a large hypothetical data set that mimics real data the undergraduate student experience (e.g., GPAs, course completion rates), and asked to use the engineering design process to identify and solve a data-rich problem using statistical techniques they have learned in the course. Two well-established measures of TA were adapted for this study; the result of the face validity check will also be discussed. This paper closes with insights on how these measures will be used to evaluate the impact of the intervention. The findings of this study will not only advance our understanding of pedagogical strategies for fostering the development of this 21st century skill, but also give us meaningful ways to measure the effectiveness of our efforts. 
    more » « less
  4. Engineers are called to play an important role in addressing the complex problems of our global society, such as climate change and global health care. In order to adequately address these complex problems, engineers must be able to identify and incorporate into their decision making relevant aspects of systems in which their work is contextualized, a skill often referred to as systems thinking. However, within engineering, research on systems thinking tends to emphasize the ability to recognize potentially relevant constituent elements and parts of an engineering problem, rather than how these constituent elements and parts are embedded in broader economic, sociocultural, and temporal contexts and how all of these must inform decision making about problems and solutions. Additionally, some elements of systems thinking, such as an awareness of a particular sociocultural context or the coordination of work among members of a cross-disciplinary team, are not always recognized as core engineering skills, which alienates those whose strengths and passions are related to, for example, engineering systems that consider and impact social change. Studies show that women and minorities, groups underrepresented within engineering, are drawn to engineering in part for its potential to address important social issues. Emphasizing the importance of systems thinking and developing a more comprehensive definition of systems thinking that includes both constituent parts and contextual elements of a system will help students recognize the relevance and value of these other elements of engineering work and support full participation in engineering by a diverse group of students. We provide an overview of our study, in which we are examining systems thinking across a range of expertise to develop a scenario-based assessment tool that educators and researchers can use to evaluate engineering students’ systems thinking competence. Consistent with the aforementioned need to define and study systems thinking in a comprehensive, inclusive manner, we begin with a definition of systems thinking as a holistic approach to problem solving in which linkages and interactions of the immediate work with constituent parts, the larger sociocultural context, and potential impacts over time are identified and incorporated into decision making. In our study, we seek to address two key questions: 1) How do engineers of different levels of education and experience approach problems that require systems thinking? and 2) How do different types of life, educational, and work experiences relate to individuals’ demonstrated level of expertise in solving systems thinking problems? Our study is comprised of three phases. The first two phases include a semi-structured interview with engineering students and professionals about their experiences solving a problem requiring systems thinking and a think-aloud interview in which participants are asked to talk through how they would approach a given engineering scenario and later reflect on the experiences that inform their thinking. Data from these two phases will be used to develop a written assessment tool, which we will test by administering the written instrument to undergraduate and graduate engineering students in our third study phase. Our paper describes our study design and framing and includes preliminary findings from the first phase of our study. 
    more » « less
  5. Metacognition is the understanding of your own knowledge including what knowledge you do not have and what knowledge you do have. This includes knowledge of strategies and regulation of one’s own cognition. Studying metacognition is important because higher-order thinking is commonly used, and problem-solving skills are positively correlated with metacognition. A positive previous disposition to metacognition can improve problem-solving skills. Metacognition is a key skill in design and manufacturing, as teams of engineers must solve complex problems. Moreover, metacognition increases individual and team performance and can lead to more original ideas. This study discusses the assessment of metacognitive skills in engineering students by having the students participate in hands-on and virtual reality activities related to design and manufacturing. The study is guided by two research questions: (1) do the proposed activities affect students’ metacognition in terms of monitoring, awareness, planning, self-checking, or strategy selection, and (2) are there other components of metacognition that are affected by the design and manufacturing activities? The hypothesis is that the participation in the proposed activities will improve problem-solving skills and metacognitive awareness of the engineering students. A total of 34 undergraduate students participated in the study. Of these, 32 were male and 2 were female students. All students stated that they were interested in pursuing a career in engineering. The students were divided into two groups with the first group being the initial pilot run of the data. In this first group there were 24 students, in the second group there were 10 students. The groups’ demographics were nearly identical to each other. Analysis of the collected data indicated that problem-solving skills contribute to metacognitive skills and may develop first in students before larger metacognitive constructs of awareness, monitoring, planning, self-checking, and strategy selection. Based on this, we recommend that the problem-solving skills and expertise in solving engineering problems should be developed in students before other skills emerge or can be measured. While we are sure that the students who participated in our study have awareness as well as the other metacognitive skills in reading, writing, science, and math, they are still developing in relation to engineering problems. 
    more » « less