skip to main content
Explore Scholarly Publications and Datasets in the NSF-PAR

Title: Defining and Assessing Systems Thinking in Diverse Engineering Populations
Engineers are called to play an important role in addressing the complex problems of our global society, such as climate change and global health care. In order to adequately address these complex problems, engineers must be able to identify and incorporate into their decision making relevant aspects of systems in which their work is contextualized, a skill often referred to as systems thinking. However, within engineering, research on systems thinking tends to emphasize the ability to recognize potentially relevant constituent elements and parts of an engineering problem, rather than how these constituent elements and parts are embedded in broader economic, sociocultural, and temporal contexts and how all of these must inform decision making about problems and solutions. Additionally, some elements of systems thinking, such as an awareness of a particular sociocultural context or the coordination of work among members of a cross-disciplinary team, are not always recognized as core engineering skills, which alienates those whose strengths and passions are related to, for example, engineering systems that consider and impact social change. Studies show that women and minorities, groups underrepresented within engineering, are drawn to engineering in part for its potential to address important social issues. Emphasizing the importance of systems more » thinking and developing a more comprehensive definition of systems thinking that includes both constituent parts and contextual elements of a system will help students recognize the relevance and value of these other elements of engineering work and support full participation in engineering by a diverse group of students. We provide an overview of our study, in which we are examining systems thinking across a range of expertise to develop a scenario-based assessment tool that educators and researchers can use to evaluate engineering students’ systems thinking competence. Consistent with the aforementioned need to define and study systems thinking in a comprehensive, inclusive manner, we begin with a definition of systems thinking as a holistic approach to problem solving in which linkages and interactions of the immediate work with constituent parts, the larger sociocultural context, and potential impacts over time are identified and incorporated into decision making. In our study, we seek to address two key questions: 1) How do engineers of different levels of education and experience approach problems that require systems thinking? and 2) How do different types of life, educational, and work experiences relate to individuals’ demonstrated level of expertise in solving systems thinking problems? Our study is comprised of three phases. The first two phases include a semi-structured interview with engineering students and professionals about their experiences solving a problem requiring systems thinking and a think-aloud interview in which participants are asked to talk through how they would approach a given engineering scenario and later reflect on the experiences that inform their thinking. Data from these two phases will be used to develop a written assessment tool, which we will test by administering the written instrument to undergraduate and graduate engineering students in our third study phase. Our paper describes our study design and framing and includes preliminary findings from the first phase of our study. « less
Authors:
; ;
Award ID(s):
1733665
Publication Date:
NSF-PAR ID:
10105632
Journal Name:
Proceedings of the American Society for Engineering Education Conference
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ( , ASEE Annual Conference proceedings)
    One of the main skills of engineers is to be able to solve problems. It is generally recognized that real-world engineering problems are inherently ill-structured in that they are complex, defined by non-engineering constraints, are missing information, and contain conflicting information. Therefore, it is very important to prepare future engineering students to be able to anticipate the occurrence of such problems, and to be prepared to solve them. However, most courses are taught by academic professors and lecturers whose focus is on didactic teaching of fundamental principles and code-based design approaches leading to predetermined “right” answers. Most classroom-taught methods to solve well-structured problems and the methods needed to solve ill-structured problems are strikingly different. The focus of our current effort is to compare and contrast the problem solving approaches employed by students, academics and practicing professionals in an attempt to determine if students are developing the necessary skills to tackle ill-structured problems. To accomplish this, an ill-structured problem is developed, which will later be used to determine, based on analysis of oral and written responses of participants in semi-structured interviews, attributes of the gap between student, faculty, and professional approaches to ill-structured problem solving. Based on the results of thismore »analysis, we will identify what pedagogical approaches may limit and help students’ abilities to develop fully-formed solutions to ill-structured problems. This project is currently ongoing. This work-in-progress paper will present the study and proposed methods. Based on feedback obtained at the conference from the broader research community, the studies will be refined. The current phase includes three parts, (1) problem formulation; (2) protocol development; and (3) pilot study. For (1), two different ill-structured problems were developed in the Civil Engineering domain. The problem difficulty assessment method was used to determine the appropriateness of each problem developed for this study. For (2), a protocol was developed in which participants will be asked to first solve a simple problem to become familiar with the interview format, then are given 30 minutes to solve the provided ill-structured problem, following a semi-structured interview format. Participants will be encouraged to speak out loud and also write down what they are thinking and their thought processes throughout the interview period. Both (1) and (2) will next be used for (3) the pilot study. The pilot study will include interviewing three students, three faculty members and three professional engineers. Each participant will complete both problems following the same protocol developed. Post-interview discussion will be held with the pilot study participants individually to inquire if there were any portions of the tasks that are unclearly worded or could be improved to clarify what was being asked. Based on these results the final problem will be chosen and refined.« less
  2. ( , 2022 ASEE Annual Conference & Exposition)
    As problems become more complex, global, and interdisciplinary, engineers need to develop novel solutions and utilize resources, information, and tools in strategic and creative ways. Divergent thinking describes a process where multiple options, pathways, alternatives, or ideas are developed. For engineering students, divergent thinking can facilitate flexibility and expand opportunities considered when solving problems. To develop divergent thinking skills in engineering, we must understand how it is (and is not) facilitated in current engineering education experiences. Current pedagogy and resources available in engineering education on divergent thinking are limited. Thus, our research focused on exploring educational experiences in which students felt they considered divergent thinking. In this paper, we describe the iterative development of an interview protocol to elicit student experiences related to opportunities for divergent thinking. From the initial round of piloting, we found student awareness of divergent thinking was limited. Our findings highlight the need to structure questions in ways that align with students’ existing understandings of their engineering experiences. Our team made modifications to the protocol to address this, including using accessible terms to describe divergent thinking, asking students to describe one example project they remembered well, and. focusing questions within one step of the project selectedmore »by the student as most relevant to their exploration of alternatives. This iterative development of the protocol was successful in eliciting divergent thinking experiences across their work.« less
  3. ; ( , ASEE Annual Conference proceedings)
    This is a research study that investigates the range of conceptions of prototyping in engineering design courses through exploring the conceptions and implementations from the instructors’ perspective. Prototyping is certainly an activity central to engineering design. The context of prototyping to support engineering education and practice has a range of implementations in an undergraduate engineering curriculum, from first-year engineering to capstone engineering design experiences. Understanding faculty conceptions’ of the reason, purpose, and place of prototyping can help illustrate how teaching and learning of the engineering design process is realistically implemented across a curriculum and how students are prepared for work practice. We seek to understand, and consequently improve, engineering design teaching and learning, through transformations of practice that are based on engineering education research. In this exploratory study, we interviewed three faculty members who teach engineering design in project-based learning courses across the curriculum of an undergraduate engineering program. This builds on related work done by the authors that previously investigated undergraduate engineering students’ conceptions of prototyping activities and process. With our instructor participants, a similar interview protocol was followed through semi-structured qualitative interviews. Data analysis has been undertaken through an emerging thematic analysis of these interview transcripts. Early findingsmore »characterize the focus on teaching the design process; the kind of feedback that the educators provide on students’ prototypes; students’ behavior while working on design projects; and educators’ perspectives on the design course. Understanding faculty conceptions with students’ conceptions of prototyping can shed light on the efficacy of using prototyping as an authentic experience in design teaching and learning. In project-based learning courses, particular issues of authenticity and assessment are under consideration, especially across the curriculum. More specifically, “proportions of problems” inform “problem solving” as one of the key characteristics in design thinking, teaching and learning. More attention to prototyping as part of the study of problem-solving processes can be useful to enhance understanding of the impact of instructional design. Challenges for teaching engineering design exist, and may be due to difficulties in framing design problems, recognizing what expertise students possess, and assessing their expertise to help them reach their goals, all at an appropriate place and ambiguity with student learning goals. Initial findings show that prototyping activities can help students become more reflective on their design. Scaffolded activities in prototyping can support self-regulated learning by students. The range of support and facilities, such as campus makerspaces, may also help students and instructors alike develop industry-ready engineering students.« less
  4. ; ; ; ; ; ; ( , 2022 ASEE Annual Conference & Exposition)
    Engineering problem solving has become more complex and reliant on technology making engineering judgement an increasingly important and essential skill for engineers. Educators need to ensure that students do not become rote learners with little ability to critically analyze the result of solutions. This suggests that greater focus should be placed on developing engineering judgement, specifically engineering intuition, in our students who will be the future engineering workforce. This project is focused on the following four research questions: 1) What are practicing professional engineers’ perceptions of discipline specific intuition and its use in the workplace? 2) Where does intuition manifest in expert engineer decision-making and problem-solving processes? 3) How does the motivation and identity of practicing professional engineers relate to discipline-specific intuition? 4) What would an instrument designed to validly and reliably measure engineering intuition look like? Literature from the fields of nursing (Smith), management (Simon), and expertise development (Dreyfus) suggest intuition plays a role in both decision making and becoming an expert. This literature is used to support our definition of engineering intuition which is defined as the ability to: 1) assess the feasibility of a solution or response, and 2) predict outcomes and/or options within an engineering scenariomore »(Authors). This paper serves as an update on the progress of our work to date. The first three research questions have been addressed through interviews with engineering practitioners at various stages in their careers, from early career to retired. Emergent findings have allowed us to construct a modified definition of engineering intuition, while also identifying related constructs. In Spring 2021, we created and tested an instrument to measure intuition. This instrument was re-deployed in Fall 2021. Preliminary results from the project’s qualitative and quantitative efforts will be presented. Our ultimate aim of this project is to inform the creation of classroom practices that improve students’ ability to develop, recognize, and improve their own engineering intuition. Select References: Authors (2020). Dreyfus, Stuart E., and Hubert L. Dreyfus. A five-stage model of the mental activities involved in directed skill acquisition. No. ORC-80-2. California Univ Berkeley Operations Research Center, 1980. Smith, Anita. "Exploring the legitimacy of intuition as a form of nursing knowledge." Nursing Standard (through 2013) 23.40 (2009): 35. Simon, Herbert A. "Making management decisions: The role of intuition and emotion." Academy of Management Perspectives 1.1 (1987): 57-64.« less
  5. ; ; ; ( , ASEE annual conference proceedings)
    Engineering identity is an integral determinant of academic success in engineering school, as it allows students to have an understanding of themselves in relation to what they study. Studies in engineering and other STEM disciplines have shown a positive correlation between identity and retention. Previous studies by Carlone and Johnson, Hazari, and Godwin have examined the following facets of a STEM or engineering identity: performance, competence, recognition and interest. While many current papers examine how culture and social interactions may influence identity, this paper examines how doing engineering coursework can uncover or influence a student’s engineering identity. This comparative case study examines how two students’ experiences solving an Open-ended Modeling Problem (OEMP) in their statics class may have contributed to their engineering identities. Cristina and Dylan, our two cases, both recalled how they solved a problem about a hands-free crutch device in an interview at the end of the semester. None of the questions were explicitly about identity. The interviews indicate that both students were interested in solving these problems and recognized themselves as being capable of solving the problem. In the case of Cristina, the problem helped her build confidence, both through her understanding of the material and hermore »problem solving abilities. Our results also saw both students discussing how the disciplinary authenticity made them ‘feel like an engineer.’ Implications of this work include a deeper understanding of how day-to-day problem solving within courses can influence engineering identity and may aid in understanding how certain activities and scaffolding can influence engineering identity. This is important as students who have strong engineering identities are more likely to stay in engineering, become competent engineers, and find success in their respective fields. This research can inform educators on the importance of assigning novel, ill-defined problems that require students to apply their critical thinking skills and logic skills in real world situations.« less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email