skip to main content


Title: Design thinking among first‐year and senior engineering students: A cross‐sectional, national study measuring perceived ability
Abstract Background

Prior researchers developed an instrument to measure perceived design thinking ability of first‐year students interested in engineering, and they validated the instrument through exploratory factor analysis.

Purpose/Hypothesis

Our study uses the previously developed instrument to evaluate perceived design thinking ability of senior engineering students. We make a cross‐sectional comparison of this measure on a national scale.

Design/Method

We surveyed a national sample of senior engineering students in 2018 and conducted a cross‐sectional comparison with results from a 2012 national sample of first‐year students who were interested in declaring an engineering major. Two‐way analysis of variance tests compared average design thinking scores across sample groups. Confirmatory factor analysis was conducted to improve the design thinking instrument.

Results

First‐year students who intended to declare an engineering major score significantly higher (2.80) on the design thinking scale than senior engineering students (2.59) with a medium effect size of 0.4. The senior engineering sample performs significantly worse on the feedback seeking and experimentalism instrument items, but significantly better on the integrative thinking and collaboration items. We found no significant differences in perceived design thinking ability among engineering disciplines among senior students.

Conclusions

Feedback seeking and experimentalism are traits that engineering educators should develop in their students to improve perceived design thinking ability. Incorporation of user‐centered design and divergent thinking in the engineering classroom are recommended as avenues to foster feedback seeking and experimentalism. We also offer recommendations to improve the design thinking instrument for future research.

 
more » « less
Award ID(s):
1635534 1635204
NSF-PAR ID:
10126168
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Journal of Engineering Education
Volume:
109
Issue:
1
ISSN:
1069-4730
Page Range / eLocation ID:
p. 72-87
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The United Nation’s Sustainable Development Goals state climate change could irreversibly affect future generations and is one of the most urgent issues facing society. To date, most education research on climate change examines middle and high school students’ knowledge without considering the link between understanding and interest to address such issues in their career. In research on students’ attitudes about sustainability, we found that half of first-year college engineering students, in our nationally representative sample of all college students at 4-year institutions (n = 937), do not believe climate change is caused by humans. This lack of belief in human-caused climate change is a significant problem in engineering education because our results also indicate engineering students who do not believe in human caused climate change are less likely to want to address climate change in their careers. This dismal finding highlights a need for improving student understanding and attitudes toward climate change in order to produce engineers prepared and interested in solving complex global problems in sustainability. To advance understanding about students’ understanding of climate change and their agency to address the issue, we developed the CLIMATE survey to measure senior undergraduate engineering students’ Climate change literacy, engineering identity, career motivations, and agency through engineering. The survey was designed for students in their final senior design, or capstone course, just prior to entering the workforce. We developed the survey using prior national surveys and newly written questions categorized into six sections: (1) career goals and motivation, (2) college experiences, (3) agency, (4) climate literacy, (5) people and the planet, and (6) demographic information. We conducted focus groups with students to establish face and content validity of the survey. We collected pilot data with 200 engineering students in upper-level engineering courses to provide validity evidence for the use of these survey items to measure students and track changes across the undergraduate curriculum for our future work. In this paper, we narrate the development of the survey supported by literature and outline the next step for further validation and distribution on a national scale. Our intent is to receive feedback and input about the questions being asked and the CLIMATE instrument. Our objective is to share the nationally representative non-identifiable responses (the estimated goal is 4,000 responses) openly with education researchers interested in students understanding about climate change, their engineering identity, career motivations, and agency through engineering. Ultimately, we want this research to become a catalyst for teaching about topics related to climate change in engineering and its implications for sustainability. 
    more » « less
  2. The United Nation’s Sustainable Development Goals state climate change could irreversibly affect future generations and is one of the most urgent issues facing society. To date, most education research on climate change examines middle and high school students’ knowledge without considering the link between understanding and interest to address such issues in their career. In research on students’ attitudes about sustainability, we found that half of first-year college engineering students, in our nationally representative sample of all college students at 4-year institutions (n = 937), do not believe climate change is caused by humans. This lack of belief in human-caused climate change is a significant problem in engineering education because our results also indicate engineering students who do not believe in human caused climate change are less likely to want to address climate change in their careers. This dismal finding highlights a need for improving student understanding and attitudes toward climate change in order to produce engineers prepared and interested in solving complex global problems in sustainability. To advance understanding about students’ understanding of climate change and their agency to address the issue, we developed the CLIMATE survey to measure senior undergraduate engineering students’ Climate change literacy, engineering identity, career motivations, and agency through engineering. The survey was designed for students in their final senior design, or capstone course, just prior to entering the workforce. We developed the survey using prior national surveys and newly written questions categorized into six sections: (1) career goals and motivation, (2) college experiences, (3) agency, (4) climate literacy, (5) people and the planet, and (6) demographic information. We conducted focus groups with students to establish face and content validity of the survey. We collected pilot data with 200 engineering students in upper-level engineering courses to provide validity evidence for the use of these survey items to measure students and track changes across the undergraduate curriculum for our future work. In this paper, we narrate the development of the survey supported by literature and outline the next step for further validation and distribution on a national scale. Our intent is to receive feedback and input about the questions being asked and the CLIMATE instrument. Our objective is to share the nationally representative non-identifiable responses (the estimated goal is 4,000 responses) openly with education researchers interested in students understanding about climate change, their engineering identity, career motivations, and agency through engineering. Ultimately, we want this research to become a catalyst for teaching about topics related to climate change in engineering and its implications for sustainability. 
    more » « less
  3. In order to lead the social process required to solve society’s grandest challenges and ensure that the capabilities of an expanded engineering workforce are successfully harnessed, new engineers must be more than just technical experts, they must also be technical leaders. Thankfully, greater numbers of engineering educators are recognizing this need and are consequently establishing engineering leadership certificates, minors, and even full degree programs through centers at universities throughout the country. However, for these programs to reach their full potential, engineering educators must be successful in integrating leadership into the very identity of engineers. This study seeks to better understand the relationship between engineering identity and leadership, so tools can be developed that enable engineering educators to more effectively integrate leadership into an engineering identity. This paper explores this relationship using a national sample of 918 engineering students who participated in the 2013 College Senior Survey (CSS). The CSS is administered by the Higher Education Research Institute (HERI) at UCLA to college students at the end of their fourth year of college; data from the CSS are then matched to students’ prior responses on the 2009 Freshman Survey (TFS), which was administered when they first started college, to create a longitudinal sample. Using a leadership construct developed by HERI as the outcome variable, this work utilizes Hierarchical Linear Modelling (HLM) to examine the impact of engineering identity and a host of other factors shown to be important in college student development on leadership. HLM is especially appropriate since individual student cases are grouped by schools, and predictor variables include both student-level and institution-level variables. The leadership construct, referred to as leadership self-efficacy in this work, includes self-rated growth in leadership ability, self-rating of leadership ability relative to one’s peers, participation in a leadership role and/or leadership training, and perceived effectiveness leading an organization. The primary independent variable of interest was a factor measuring engineering identity comprised of items available on both the TFS and CSS instruments. Including this measure of engineering identity from two different time periods in the model provides the relationship between engineering identity in the fourth year and leadership self-efficacy, controlling for engineering identity in the first year as a pretest. Statistically significant results were found across each of the areas tested, including the fourth-year engineering identity factor as well as several collegiate experiences, pre-college experiences, major, and institutional variables. Taken together, these results present a nuanced picture of what matters to predicting leadership outcomes for undergraduate engineering students. For example, while engineering identity is a significant positive predictor of the leadership construct, computer engineers score lower than mechanical engineers on leadership, while interacting with faculty appears to enhance leadership self-efficacy. 
    more » « less
  4. The Project-Based Scientific Research is a new interdisciplinary course developed by the National Science Foundation (NSF - IUSE) funded STEM center at _______ State University. The implementation of this new course was one of the major three goals for this five year grant to strengthen the STEM undergraduate research community at ______ State University by helping undergraduates who are interested in hands-on and/or scientific research. The course is designed to introduce undergraduate junior and senior science, engineering technology and math students to the vibrant world of real research; to build foundational skills for research; to help STEM students meet potential mentors whose research labs they might join with the goal of gaining experimental research experience while on campus. On top of course content and requirements the following goals are aimed for the student and faculty mentors to strengthen the research community; (1) helping undergraduate students who are interested in research connect with faculty partners who are committed to mentoring undergraduates in research, (2) to guide students in reading through papers that introduce the type of research being carried out in a faculty partners lab, (3) to guide students in drafting a mini-review of 5 papers relevant to that research, (4) to guide students in identifying and writing up a research proposal which they will complete in the lab of the faculty partner. The learning objectives for the students in this course are summarized as; (a) by the end of this course, all students build a foundational understanding of the principles of STEM research through the exploration and discussion of important historical interdisciplinary projects; (b) interact with faculty researchers who perform projects across STEM disciplines; (c) be able to describe the similarities and differences between experimental and theoretical STEM research; (d) explore and present several possibilities for future research topics; (e) design and present a research prospectus, complete with a review of some of the relevant literature; (f) and be prepared to continue a research project with a chosen faculty mentor or mentors. First year, six academic departments out of eight participated this new course by offering a cross-listed course for their students under one major course taught by one of the PIs at the STEM Center. All the details such as challenges faced, outcomes, resources used, faculty involved, student and faculty feedback etc. for this course will be shared with academia in the paper. 
    more » « less
  5. The purpose of this study is to develop an instrument to measure student perceptions about the learning experiences in their online undergraduate engineering courses. Online education continues to grow broadly in higher education, but the movement toward acceptance and comprehensive utilization of online learning has generally been slower in engineering. Recently, however, there have been indicators that this could be changing. For example, ABET has accredited online undergraduate engineering degrees at Stony Brook University and Arizona State University (ASU), and an increasing number of other undergraduate engineering programs also offer online courses. During this period of transition in engineering education, further investigation about the online modality in the context of engineering education is needed, and survey instrumentation can support such investigations. The instrument presented in this paper is grounded in a Model for Online Course-level Persistence in Engineering (MOCPE), which was developed by our research team by combining two motivational frameworks used to study student persistence: the Expectancy x Value Theory of Achievement Motivation (EVT), and the ARCS model of motivational design. The initial MOCPE instrument contained 79 items related to students’ perceptions about the characteristics of their courses (i.e., the online learning management system, instructor practices, and peer support), expectancies of course success, course task values, perceived course difficulties, and intention to persist in the course. Evidence of validity and reliability was collected using a three-step process. First, we tested face and content validity of the instrument with experts in online engineering education and online undergraduate engineering students. Next, the survey was administered to the online undergraduate engineering student population at a large, Southwestern public university, and an exploratory factor analysis (EFA) was conducted on the responses. Lastly, evidence of reliability was obtained by computing the internal consistency of each resulting scale. The final instrument has seven scales with 67 items across 10 factors. The Cronbach alpha values for these scales range from 0.85 to 0.97. The full paper will provide complete details about the development and psychometric evaluation of the instrument, including evidence of and reliability. The instrument described in this paper will ultimately be used as part of a larger, National Science Foundation-funded project investigating the factors influencing online undergraduate engineering student persistence. It is currently being used in the context of this project to conduct a longitudinal study intended to understand the relationships between the experiences of online undergraduate engineering students in their courses and their intentions to persist in the course. We anticipate that the instrument will be of interest and use to other engineering education researchers who are also interested in studying the population of online students. 
    more » « less