Identity, or how people choose to define themselves, is emerging as an attractive explanation for who persists in engineering. Many studies of engineering identity build off of prior work in math and science identity, emphasizing the academic aspects of engineering. However, affect towards professional practice is also central to engineering identity development. This paper describes the methods used to create a new survey measure of individuals’ affect toward elements of engineering practice. We followed the item generation, refinement, and instrument validation steps required for psychometric validation of a new survey measure. We generated items deductively using the literature on engineering professional skills and practice and inductively based on interviews with practicing engineers, engineering graduate students, and engineering undergraduate students. We blended the inductively and deductively derived item lists to create a list of initial items for the measure. We circulated this list of items to a set of engineering and professional identity experts to establish face validity and made modifications based on their feedback. The final list included 34 items. These 34 items were administered in a questionnaire survey in the fall of 2016 to 1465 engineering undergraduates in three majors at two institutions. We conducted an exploratory factor analysis (EFA) and established internal consistency using Cronbach’s alpha on a subset of the analytical sample data (n=384). The resulting factors fit our a priori assumption of the factors theorized to characterize affect towards engineering professional practice. Using the remaining data (n=904), we conducted a confirmatory factor analysis on the reduced set of items resulting from EFA. The results indicate an emergent factor structure for affect towards elements of engineering practice.
more »
« less
Professional Skill Opportunities Survey: Development and Exploratory Factor Analysis
This full research paper presents the exploratory factor analysis (EFA) results for the Professional Skill Opportunities survey (PSO) we designed to measure undergraduate engineering students’ opportunities to develop and practice important nontechnical professional skills. We use Dall’alba’s “ways of being” as the theoretical framework for the survey development and generated construct definitions based on past literature, expert review, and cognitive think-aloud interviews. We administered the survey in an engineering class at the beginning of the Spring 2022 semester. After comparing the three EFA models based on goodness-of-fit indices and model interpretability aligned to the theoretical model, the researchers selected a five-factor model. The EFA result and literature on leadership and teamwork showed these two skills are highly interrelated and could be combined into one construct to stress the “sharedness” of leadership responsibilities in teams. The result allowed our team to refine our item pool, revise construct definitions, and generate new items. In future work, we will administer the revised PSO survey to the same population at the end of the same semester as further validation. We also plan to explore the relationship between professional skill development opportunities and students’ social support. We hope the PSO survey can provide educators and institutions a means to offer scaffoldings and more opportunities for professional skill development and better prepare students for the engineering workforce.
more »
« less
- Award ID(s):
- 2129308
- PAR ID:
- 10430299
- Date Published:
- Journal Name:
- Professional skill opportunities survey: Development and exploratory factor analysis
- Page Range / eLocation ID:
- 1 to 8
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
As the need for interdisciplinary collaboration increases, industry needs engineers who are not only affluent in technical engineering skills but also efficient in skills such as communication, problem-solving, engineering ethics, and business management. As a result, engineering programs are tasked with providing students with sufficient opportunities to develop non-technical professional skills to better prepare them for the workforce. Previous research has focused on exploring how and where students tend to develop profession skills and assessments have been established to measure the level of professional skills. However, without a means to measure whether students are getting sufficient opportunities for development, it is hard for educators and engineering programs to determine whether or where scaffolding are needed. We developed an instrument to assess undergraduate engineering students’ opportunities for professional skill development. To increase content validity, we conducted 20 think-aloud interviews with students from a large Midwestern university. The aim of this WIP is two-fold. We present the preliminary results of the think-aloud interview to determine what changes need to be made to existing items and what emerging themes appear regarding to participants’ professional skill development opportunities. After thematic analysis of the interview transcripts, we revised 10 items by simplifying the grammar or altering certain words that tend to confuse participants or carry negative connotations. We found that, compared to students who have only been involved in class projects, those with co-curricular experiences tend to report more opportunities in skills related to business management principles and problem-solving skills. Co-curricular activities were also the most referenced in building communication skills. Our next step will be piloting the instrument across multiple institutions and conducting validation analysis.more » « less
-
In order to most effectively contribute to the development of solutions to society’s greatest challenges, engineers must learn to lead the interdisciplinary teams required to develop these solutions. However, most undergraduate engineering programs do little to develop leadership skills in their students. Perhaps, one reason for this gap between needs and education is a conflict between the development of an engineering identity and a leadership identity. To date, the literature contains little work that illustrates the role leadership concepts play in the formation of an engineering identity. Therefore, more work is needed to understand the formation of a leadership identity within the formation of an engineering identity. Together, these development processes constitute the formation of engineering leaders. This paper presents the methods underway to validate and refine a proposed theoretical model of engineering leadership identity development. This model can be used to reshape existing engineering leadership education programs and integrate leadership into the engineering curriculum in an innovative manner. The model starts with a fundamental assumption that the engineering leadership formation process is, at its core, an identity development process. This assumption is also central to two established theoretical perspectives that informed the construction of this model. Lave and Wenger’s (1991) communities of practice model argues that the development of a professional identity is the outcome of learning within a community of practice, and is frequently used to explain the process by which undergraduates develop a sense of engineering identity. The communities of practice model is then combined with Komives, Owen, Longerbeam, Mainella, and Osteen’s (2005) Leadership Identity Development Model to outline how engineering students might cultivate a self-concept as a leader. A key argument within this model is that college students develop a personal sense of leadership as an identity when they view leadership as a process, not merely a position. This paper first explains the development of this theoretical model of engineering leadership identity development combining the literature from engineering identity development, leadership identity development within collegiate populations, and engineering leadership. Following this explanation, this work focuses on the methods developed and currently being deployed to validate and refine the model, including initial findings from this research.more » « less
-
The Academy of Engineering Success (AcES), supported by an NSF S-STEM grant since 2016, employs literature-based, best practices to support and retain students in engineering. AcES students participate in a one-week summer bridge experience; a common fall semester course focused on professional development, time management and study skills, and career exploration; and a common spring semester course emphasizing the role of engineers in societal development. Students are also immersed in co-curricular activities with the goals of fostering feelings of institutional inclusion and belonging in engineering, providing academic support and student success skills, and professional development. AcES students participate in the GRIT, LAESE, and MSLQ surveys at the start and end of each fall semester and at the end of the spring semester each year. Focus group data is collected at the beginning, middle and end of each semester and one-on-one interviews occur at the start and end of each semester. The surveys provide a measure of students’ GRIT, general self-efficacy, engineering self-efficacy, test anxiety, math outcome efficacy, intrinsic value of learning, inclusion, career expectations, and coping efficacy. A previous study, based on an analysis of the 2017 AcES cohort survey responses, produced a surprising result. When the responses of AcES students who retained were compared to the responses of AcES students who left engineering, those who left engineering had higher baseline values of GRIT, career expectations, engineering self-efficacy, and math outcome efficacy than those students who retained. These results appear to support the Kruger-Dunning effect. This paper presents the subsequent analysis of two years of participant data, the 2017 and 2018 cohorts, to further explore the possibility or the strength of this effect for these students and investigates possible reasons for the results.more » « less
-
The development of inclusive leaders is essential for the success of future engineering and our nation. Equipping students with vital leadership-enabling competencies is necessary to develop a workforce that is prepared to act ethically, and responsibly, and tackle unforeseen challenges in the future. Inclusive leaders, or leaders that are self-aware, empathetic, and prioritize diversity, equity, and inclusion in their decision-making, are essential for the forward progress of engineering. A growing body of literature highlights the numerous ways in which students may develop leadership skills outside of the classroom through involvement in out-of-class activities (e.g., internships, clubs, sports, and research experiences). Research Experiences for Undergraduates (REUs) may provide students with a unique opportunity to develop leadership-enabling competencies that will prepare them for leadership in graduate school, the engineering industry, or academia. The goal of this research was to identify how students’ engagement in an engineering education virtual REU site contributed to their development of essential leadership-enabling competencies. The research question guiding this study was ‘What inclusive leadership-enabling competencies and skills did engineering students learn and develop during an engineering education Summer REU program?’ Qualitative data was collected via weekly open-ended surveys from 9 students (7 women, 2 men) participating in an REU over 9 weeks. Participants in this study consisted of students from underrepresented groups in engineering (e.g., Black, Latinx, women, students from low SES backgrounds, or first-generation students), attending large public research universities across the United States. This study implemented mixed methods to understand what leadership competencies were occurring most frequently and how students were learning and developing these competencies. A combination of text mining for frequency (quantitative analysis) and deductive and inductive coding (qualitative analysis) was used to analyze the data. A codebook was developed based on the leadership-coupled professional competencies that engineering industry leaders identified as essential for engineers entering the workforce. Researchers also allowed for other competencies and leadership-enabling skills to emerge from the data. Findings from this work indicate that students were developing a vast amount of inclusive leadership knowledge and skills from participating in the virtual REU site. This paper highlights, through the use of word clouds and text mining software, the many leadership-enabling competencies that participants developed throughout the summer research experience (e.g., learning, communication, adaptability, self-awareness, balance, networking, etc.). Further, students were able to develop digital literacy, increased communication skills, knowledge of career pathways, intrapersonal growth, and interpersonal relations. This work offers a novel contribution to the literature in understanding how students can develop technical engineering and research skills as well as professional and leadership skills in the same space. Findings from this work help to illuminate the benefits of this virtual REU site focused on engineering education research resulting in terms of developing inclusive leadership skills. Implications for future REU programs, students interested in developing leadership skills, engineering graduate programs, academia, and industry employers are outlined.more » « less
An official website of the United States government

