An official website of the United States government
Identity, or how people choose to define themselves, is emerging as an explanation for who pursues and persists in engineering. Recent developments in the study of engineering identity, including studies of math and science identity, tend to emphasize the academic aspects of engineering without considering aspects of professional practice central to the development of an engineering identity. This paper outlines the methods used to create a new survey measure: affect toward elements of engineering practice. We followed the item generation, refinement, and instrument validation steps required for psychometric validation of a new survey measure. Through this process a final list of 34 items was administered in a survey in the fall of 2016 to engineering undergraduates. We conducted an exploratory factor analysis and established internal consistency using Cronbach’s alpha on a subset of the data sample (n=384). The resulting factors reflect key elements of affect towards engineering professional practice.
more »
« less
A Measure of Affect toward Key Elements of Engineering Professional Practice.
Identity, or how people choose to define themselves, is emerging as an attractive explanation for who persists in engineering. Many studies of engineering identity build off of prior work in math and science identity, emphasizing the academic aspects of engineering. However, affect towards professional practice is also central to engineering identity development. This paper describes the methods used to create a new survey measure of individuals’ affect toward elements of engineering practice. We followed the item generation, refinement, and instrument validation steps required for psychometric validation of a new survey measure. We generated items deductively using the literature on engineering professional skills and practice and inductively based on interviews with practicing engineers, engineering graduate students, and engineering undergraduate students. We blended the inductively and deductively derived item lists to create a list of initial items for the measure. We circulated this list of items to a set of engineering and professional identity experts to establish face validity and made modifications based on their feedback. The final list included 34 items. These 34 items were administered in a questionnaire survey in the fall of 2016 to 1465 engineering undergraduates in three majors at two institutions. We conducted an exploratory factor analysis (EFA) and established internal consistency using Cronbach’s alpha on a subset of the analytical sample data (n=384). The resulting factors fit our a priori assumption of the factors theorized to characterize affect towards engineering professional practice. Using the remaining data (n=904), we conducted a confirmatory factor analysis on the reduced set of items resulting from EFA. The results indicate an emergent factor structure for affect towards elements of engineering practice.
more »
« less
- Award ID(s):
- 1636404
- PAR ID:
- 10066250
- Date Published:
- Journal Name:
- ASEE annual conference & exposition proceedings
- ISSN:
- 2153-5868
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This full research paper presents the exploratory factor analysis (EFA) results for the Professional Skill Opportunities survey (PSO) we designed to measure undergraduate engineering students’ opportunities to develop and practice important nontechnical professional skills. We use Dall’alba’s “ways of being” as the theoretical framework for the survey development and generated construct definitions based on past literature, expert review, and cognitive think-aloud interviews. We administered the survey in an engineering class at the beginning of the Spring 2022 semester. After comparing the three EFA models based on goodness-of-fit indices and model interpretability aligned to the theoretical model, the researchers selected a five-factor model. The EFA result and literature on leadership and teamwork showed these two skills are highly interrelated and could be combined into one construct to stress the “sharedness” of leadership responsibilities in teams. The result allowed our team to refine our item pool, revise construct definitions, and generate new items. In future work, we will administer the revised PSO survey to the same population at the end of the same semester as further validation. We also plan to explore the relationship between professional skill development opportunities and students’ social support. We hope the PSO survey can provide educators and institutions a means to offer scaffoldings and more opportunities for professional skill development and better prepare students for the engineering workforce.more » « less
-
Abstract BackgroundDespite well‐documented benefits, instructor adoption of active learning has been limited in engineering education. Studies have identified barriers to instructors’ adoption of active learning, but there is no well‐tested instrument to measure instructors perceptions of these barriers. PurposeWe developed and tested an instrument to measure instructors’ perceptions of barriers to adopting active learning and identify the constructs that coherently categorize those barriers. MethodWe used a five‐phase process to develop an instrument to measure instructors’ perceived barriers to adopting active learning. In Phase 1, we built upon the Faculty Instructional Barriers and Identity Survey (FIBIS) to create a draft instrument. In Phases 2 and 3, we conducted exploratory factor analysis (EFA) on an initial 45‐item instrument and a refined 21‐item instrument, respectively. We conducted confirmatory factor analysis (CFA) in Phases 4 and 5 to test the factor structure identified in Phases 2 and 3. ResultsOur final instrument consists of 17 items and four factors: (1) student preparation and engagement; (2) instructional support; (3) instructor comfort and confidence; and (4) institutional environment/rewards. Instructor responses indicated that time considerations do not emerge as a standalone factor. ConclusionsOur 17‐item instrument exhibits a sound factor structure and is reliable, enabling the assessment of perceived barriers to adopting active learning in different contexts. The four factors align with an existing model of instructional change in science, technology, engineering, and mathematics (STEM). Although time is a substantial instructor concern that did not comprise a standalone factor, it is closely related to multiple constructs in our final model.more » « less
-
The existing curriculum and models for civil engineering graduate programs assume that graduating Ph.D. students will primarily pursue career opportunities in research or academia. However, the number of civil engineering Ph.D. graduate students continues to increase, while the number of opportunities in academia for civil engineers remains stagnant. As a result, it is becoming increasingly apparent that the civil engineering graduate programs must be reevaluated to assist students entering industry after graduation. As part of a larger research study funded through the NSF Innovations in Graduate Education (IGE), we aim to answer the following research questions: 1) How can a research-to-practice model assist students in preparing for a transportation engineering career outside of academia?, 2) What impacts does the research-to-practice graduate model have on the development of transportation engineering doctoral students’ professional identity?, 3) How does the cognitive apprenticeship framework prepare doctoral students for professional practice in transportation engineering?, and 4) What influences does the research-to-practice model have on doctoral students’ motivation toward degree completion? As part of the first phase for the project, two surveys were developed: a graduate engineering student motivation survey based on Expectancy-Value-Theory, and an instrument based on the Cognitive Apprenticeship framework. The motivation survey was based on an instrument designed and validated by Brown & Matusovich (2013) which aimed to measure undergraduate engineering students' motivation towards obtaining an engineering degree. The survey prompts were reviewed and rewritten to reflect the change in context from undergraduate to graduate school. Revised survey prompts were reviewed with a group of graduate engineering students through a think aloud protocol and changes to the instrument were made to ensure consistency in interpretation of the prompts (Rodriguez-Mejia and Bodnar, 2023). The cognitive apprenticeship instrument was derived from the Maastricht Clinical Teaching Questionnaire (MCTQ), originally designed to offer clinical educators feedback on their teaching abilities, as provided by medical students during their clerkship rotations (Stalmeijer et al., 2010). To tailor it to the context of engineering graduate students, the MCTQ's 24 items were carefully examined and rephrased. A think aloud was conducted with three civil engineering graduate students to determine the effectiveness and clarity of the cognitive apprenticeship instrument. Preliminary results show that minimal clarification is needed for some items, and suggestions to include items which address support from their mentors. The other part of the project assessment involves students completing monthly reflections to obtain their opinions on specific events such as seminars or classes, and identify their perceptions of their identity as professionals, scientists, or researchers. Preliminary results suggest that the students involved place an emphasis on developing critical thinking and planning skills to become an engineering professional, but de-emphasize passion and enjoyment. This paper will report on initial findings obtained through this first phase of the IGE project.more » « less
-
Contribution: This study explores the factors contributing to the development of engineering identity in Latinx students at two institutions. A better understanding of these factors will support the development of more inclusive engineering education environments and experiences. Background: Persistence of Latinx engineering students is of particular interest due to their underrepresentation in the field. Identity is a lens for understanding student persistence, but Latinx students are underrepresented in prior engineering identity studies. This study seeks to identify the unique factors, academic and professional, that contribute to engineering identity development, and potential means for supporting the persistence of Latinx engineers. Research Questions: (1) What academic and professional affect factors predict engineering identity development of Latinx students? and (2) What role does the institution play in Latinx students’ engineering identity development? Methodology: A mixed-methods approach was used to measure engineering identity based on a framework incorporating both academic and professional affect elements. Regression analyses were conducted on 892 responses to an online survey from Latinx engineering students, with additional insight from interviews with ten Latinx engineering students. Findings: Six of the nine factors analyzed (performance/competence, interest, recognition, analysis, framing and solving problems, and tinkering) were significant predictors of Latinx students' engineering identity, as were institution, gender, and having a parent with an engineering degree. Engineering identity was higher for Latinx students at the Hispanic Serving Institution, but none of the interaction terms were significant, so the relationship between these factors and engineering identity is similar at each institution.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
