skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Work in Progress: Designing a Survey Instrument to Assess Graduate Student Motivation Towards Degree Completion
This work in progress paper describes the development of an instrument to assess graduate student motivation towards doctoral degree completion. Doctoral attrition rates in the United States have been estimated to be around 40% over a 10 year completion period [8]. King [8] also found that less than 20% of students complete their doctoral programs in the expected timeframe of between 3 and 4 years. These results indicate the need to better understand factors that affect graduate students' experience during their doctoral program, particularly their choice to persist, so we can ensure equal opportunities for Ph.D completion. Spaulding and Rockinson-Szapkiw [12] talk about personal factors that contribute to doctoral students’ persistence. These factors include motivation, strategies for writing the dissertation, time management, and attributes such as credibility, commitment, and increased monetary compensation. As part of this research study, we have selected to focus upon student motivation as motivation theories have been found to provide explanations for factors that influence individuals choices and actions [3]. Specifically, we have selected the Expectancy-Value Theory (EVT) of motivation because it considers social, cultural, and psychological factors [1], making it beneficial for elements that could be relevant in a graduate studies program. This work seeks to create a motivational instrument specific to an engineering graduate studies program setting. Our instrument development process began with the Engineering Motivation Survey, developed by Brown & Matusovich [2]. This survey instrument was designed to measure motivation of undergraduate engineering students towards engineering education and career choices. Ultimately, the purpose was to measure motivational factors that contribute toward choices to pursue and complete engineering degrees. The 35 likert scale questions were rephrased to focus on a graduate student setting. After the rephrasing, the draft survey was used in a Think-aloud protocol with six engineering graduate students to determine what changes may be needed to better support its new area of implementation. Upon finalization of the graduate student engineering motivation survey we will apply it to measure civil and environmental engineering graduate students’ motivation towards their doctoral degree completion as part of their participation in a Graduate Assistance in Areas of National Need (GAANN) program.  more » « less
Award ID(s):
2224724
PAR ID:
10528662
Author(s) / Creator(s):
;
Publisher / Repository:
ASEE Conferences
Date Published:
Format(s):
Medium: X
Location:
Baltimore , Maryland
Sponsoring Org:
National Science Foundation
More Like this
  1. The existing curriculum and models for civil engineering graduate programs assume that graduating Ph.D. students will primarily pursue career opportunities in research or academia. However, the number of civil engineering Ph.D. graduate students continues to increase, while the number of opportunities in academia for civil engineers remains stagnant. As a result, it is becoming increasingly apparent that the civil engineering graduate programs must be reevaluated to assist students entering industry after graduation. As part of a larger research study funded through the NSF Innovations in Graduate Education (IGE), we aim to answer the following research questions: 1) How can a research-to-practice model assist students in preparing for a transportation engineering career outside of academia?, 2) What impacts does the research-to-practice graduate model have on the development of transportation engineering doctoral students’ professional identity?, 3) How does the cognitive apprenticeship framework prepare doctoral students for professional practice in transportation engineering?, and 4) What influences does the research-to-practice model have on doctoral students’ motivation toward degree completion? As part of the first phase for the project, two surveys were developed: a graduate engineering student motivation survey based on Expectancy-Value-Theory, and an instrument based on the Cognitive Apprenticeship framework. The motivation survey was based on an instrument designed and validated by Brown & Matusovich (2013) which aimed to measure undergraduate engineering students' motivation towards obtaining an engineering degree. The survey prompts were reviewed and rewritten to reflect the change in context from undergraduate to graduate school. Revised survey prompts were reviewed with a group of graduate engineering students through a think aloud protocol and changes to the instrument were made to ensure consistency in interpretation of the prompts (Rodriguez-Mejia and Bodnar, 2023). The cognitive apprenticeship instrument was derived from the Maastricht Clinical Teaching Questionnaire (MCTQ), originally designed to offer clinical educators feedback on their teaching abilities, as provided by medical students during their clerkship rotations (Stalmeijer et al., 2010). To tailor it to the context of engineering graduate students, the MCTQ's 24 items were carefully examined and rephrased. A think aloud was conducted with three civil engineering graduate students to determine the effectiveness and clarity of the cognitive apprenticeship instrument. Preliminary results show that minimal clarification is needed for some items, and suggestions to include items which address support from their mentors. The other part of the project assessment involves students completing monthly reflections to obtain their opinions on specific events such as seminars or classes, and identify their perceptions of their identity as professionals, scientists, or researchers. Preliminary results suggest that the students involved place an emphasis on developing critical thinking and planning skills to become an engineering professional, but de-emphasize passion and enjoyment. This paper will report on initial findings obtained through this first phase of the IGE project. 
    more » « less
  2. Contribution: This study shows that identification with engineering for engineering graduate students is positively and significantly predicted by engineering interest, competence, recognition, and interpersonal skills competence. Background: Prior studies of engineering identity on undergraduates identified several factors (e.g., engineering interest, engineering recognition) as positive predictors of identification of engineering. Engineering competence, achieved by participating in design projects, is a crucial part of students’ efforts to become more innovative engineers. Identity theory is used to understand undergraduates’ persistence in engineering, as students with stronger engineering identification are more likely to persist. More work is needed focusing on graduate students. Research Questions: Do engineering identity measurement frameworks studied for undergraduate students also apply to graduate students? Do they correlate with intention to complete the degree? What predicts the engineering identity of engineering Master's and doctoral students? Methodology: Interviews informed development and adaptation of a multi-scale survey instrument. Factor analyses identified four factors that relate to graduate engineering identity: engineering interest, engineering recognition, engineering competence, and interpersonal skills competence. Three sequential multiple linear regression models were used to predict engineering graduate students’ engineering identity. Findings: The final regression model, which includes student characteristics and the four factors resulting from Confirmatory Factor Analysis, predicts 60% of the variance in engineering identity—substantially more than similar undergraduate engineering identity models. All four factors were significant and positive predictors of graduate students’ engineering identity. The engineering recognition factor in particular needed adaptation to emphasize peers and faculty members over family, although family remained important. 
    more » « less
  3. Background A growing body of research highlights the experiences of Black men students who successfully navigate science, technology, engineering, and mathematics (STEM) educational pathways. Many Black men graduate students in engineering describe moments when their advisors, peers, and, at times, community members make them feel different because of their race and gender. Needed is a better understanding of what motivates Black men to persist in graduate school despite such challenges. Purpose This study advances a new theoretical model, “Black Men's Graduate Engineering Motivation” (BMGEM), to describe the overlaying factors and sources of motivation—and their interrelations—that influence Black men in engineering graduate programs to persist. Research Design To explore the motivational factors that influence Black men in graduate engineering programs at predominantly White institutions (PWIs) to persist, this study of 42 students used an eight-item demographic form, one-on-one semi-structured interviews, and follow-up focus groups. Data analysis was conducted using adapted grounded theory techniques. After the completion of data collection and multiple iterations of analyses (both inductive and deductive), existing conceptualizations of motivation were used to help make sense of data. The connection to existing literature, code development, their placement into categories, and placing categories into themes led to the creation of a substantive, practice-informing theory: Black Men's Graduate Engineering Motivation. Findings Data analysis resulted in the theory of Black Men's Graduate Engineering Motivation (BMGEM). The BMGEM explains the overlaying factors that influence individuals’ experiences and motivations to persist (i.e., sociocultural factors, personal factors, social identities, pre-graduate school experiences), and external and internal motivational sources that also influence students’ motivations to persist (i.e., desire to earn a graduate degree, desire to become an engineer, challenges during graduate school, peers, family members, [under]representation, self-coaching practices, career and professional goals). Conclusions and Recommendations The findings from this study inform future research, and practice-based strategies around broadening participation, that aid in Black men's progress through science and engineering pathways. With this new information, we charge engineering colleges to make true commitments to broadening participation, which means centering students—in this case, Black men—as contributors to STEM. In doing so, engineering colleges need to commit to helping Black men succeed. Assisting in their motivation to persist is a key to meeting this charge. 
    more » « less
  4. Available attrition statistics for graduate engineering students do not adequately inform current attrition research because they focus on degree completion rather than attrition or early departure; aggregate science, technology, engineering, and mathematics (STEM) students; and reflect out-of-date data. While recently some work has begun to explore doctoral attrition qualitatively, the purpose of this study is to describe current trends in graduate engineering students’ consideration of departure from their programs of study by capturing current numerical data specific to engineering about students’ recent attrition considerations. This is important because, since the last studies were conducted, higher education systems have experienced a global pandemic, economic downturn, and sociopolitical turmoil in the United States. Graduate students (n = 2204) in the U.S. completed a survey. The sample includes master’s (n = 535) and doctorate (n = 1646) degree-seeking students from 27 engineering disciplines and includes U.S. domestic and international populations. A majority of students considered leaving their degree program in the month before they took the survey: nearly 70% of Ph.D. and 39% of master’s students, while 31% of Ph.D. and 16% of master’s students seriously considered leaving their program without their degree. Descriptive statistics provide early departure considerations by engineering discipline, gender identity, race/ethnicity, nationality, and year in program by degree sought. Comparisons between groups are presented for gender, nationality, and career stage. It is essential to have an updated and discipline-specific benchmark of attrition considerations for continued engineering education research purposes, for mentorship, and for administrative purposes. Early departure from graduate school remains a threat to innovation and broadening participation in engineering and the professoriate. 
    more » « less
  5. The purpose of this study is to develop an instrument to measure student perceptions about the learning experiences in their online undergraduate engineering courses. Online education continues to grow broadly in higher education, but the movement toward acceptance and comprehensive utilization of online learning has generally been slower in engineering. Recently, however, there have been indicators that this could be changing. For example, ABET has accredited online undergraduate engineering degrees at Stony Brook University and Arizona State University (ASU), and an increasing number of other undergraduate engineering programs also offer online courses. During this period of transition in engineering education, further investigation about the online modality in the context of engineering education is needed, and survey instrumentation can support such investigations. The instrument presented in this paper is grounded in a Model for Online Course-level Persistence in Engineering (MOCPE), which was developed by our research team by combining two motivational frameworks used to study student persistence: the Expectancy x Value Theory of Achievement Motivation (EVT), and the ARCS model of motivational design. The initial MOCPE instrument contained 79 items related to students’ perceptions about the characteristics of their courses (i.e., the online learning management system, instructor practices, and peer support), expectancies of course success, course task values, perceived course difficulties, and intention to persist in the course. Evidence of validity and reliability was collected using a three-step process. First, we tested face and content validity of the instrument with experts in online engineering education and online undergraduate engineering students. Next, the survey was administered to the online undergraduate engineering student population at a large, Southwestern public university, and an exploratory factor analysis (EFA) was conducted on the responses. Lastly, evidence of reliability was obtained by computing the internal consistency of each resulting scale. The final instrument has seven scales with 67 items across 10 factors. The Cronbach alpha values for these scales range from 0.85 to 0.97. The full paper will provide complete details about the development and psychometric evaluation of the instrument, including evidence of and reliability. The instrument described in this paper will ultimately be used as part of a larger, National Science Foundation-funded project investigating the factors influencing online undergraduate engineering student persistence. It is currently being used in the context of this project to conduct a longitudinal study intended to understand the relationships between the experiences of online undergraduate engineering students in their courses and their intentions to persist in the course. We anticipate that the instrument will be of interest and use to other engineering education researchers who are also interested in studying the population of online students. 
    more » « less