skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Tolerance of Ambiguity, Development of Cognitive Models and Engineering Identity
The cognitive models of students’ perceptions of the real world lie on a spectrum spanning a dualistic understanding of the worldview on one end and a relativistic view on the other end. Students who are dualistic in their understanding of concepts have difficulty in solving problems which do not lend themselves to a well-defined single answer or solution. One would therefore assume that engineering students would rapidly develop a relativistic understanding of the solution space. It is also expected that this developmental process would also manifest itself in the strengthening of an engineering identity. The focus of the research presented in this paper is to explore the relationships of the cognitive models of the solution space, tolerance of ambiguity and the development of engineering identity. A cross-sectional study of the cognitive models of undergraduate students, their tolerance to ambiguity and perception of engineering identity was conducted at an historically black university. The modified Rydell-Rosen Ambiguity Tolerance (RRAT) instrument for tolerance of ambiguity and the Bateman-McDonald (BD) instrument for determining their location on the cognitive spectrum were used in this study. The students were also administered the Godwin Engineering Identity (GEI) survey. Data analysis indicated that students’ tolerance of ambiguity increased on only few items of the RRAT instrument with the time spent in college. The analysis of the engineering identity indicated positive changes on several of the items of the instrument for the freshmen while reduction on some items of the GEI survey were observed. This research is supported by NSF Grant# 1832041.  more » « less
Award ID(s):
1832041
PAR ID:
10185885
Author(s) / Creator(s):
Date Published:
Journal Name:
ASEE National Conference 2020
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The existing curriculum and models for civil engineering graduate programs assume that graduating Ph.D. students will primarily pursue career opportunities in research or academia. However, the number of civil engineering Ph.D. graduate students continues to increase, while the number of opportunities in academia for civil engineers remains stagnant. As a result, it is becoming increasingly apparent that the civil engineering graduate programs must be reevaluated to assist students entering industry after graduation. As part of a larger research study funded through the NSF Innovations in Graduate Education (IGE), we aim to answer the following research questions: 1) How can a research-to-practice model assist students in preparing for a transportation engineering career outside of academia?, 2) What impacts does the research-to-practice graduate model have on the development of transportation engineering doctoral students’ professional identity?, 3) How does the cognitive apprenticeship framework prepare doctoral students for professional practice in transportation engineering?, and 4) What influences does the research-to-practice model have on doctoral students’ motivation toward degree completion? As part of the first phase for the project, two surveys were developed: a graduate engineering student motivation survey based on Expectancy-Value-Theory, and an instrument based on the Cognitive Apprenticeship framework. The motivation survey was based on an instrument designed and validated by Brown & Matusovich (2013) which aimed to measure undergraduate engineering students' motivation towards obtaining an engineering degree. The survey prompts were reviewed and rewritten to reflect the change in context from undergraduate to graduate school. Revised survey prompts were reviewed with a group of graduate engineering students through a think aloud protocol and changes to the instrument were made to ensure consistency in interpretation of the prompts (Rodriguez-Mejia and Bodnar, 2023). The cognitive apprenticeship instrument was derived from the Maastricht Clinical Teaching Questionnaire (MCTQ), originally designed to offer clinical educators feedback on their teaching abilities, as provided by medical students during their clerkship rotations (Stalmeijer et al., 2010). To tailor it to the context of engineering graduate students, the MCTQ's 24 items were carefully examined and rephrased. A think aloud was conducted with three civil engineering graduate students to determine the effectiveness and clarity of the cognitive apprenticeship instrument. Preliminary results show that minimal clarification is needed for some items, and suggestions to include items which address support from their mentors. The other part of the project assessment involves students completing monthly reflections to obtain their opinions on specific events such as seminars or classes, and identify their perceptions of their identity as professionals, scientists, or researchers. Preliminary results suggest that the students involved place an emphasis on developing critical thinking and planning skills to become an engineering professional, but de-emphasize passion and enjoyment. This paper will report on initial findings obtained through this first phase of the IGE project. 
    more » « less
  2. This paper introduces the pilot implementation of the Evidence Based Personas survey instrument for assessing non-cognitive attributes of relevance from undergraduate students at different stages of their engineering degree for the purpose of informing proactive advising processes. The survey instrument was developed with two key objectives: first, to assess its potential for streamlining and shortening existing instruments, and second, to explore the possibility of consolidating items from different surveys that measure the same or closely related constructs. A proactive advising system is being developed that uses the Mediation Model of Research Experiences (MMRE) as a framework. Within this framework, participation in various educational activities is linked to increased Commitment to Engineering via three mediating parameters: Self-Efficacy, Teamwork/Leadership Self-Efficacy, and Engineering Identity. The existing, validated MMRE survey instrument was used as a starting point for development of the current instrument with a goal of streamlining / shortening the number of questions. Ultimately, we envision augmenting the shortened instrument with items related to broader non-cognitive and affective constructs from the SUCCESS instrument. Noting that both the MMRE and SUCCESS instruments include measures of Self-Efficacy and Engineering Identity, selected questions from both were included and compared. Data was collected from 395 total respondents, and subsequent data analysis was based on 337 valid participants. Factor Analysis techniques, both exploratory and confirmatory, were employed to uncover underlying or latent variables within the results, particularly in the areas of Self-Efficacy where the combined items of the SUCCESS instrument and the MMRE instrument were used. Cronbach’s alpha analysis was employed to assess the internal consistency of the survey instrument. The Teamwork, Engineering Identity, and Commitment to Engineering constructs all produced a Cronbach’s alpha value in excess of 0.80. The Self-Efficacy construct fell below the 0.80 threshold at 0.77 which is considered to be respectable but is indicative of some short comings compared to that of the other constructs. The results of the EFA four-factor pattern matrix show the SUCCESS instrument items breaking out into their own components while the MMRE items merge with some of the items from the Engineering Identity construct suggesting a distinction in the underlying concepts these items may be measuring. This finding is further supported in the CFA through an assessment of the Goodness of Fit (GFI), Tucker-Lewis Index (TLI), and Root Mean Square Error of Approximation (RMSEA) of these constructs. The initial groupings of the four constructs produced a robust CFI value of 0.853, robust TLI value of 0.838, and a robust RMSEA value of 0.075. Self-Efficacy is broken out into two sub-scales one defined by the three items from the SUCCESS instrument and the other defined by the four remaining items from the MMRE instrument. Engineering Identity was also broken into two sub-scales. The robust CFI and TLI report values of 0.928 and 0.919 respectively, and the robust RMSEA is reported to be 0.053. The findings of the factor analyses indicate that a shortened form of the MMRE survey instrument will provide reliable measures of the underlying constructs. Additionally, the results suggest that the self-efficacy as measured by items from the MMRE and from the SUCCESS instruments are related to two separate aspects of self-efficacy and do not load well into a single factor. 
    more » « less
  3. Longitudinal and cross-sectional data is being collected at a Historically Black College (HBCU) to understand the cognitive development of students in their tolerance of ambiguity that may translate into their ability to solve open-ended problems. The data is expected to provide insight into the correlations between academic success, tolerance of ambiguity, intellectual development and development of a science, technology, engineering, and math (STEM) identity in undergraduate students. This work-in-progress paper provides preliminary data on tolerance of ambiguity in college students. Some results from the analysis of the data are included. 
    more » « less
  4. Longitudinal and cross-sectional data is being collected at a Historically Black College (HBCU) to understand the cognitive development of students in their tolerance of ambiguity that may translate into their ability to solve open-ended problems. The data is expected to provide insight into the correlations between academic success, tolerance of ambiguity, intellectual development and development of a science, technology, engineering, and math (STEM) identity in undergraduate students. This work-in-progress paper provides preliminary data on tolerance of ambiguity in college students. Some results from the analysis of the data are included. 
    more » « less
  5. nterest in science, technology, engineering, and mathematics (STEM) begins as early as elementary and middle school. As youth enter adolescence, they begin to shape their personal identities and start making decisions about who they are and could be in the future. Students form their career aspirations and interests related to STEM in elementary school, long before they choose STEM coursework in high school or college. Much of the literature examines either science or STEM identity and career aspirations without separating out individual sub-disciplines. Therefore, the purpose of this paper is to describe the development of a survey instrument to specifically measure engineering identity and career aspirations in adolescents and preadolescents. When possible, we utilized existing measures of STEM identity and career aspirations, adapting them when necessary to the elementary school level and to fit the engineering context. The instrument was developed within the context of a multi-year, NSF-funded research project examining the dynamics between undergraduate outreach providers and elementary students to understand the impact of the program on students’ engineering identity and career aspirations. Three phases of survey development were conducted that involved 492 elementary students from diverse communities in the United States. Three sets of items were developed and/or adapted throughout the four phases. The first set of items assessed Engineering Identity. Recent research suggests that identity consists of three components: recognition, interest, and performance/competence. Items assessing each of these constructs were included in the survey. The second and third sets of items reflected Career Interests and Aspirations. Because elementary and middle school students often have a limited or nascent awareness of what engineers do or misconceptions about what a job in science or engineering entails, it is problematic to measure their engineering identity or career aspirations by directly asking them whether they want to be a scientist/engineer or by using a checklist of broad career categories. Therefore, similar to other researchers, the second set of items assessed the types of activities that students are interested in doing as part of a future career, including both non-STEM and STEM (general and engineering-specific) activities. These items were created by the research team or adapted from activity lists used in existing research. The third set of items drew from career counseling measures relying on Holland’s Career Codes. We adapted the format of these instruments by asking students to choose the activity they liked the most from a list of six activities that reflected each of the codes rather than responding to their interest about each activity. Preliminary findings for each set of items will be discussed. Results from the survey contribute to our understanding of engineering identities and career aspirations in preadolescent and adolescent youth. However, our instrument has the potential for broader application in non-engineering STEM environments (e.g., computer science) with minor wording changes to reflect the relevant science subject area. More research is needed in determining its usefulness in this capacity. 
    more » « less