skip to main content


Title: Measuring adaptive expertise amongst first-year STEM students
Engineering programs must weave coverage of disciplinary content with the ability of students to apply and extend this content knowledge to new contexts and for use in their professional practice as engineers. It is, therefore, necessary for schools to promote and cultivate additional dispositions within their students that better enable them to adapt and employ their disciplinary knowledge. The concept of an “adaptive expert” (AE) has been previously developed within the learning sciences to describe an individual with deep content knowledge but who also displays additional cognitive characteristics that better enable them to employ their knowledge and skills in practice. Four constructs have been identified in the literature as forming the basis of this adaptive expertise: 1) multiple perspectives (MP), 2) metacognition (META), 3) goals and beliefs (GB), and 4) epistemology (EPIST). Upon entry to an engineering program, it is likely that students will present with different levels of development and awareness within these particular dimensions. Baseline levels must, therefore, be measured in order to assess these levels of development and before research-based practices and activities can be designed to promote growth in these constructs. In this work-in-progress study, the “adaptiveness” of incoming undergraduate STEM students (n=711) is measured using a previously developed validated survey instrument used in other studies to measure levels of adaptive expertise amongst undergraduate students by determining their levels along the four identified dimensions of AE. Based on this survey data, statistically significant differences were found in the AE constructs for men and women, with women outscoring men in three of the four AE subscales (MP, META, EPIST) and men outscoring women in goals and beliefs (GB). White students were found to score statistically higher than Asian students in both multiple perspectives (MP) and goals and beliefs (GB), while no statistically significant differences were observed when White and Black/African American students were compared. The mean epistemology (EPIST) scores for White, non-Hispanic students was statistically higher than Hispanic students, with low-income students scoring lower than non-low-income students on this subscale. This project seeks to provide baseline data concerning the adaptivity of incoming first-year students. A structured mentoring program focusing on elements of AE will then be implemented and student growth in the dimensions of AE assessed through their program of study.  more » « less
Award ID(s):
2130428
NSF-PAR ID:
10438261
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
2022 ASEE Mid-Atlantic Section Spring Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. One of the goals of undergraduate education is to prepare students to adapt to a challenging career that requires continual learning and application of knowledge. Working professionals should have deep conceptual knowledge that they can apply in a range of contexts and possess the attitudes and skills of lifelong learners. The literature suggests the concept of Adaptive Expertise (AE), which can be defined as the ability to apply and extend knowledge and skills to new situations, describes some of these characteristics. Survey data concerning the level of AE displayed by various populations is extremely limited in most contexts, be it education or working professionals. As such, data concerning the level of adaptiveness displayed among various groups needs to be measured if activities designed to promote the development of AE are to be created and then tested in terms of their efficacy. This investigation provides this critical baseline data for future studies as we track the AE development of individual, first-year college students through their undergraduate program of study, with a focus on low-income students as a means to support retention. In this work, we assessed adaptive expertise among low-income STEM students using surveys and interviews. Low-income STEM students from various stages of their four year undergraduate program (n=208) completed an adaptive expertise survey in spring 2022. Following the survey, 24 of the low-income students (6 per year, 3 male, 3 female) were selected for targeted qualitative interviews to better understand the differences displayed by low and high AE students. Survey results from prior studies were used to draw comparisons between adaptiveness of low-income and non-low-income students. Results of the AE survey indicated no statistically-significant differences between low-income and non-low-income first-year students in terms of their level of adaptiveness. In addition, the level of AE displayed by low-income students increased through the program in a manner similar to that of non-low-income STEM students. Themes that emerged from the interviews included a general understanding of the importance and likelihood of learning new concepts continually while working in a professional role, and that students expressed growth in understanding the acceptance of reaching out for assistance from other students and faculty after exploring information on their own as they work through challenges in their academic assignments. Two dominant and divergent metacognitive processes were also observed: teaching/explaining concepts to others (highly adaptive) or primarily relying on exam/course grades for feedback on learning (low adaptiveness). Data gathered from interviews demonstrate the need for a greater emphasis on metacognitive practice to promote various aspects of AE. 
    more » « less
  2. Lin, Chung-Ying (Ed.)
    Background University students are increasingly recognized as a vulnerable population, suffering from higher levels of anxiety, depression, substance abuse, and disordered eating compared to the general population. Therefore, when the nature of their educational experience radically changes—such as sheltering in place during the COVID-19 pandemic—the burden on the mental health of this vulnerable population is amplified. The objectives of this study are to 1) identify the array of psychological impacts COVID-19 has on students, 2) develop profiles to characterize students' anticipated levels of psychological impact during the pandemic, and 3) evaluate potential sociodemographic, lifestyle-related, and awareness of people infected with COVID-19 risk factors that could make students more likely to experience these impacts. Methods Cross-sectional data were collected through web-based questionnaires from seven U.S. universities. Representative and convenience sampling was used to invite students to complete the questionnaires in mid-March to early-May 2020, when most coronavirus-related sheltering in place orders were in effect. We received 2,534 completed responses, of which 61% were from women, 79% from non-Hispanic Whites, and 20% from graduate students. Results Exploratory factor analysis on close-ended responses resulted in two latent constructs, which we used to identify profiles of students with latent profile analysis, including high (45% of sample), moderate (40%), and low (14%) levels of psychological impact. Bivariate associations showed students who were women, were non-Hispanic Asian, in fair/poor health, of below-average relative family income, or who knew someone infected with COVID-19 experienced higher levels of psychological impact. Students who were non-Hispanic White, above-average social class, spent at least two hours outside, or less than eight hours on electronic screens were likely to experience lower levels of psychological impact. Multivariate modeling (mixed-effects logistic regression) showed that being a woman, having fair/poor general health status, being 18 to 24 years old, spending 8 or more hours on screens daily, and knowing someone infected predicted higher levels of psychological impact when risk factors were considered simultaneously. Conclusion Inadequate efforts to recognize and address college students’ mental health challenges, especially during a pandemic, could have long-term consequences on their health and education. 
    more » « less
  3. The purpose of the Research in the Formation of Engineers National Science Foundation funded project, Developing Engineering Experiences and Pathways in Engineering Technology Career Formation (D.E.E.P. Engineering Technology Career Formation), is to develop a greater understanding of the professional identity, institutional culture, and formation of engineer technicians and technologists (ET) who are prepared at two-year colleges. ET professionals are important hands-on members of engineering teams who have specialized knowledge of components and engineering systems. Little research on career development and the role of ET in the workforce has previously been conducted prompting national organizations such as NSF and the National Academy of Sciences to prompt more research in this area [1]. The primary objectives of this project are to: (a) identify dimensions of career orientations and anchors at various stages of professional preparation and map to ET career pathways, (b) develop an empirical framework, incorporating individual career anchors and effect of institutional culture, for understanding ET professional formation, and (c) develop and pilot interventions aimed at transforming engineering formation systems in ET contexts. The three interdisciplinary theoretical frameworks integrated to guide design and analysis of this research study are social cognitive career theory (SCCT) [2], Schein’s career anchors which focuses on individual career orientation [3], and the Hughes value framework focused on the organization [4]. SCCT which links self-efficacy beliefs, outcome expectations, and personal goals to educational and career decisions and outcomes ties the individual career anchors to the institutional context of the Hughes framework [2]. To date, the project has collected and analyzed quantitative data from over 330 participants who are two-year college ET students, two-year college transfer students, and early career ET professionals. Qualitative data from historical institutional documents has also been collected and analyzed. Initial analyses have revealed gaps and needed areas of support for ET students in the area of professional formation. Thus far, the identified gaps are in institutional policy (i.e. lack of articulation agreements), needed faculty professional development (i.e. two-year faculty on specific career development and professional ET formation needs and four-year faculty on unique needs of transfer students), missing curriculum and resources supporting career development and professional formation of ET students, and integration of transfer student services focusing on connecting faculty and advisors across both institutional levels and types of programs. Significant gaps in the research promoting understanding of the role of ET and unique professional formation needs of these students were also confirmed. This project has been successful at helping to broaden participation in ET engineering education through integrating new participants into activities (new four-year institutional stakeholders, new industry partners, new faculty and staff directly and indirectly working with ET students) and through promoting disciplinary (engineering education and ET) and cross disciplinary collaborations (human resource development, higher education leadership, and student affairs). With one year remaining before completion of this project, this project has promoted a better understanding of student and faculty barriers supporting career development for ET students and identified need for career development resources and curriculum in ET. Words: 498 References [1] National Academy of Engineering. (2016). Engineering technology education in the United States. Washington, DC: The National Academies Press. [2] Lent, R.W., & Brown, S.B. (1996). Social cognitive approach to career development: An overivew. Career Development Quarterly, 44, 310-321. [3] Schein, E. (1996). Career anchors revisited: Implications for career development in the 21st century. Academy of Management Executive, 10(4), 80-88. [4] Hughes, C. (2014, Spring). Conceptualizing the five values of people and technology development: Implications for human resource managmeent and development. Workforce Education Forum, 37(1), 23-44. 
    more » « less
  4. Additive manufacturing (AM) is prevalent in academic, industrial, and layperson use for the design and creation of objects via joining materials together in a layer upon layer fashion. However, few universities have an undergraduate course dedicated to it. Thus, using NSF IUSE support [grant number redacted for review] from the Exploration and Design Tier of the Engaged Student Learning Track, this project has created and implemented such a course at three large universities: Texas Tech (a Carnegie high research productivity and Hispanic Serving Institution), Kansas State (a Carnegie high research productivity and land grant university) and California State, Northridge (the largest of all the California State campuses and highly ranked in serving underprivileged students). Our research team includes engineering professors and a sociologist trained in assessment and K-12 outreach to determine the effects of the course on the undergraduate and high school students. We are currently in year two of the three years of NSF support. The course focuses on the fundamentals of the three families of prevailing AM processes: extrusion-based, powder-based, and liquid-based, as well as learning about practical solutions to additive manufacturing of common engineering materials including polymers, metals and alloys, ceramics, and composites. It has a lecture plus lab format, in that students learn the fundamentals in a classroom, but then apply and broaden their knowledge in lab projects and independent studies. Additionally, as outreach, we host field trips from local high schools during which the undergraduates give presentations about discrete AM skills, then lead the high school students through a lab project focused on those skills. This creates a pipeline of knowledge about AM for younger students as well as an opportunity for undergraduates to develop leadership and speaking skills while solidifying their knowledge. We are also in the process of uploading videos and lab projects to an online Google Classroom so that those with access to 3D printers in other areas can learn online for free. We are also self-publishing an accompanying textbook and lab manual. Beyond the course itself, one of the innovations of our project is the assessment strategy. For both undergraduates and high school students, we have been able to collect content area knowledge both before and after the class, as well as information about their attitudes towards engineering and self-efficacy beliefs. This has been particularly illuminating in regards to subgroups like women and students of color. Our research questions include: i) what is the knowledge growth about AM during this course? ii) does this differ by university? iii) does this differ by gender or race? iv) what are the best ways to make this course portable to other universities? Preliminary results indicate a statistically significant improvement in knowledge for all students. This was particularly true for women, which may indicate the promise of AM courses in decreasing the female dropout rate in engineering. Attitudes towards engineering and self-efficacy perceptions also differed after the class, but in varying ways by demographic subgroups and university. This will be explored more in the paper. 
    more » « less
  5. This Research Full paper focuses on perceptions and experiences of freshman and sophomore engineering students when playing an online serious engineering game that was designed to improve engineering intuition and knowledge of statics. Use of serious educational engineering games has increased in engineering education to help students increase technical competencies in engineering disciplines. However, few have investigated how these engineering games are experienced by the students; how games influence students' perceptions of learning, or how these factors may lead to inequitable perspectives among diverse populations of students. Purpose/Hypothesis: The purpose of this study was to explore the perceptions, appeal, and opinions about the efficacy of educational online games among a diverse population of students in an engineering mechanics statics course. It was hypothesized that compared to majority groups (e.g., men, White), women of color who are engineering students would experience less connections to the online educational game in terms of ease of use and level of frustration while playing. It is believed that these discordant views may negatively influence the game's appeal and efficacy towards learning engineering in this population of students. Design/Method: The Technology Acceptance Model (TAM) is expanded in this study, where the perspectives of women of colour (Latinx, Asian and African American) engineering students are explored. The research approach employed in this study is a mixed-method sequential exploratory design, where students first played the online engineering educational game, then completed a questionnaire, followed by participation in a focus group. Responses were initially analyzed through open and magnitude coding approaches to understand whether students thought these educational games reflected their personal culture. Results: Preliminary results indicate that though the majority of the students were receptive to using the online engineering software for their engineering education, merely a few intimated that they would use this software for engineering exam or technical job interview preparation. A level-one categorical analysis identified a few themes that comprised unintended preservation of inequality in favor of students who enjoyed contest-based education and game technology. Competition-based valuation of presumed mastery of course content fostered anxiety and intimidation among students, which caused some to "game the game" instead of studying the material, to meet grade goals. Some students indicated that they spent more time (than necessary) to learn the goals of the game than engineering content itself, suggesting a need to better integrate course material while minimizing cognitive effort in learning to navigate the game. Conclusions: Preliminary results indicate that engineering software's design and the way is coupled with course grading and assessment of learning outcomes, affect student perceptions of the technology's acceptance, usefulness, and ease of use as a "learning tool." Students were found to have different expectations of serious games juxtaposed software/apps designed for entertainment. Conclusions also indicate that acceptance of inquiry-based educational games in a classroom among diverse populations of students should clearly articulate and connect the game goals/objectives with class curriculum content. Findings also indicate that a multifaceted schema of tools, such as feedback on game challenges, and explanations for predictions of the game should be included in game/app designs. 
    more » « less