skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Towards Development of an Engineering Design Value-expectancy Scale (EDVES)
As high school programs are increasingly incorporating engineering content into their curricula, a question is raised as to the impacts of those programs on student attitudes towards engineering, in particular engineering design. From a collegiate perspective, there is a related question as to how first-year engineering programs at the college level should adapt to a greater percentage of incoming students with prior conceptions about engineering design and how to efficaciously uncover what those conceptions may be. Further, there is a broader question within engineering design as to how various design experiences, especially introductory experiences, may influence student attitudes towards the subject and towards engineering more broadly. Student attitudes is a broad and well-studied area and a wide array of instruments have been shown to be valid and reliable assessments of various aspects of student motivation, self-efficacy, and interests. In terms of career interests, the STEM Career Interest Survey (STEM-CIS) has been widely used in grade school settings to gauge student intentions to pursue STEM careers, with a subscale focused on engineering. In self-efficacy and motivation, the Value-Expectancy STEM Assessment Scale (VESAS) is a STEM-focused adaptation of the broader Values, Interest, and Expectations Scale (VIES), which in turns builds upon Eccles’ Value-Expectancy model of self-efficacy. When it comes to engineering design, there have been a few attempts to develop more focused instruments, such as Carberry’s Design Self-Efficacy Instrument. For the purposes of this work, evaluating novice and beginning designer attitudes about engineering design, the available instruments were not found to assess the desired attributes. Design-focused instruments such as Carberry’s were too narrowly focused on the stages of the design process, many of which required a certain a priori knowledge to effectively evaluate. Broader instruments such as the VESAS were too focused on working and studying engineering, rather than doing or identifying with engineering. A new instrument, the Engineering Design Value-Expectancy Scale (EDVES) was developed to meet this need. In its current form the EDVES includes 38 items across several subscales covering expectancy of success in, perceived value of, and identification with engineering and design. This work presents the EDVES and discusses the development process of the instrument. It presents validity evidence following the Cook validation evidence model, including scoring, generalization, and extrapolation validity evidence. This validation study was conducted using pre- and post-course deployment with 192 first-year engineering students enrolled in a foundational engineering design course.  more » « less
Award ID(s):
1812823
PAR ID:
10286684
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2021 ASEE Virtual Annual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. As more institutions create first year engineering programs that teach an engineering design process, there is a growing desire to prepare students for this coursework in the high school setting. When exposing such a broad population to these ideas, a primary question arises regarding student attitudes toward engineering and how these attitudes develop over time. That is, how does this exposure to engineering design influence student attitudes toward engineering? Moreover, answering this question will allow educators to better understand what motivates students to learn, how much their motivation impacts their overall mastery of these skills, and how these aspects of engineering self-efficacy and engineering design may differ between those who are on a pre-engineering track and those who are not. To begin answering this question, high school students enrolled in the Olathe City school system of Olathe, Kansas completed Engineering Problem-Framing Design Activities (EPDAs) in participating science courses (AP physics, physics, advanced biotechnology, chemistry, honors chemistry, biology, honors biology, and physical science specifically) of the traditional science and engineering academy curriculums offered by the district. Student engineering self-efficacy and motivation was also measured at the beginning and end of their coursework. This was conducted via a new instrument, the Engineering Design Value-Expectancy Scale (EDVES), which includes 38 items across three primary subscales: expectancy of success in, perceived value of, and identification with engineering and design. The development of this tool was presented and discussed in a previous study where the EDVES instrument was analyzed for validity among first-year undergraduate engineering students. In this work, the responses of high school students on the EDVES were analyzed to establish validity in this new population and to begin exploring trends in student responses based on their sub-population. Validity testing was completed via Cook’s validation evidence model with respect to scoring, generalization, and extrapolation evidence. The pre-course EDVES responses obtained were used to complete validation and trend analysis (note that post-course data was not readily available at the time of analysis). 
    more » « less
  2. Internationally, out-of-school time (OST) science, technology, engineering, and mathematics (STEM) programs abound. However, rigorous evidence of their impacts on student outcomes is scarce. This study evaluated the relationships between OST STEM program participation and student motivational factors in math and science by analyzing survey and administrative data of 1.017 middle school students who participated in the seven-week, STEM-focused Prefreshman Engineering Program (PREP) in San Antonio, Texas, from 2015 to 2017. Multiple regression results indicated that the PREP participation was positively associated with students’ attitudes toward math and interests in math-related careers, whereas the effects on students’ attitudes toward science and career interests in science were negligible. No evidence was found to suggest that the associations between PREP participation and student motivational factors in math and science differed by gender, race/ethnicity, or socioeconomic status. 
    more » « less
  3. There is little research or understanding of curricular differences between two- and four-year programs, career development of engineering technology (ET) students, and professional preparation for ET early career professionals [1]. Yet, ET credentials (including certificates, two-, and four-year degrees) represent over half of all engineering credentials awarded in the U.S [2]. ET professionals are important hands-on members of engineering teams who have specialized knowledge of components and engineering systems. This research study focuses on how career orientations affect engineering formation of ET students educated at two-year colleges. The theoretical framework guiding this study is Social Cognitive Career Theory (SCCT). SCCT is a theory which situates attitudes, interests, and experiences and links self-efficacy beliefs, outcome expectations, and personal goals to educational and career decisions and outcomes [3]. Student knowledge of attitudes toward and motivation to pursue STEM and engineering education can impact academic performance and indicate future career interest and participation in the STEM workforce [4]. This knowledge may be measured through career orientations or career anchors. A career anchor is a combination of self-concept characteristics which includes talents, skills, abilities, motives, needs, attitudes, and values. Career anchors can develop over time and aid in shaping personal and career identity [6]. The purpose of this quantitative research study is to identify dimensions of career orientations and anchors at various educational stages to map to ET career pathways. The research question this study aims to answer is: For students educated in two-year college ET programs, how do the different dimensions of career orientations, at various phases of professional preparation, impact experiences and development of professional profiles and pathways? The participants (n=308) in this study represent three different groups: (1) students in engineering technology related programs from a medium rural-serving technical college (n=136), (2) students in engineering technology related programs from a large urban-serving technical college (n=52), and (3) engineering students at a medium Research 1 university who have transferred from a two-year college (n=120). All participants completed Schein’s Career Anchor Inventory [5]. This instrument contains 40 six-point Likert-scale items with eight subscales which correlate to the eight different career anchors. Additional demographic questions were also included. The data analysis includes graphical displays for data visualization and exploration, descriptive statistics for summarizing trends in the sample data, and then inferential statistics for determining statistical significance. This analysis examines career anchor results across groups by institution, major, demographics, types of educational experiences, types of work experiences, and career influences. This cross-group analysis aids in the development of profiles of values, talents, abilities, and motives to support customized career development tailored specifically for ET students. These findings contribute research to a gap in ET and two-year college engineering education research. Practical implications include use of findings to create career pathways mapped to career anchors, integration of career development tools into two-year college curricula and programs, greater support for career counselors, and creation of alternate and more diverse pathways into engineering. Words: 489 References [1] National Academy of Engineering. (2016). Engineering technology education in the United States. Washington, DC: The National Academies Press. [2] The Integrated Postsecondary Education Data System, (IPEDS). (2014). Data on engineering technology degrees. [3] Lent, R.W., & Brown, S.B. (1996). Social cognitive approach to career development: An overivew. Career Development Quarterly, 44, 310-321. [4] Unfried, A., Faber, M., Stanhope, D.S., Wiebe, E. (2015). The development and validation of a measure of student attitudes toward science, technology, engineeirng, and math (S-STEM). Journal of Psychoeducational Assessment, 33(7), 622-639. [5] Schein, E. (1996). Career anchors revisited: Implications for career development in the 21st century. Academy of Management Executive, 10(4), 80-88. [6] Schein, E.H., & Van Maanen, J. (2013). Career Anchors, 4th ed. San Francisco: Wiley. 
    more » « less
  4. Peters, S. A.; Zapata-Cardona, L.; Bonafini, F.; Fan, A. (Ed.)
    Attitudes matter in statistics and data science education, but previous instruments have been limited in scope, resulting in many unanswered questions. This paper discusses the Surveys of Motivational Attitudes toward Statistics and Data Science, a family of instruments designed to provide a broad understanding of university-level student and instructor attitudes as well as learning environment characteristics. Based on Expectancy Value Theory, a meta-model explains the interrelationships among the instruments, and an iterative design process is followed for survey development. Psychometric results from data collections using instruments developed thus far are presented. This is the first time a cohesive, synergistic set of instruments has been designed to work together to give a broader understanding of the state of statistics and data science education. 
    more » « less
  5. null (Ed.)
    Purpose The unequitable representation among genders in science, technology, engineering and mathematics (STEM) degrees and careers remains a persisting challenge. Peer mentoring has been cited as one method for supporting women and racial and ethnic minorities in becoming interested in, experiencing self-efficacy in and persisting in STEM. The current study was undertaken to explore how and in what ways peer mentors' participation in the program (namely, the mentoring experience) influenced their STEM self-efficacy beliefs, interests, skills and behaviors, including their intent to persist and actual persistence in STEM. Design/methodology/approach Using a multisite case study design, the current study implemented a blended peer mentoring program at two historically black institutions. Findings The experience in the peer mentoring process increased mentors' self-efficacy, career interest, perceived mentoring skill development in most areas and intent to persist in STEM. Evidence from the interviews and open-ended survey questions demonstrated that the peer mentoring experience had a direct influence on the mentor's self-efficacy, career interest, leadership and professional skills and persistence. The thematic analysis of the data sources revealed that specific elements of the peer mentoring experience influenced mentors' beliefs, interests, skills and behaviors, including recognition, functioning as a mentor, developing an other's orientation, engaging in a sisterhood and developing competencies. Originality/value Findings support the benefit of the blended peer mentoring program model among women who identify as a racial or ethnic minority across two historically black college or universities (HBCUs). Peer mentoring programs should include training to increase competencies and skills, should provide resources targeted to specific mentor needs and should include opportunities for self-reflection and components of faculty support. 
    more » « less