skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Towards Development of an Engineering Design Value-expectancy Scale (EDVES)
As high school programs are increasingly incorporating engineering content into their curricula, a question is raised as to the impacts of those programs on student attitudes towards engineering, in particular engineering design. From a collegiate perspective, there is a related question as to how first-year engineering programs at the college level should adapt to a greater percentage of incoming students with prior conceptions about engineering design and how to efficaciously uncover what those conceptions may be. Further, there is a broader question within engineering design as to how various design experiences, especially introductory experiences, may influence student attitudes towards the subject and towards engineering more broadly. Student attitudes is a broad and well-studied area and a wide array of instruments have been shown to be valid and reliable assessments of various aspects of student motivation, self-efficacy, and interests. In terms of career interests, the STEM Career Interest Survey (STEM-CIS) has been widely used in grade school settings to gauge student intentions to pursue STEM careers, with a subscale focused on engineering. In self-efficacy and motivation, the Value-Expectancy STEM Assessment Scale (VESAS) is a STEM-focused adaptation of the broader Values, Interest, and Expectations Scale (VIES), which in turns builds upon Eccles’ Value-Expectancy model of self-efficacy. When it comes to engineering design, there have been a few attempts to develop more focused instruments, such as Carberry’s Design Self-Efficacy Instrument. For the purposes of this work, evaluating novice and beginning designer attitudes about engineering design, the available instruments were not found to assess the desired attributes. Design-focused instruments such as Carberry’s were too narrowly focused on the stages of the design process, many of which required a certain a priori knowledge to effectively evaluate. Broader instruments such as the VESAS were too focused on working and studying engineering, rather than doing or identifying with engineering. A new instrument, the Engineering Design Value-Expectancy Scale (EDVES) was developed to meet this need. In its current form the EDVES includes 38 items across several subscales covering expectancy of success in, perceived value of, and identification with engineering and design. This work presents the EDVES and discusses the development process of the instrument. It presents validity evidence following the Cook validation evidence model, including scoring, generalization, and extrapolation validity evidence. This validation study was conducted using pre- and post-course deployment with 192 first-year engineering students enrolled in a foundational engineering design course.  more » « less
Award ID(s):
1812823
PAR ID:
10286684
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2021 ASEE Virtual Annual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. As more institutions create first year engineering programs that teach an engineering design process, there is a growing desire to prepare students for this coursework in the high school setting. When exposing such a broad population to these ideas, a primary question arises regarding student attitudes toward engineering and how these attitudes develop over time. That is, how does this exposure to engineering design influence student attitudes toward engineering? Moreover, answering this question will allow educators to better understand what motivates students to learn, how much their motivation impacts their overall mastery of these skills, and how these aspects of engineering self-efficacy and engineering design may differ between those who are on a pre-engineering track and those who are not. To begin answering this question, high school students enrolled in the Olathe City school system of Olathe, Kansas completed Engineering Problem-Framing Design Activities (EPDAs) in participating science courses (AP physics, physics, advanced biotechnology, chemistry, honors chemistry, biology, honors biology, and physical science specifically) of the traditional science and engineering academy curriculums offered by the district. Student engineering self-efficacy and motivation was also measured at the beginning and end of their coursework. This was conducted via a new instrument, the Engineering Design Value-Expectancy Scale (EDVES), which includes 38 items across three primary subscales: expectancy of success in, perceived value of, and identification with engineering and design. The development of this tool was presented and discussed in a previous study where the EDVES instrument was analyzed for validity among first-year undergraduate engineering students. In this work, the responses of high school students on the EDVES were analyzed to establish validity in this new population and to begin exploring trends in student responses based on their sub-population. Validity testing was completed via Cook’s validation evidence model with respect to scoring, generalization, and extrapolation evidence. The pre-course EDVES responses obtained were used to complete validation and trend analysis (note that post-course data was not readily available at the time of analysis). 
    more » « less
  2. Peters, S. A.; Zapata-Cardona, L.; Bonafini, F.; Fan, A. (Ed.)
    Attitudes matter in statistics and data science education, but previous instruments have been limited in scope, resulting in many unanswered questions. This paper discusses the Surveys of Motivational Attitudes toward Statistics and Data Science, a family of instruments designed to provide a broad understanding of university-level student and instructor attitudes as well as learning environment characteristics. Based on Expectancy Value Theory, a meta-model explains the interrelationships among the instruments, and an iterative design process is followed for survey development. Psychometric results from data collections using instruments developed thus far are presented. This is the first time a cohesive, synergistic set of instruments has been designed to work together to give a broader understanding of the state of statistics and data science education. 
    more » « less
  3. This work in progress paper describes the development of an instrument to assess graduate student motivation towards doctoral degree completion. Doctoral attrition rates in the United States have been estimated to be around 40% over a 10 year completion period [8]. King [8] also found that less than 20% of students complete their doctoral programs in the expected timeframe of between 3 and 4 years. These results indicate the need to better understand factors that affect graduate students' experience during their doctoral program, particularly their choice to persist, so we can ensure equal opportunities for Ph.D completion. Spaulding and Rockinson-Szapkiw [12] talk about personal factors that contribute to doctoral students’ persistence. These factors include motivation, strategies for writing the dissertation, time management, and attributes such as credibility, commitment, and increased monetary compensation. As part of this research study, we have selected to focus upon student motivation as motivation theories have been found to provide explanations for factors that influence individuals choices and actions [3]. Specifically, we have selected the Expectancy-Value Theory (EVT) of motivation because it considers social, cultural, and psychological factors [1], making it beneficial for elements that could be relevant in a graduate studies program. This work seeks to create a motivational instrument specific to an engineering graduate studies program setting. Our instrument development process began with the Engineering Motivation Survey, developed by Brown & Matusovich [2]. This survey instrument was designed to measure motivation of undergraduate engineering students towards engineering education and career choices. Ultimately, the purpose was to measure motivational factors that contribute toward choices to pursue and complete engineering degrees. The 35 likert scale questions were rephrased to focus on a graduate student setting. After the rephrasing, the draft survey was used in a Think-aloud protocol with six engineering graduate students to determine what changes may be needed to better support its new area of implementation. Upon finalization of the graduate student engineering motivation survey we will apply it to measure civil and environmental engineering graduate students’ motivation towards their doctoral degree completion as part of their participation in a Graduate Assistance in Areas of National Need (GAANN) program. 
    more » « less
  4. There has been an emerging trend of expanding entrepreneurship educational programs/events to broader student populations. Similarly, the focus of this paper is broadening participation in student innovation competitions, exhibitions, and training programs. Therefore, through student surveys, factors and barriers affecting student participation in these co-curricular programs were explored, with a particular interest being students who are underrepresented in entrepreneurship. The survey items were crafted based on the known scales and theories in the literature, such as the Expectancy-Value-Cost Scale and Self-Determination Theory. The findings revealed that the time commitment and lack of awareness were significant barriers to participation in these activities. To make student innovation competitions, exhibitions, and training programs more accessible and relatable to all students, higher education institutions should consider reframing these events and developing them, requiring less time commitment. The Expectancy-Value-Cost-based framework used in this study is also promising to study students’ engagement with entrepreneurship and innovation-focused co-curricular activities. Keywords: innovation competitions, exhibitions and training programs, participation, factors, expectancy-value-cost. 
    more » « less
  5. Internationally, out-of-school time (OST) science, technology, engineering, and mathematics (STEM) programs abound. However, rigorous evidence of their impacts on student outcomes is scarce. This study evaluated the relationships between OST STEM program participation and student motivational factors in math and science by analyzing survey and administrative data of 1.017 middle school students who participated in the seven-week, STEM-focused Prefreshman Engineering Program (PREP) in San Antonio, Texas, from 2015 to 2017. Multiple regression results indicated that the PREP participation was positively associated with students’ attitudes toward math and interests in math-related careers, whereas the effects on students’ attitudes toward science and career interests in science were negligible. No evidence was found to suggest that the associations between PREP participation and student motivational factors in math and science differed by gender, race/ethnicity, or socioeconomic status. 
    more » « less