skip to main content


Title: First-year students’ agency related to engineering requirements
A key challenge in engineering design problem framing is defining requirements and metrics. This is difficult, in part, because engineers must make decisions about how to treat qualitative and subjective issues, like stakeholder preferences, about how to prioritize different requirements, and about how to maintain tentativeness and ill-structuredness in the solution space. And this is made more challenging in light of the function of requirements in other types of engineering problems, like feasibility analysis, in which the requirements should converge on a decision. Given these challenges, it is unsurprising that there is limited research on how first-year students approach such work, how they make sense of requirements, and how their conceptualizations of requirements change with instruction. Our purpose in this study is to investigate students’ initial understanding and use of engineering requirements in a specific problem solving context. We developed a survey to measure students’ perceptions related to engineering requirements based on constructs derived from the literature on engineering requirements. We implemented the survey in a first-year and in senior courses for the purpose of validating items using factor analysis. Following this, we conducted analysis of survey and interview data restricted to the first-year course, including epistemic beliefs and analysis of students’ agency. Through exploratory factor analysis, we found that factors did not converge around constructs as described in the literature. Rather, factors formed around the forms of information leveraged to develop requirements. Through qualitative analysis of students’ responses on the survey and to interviews, we evaluated the extent to which students expressed agency over their use of requirements to make decisions within a course project. We describe implications of this exploratory study in terms of adapting research instruments to better understand this topic. Further, we consider pedagogical implications for first year programs and beyond in supporting students to develop ownership over decision making related to engineering requirements.  more » « less
Award ID(s):
1751369
NSF-PAR ID:
10385867
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the ASEE Annual Conference and Exhibition
Page Range / eLocation ID:
1-19
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In this research paper, we investigate the structure and validity of survey data related to students’ framing agency. In order to promote increased opportunities for students to engage in and learn to frame design problems that are innovative and empathetic, there is a need for instruments that can provide information about student progress and the quality of learning experiences. This is a complex problem because, compared to problem solving, design problem framing is less studied and harder to predict due to the higher levels of student agency involved. To address this issue, we developed a survey to measure framing agency, which is defined as opportunities to frame and reframe design problems and learn in the process. This study extends past research which focused on the construct of framing agency and developing an instrument to measure it following best practices in survey design, including using exploratory factor analysis of pilot data, which recovered six factors related to shared and individual consequentiality, problem structure and constrainedness, and learning. However, as a pilot, the sample limited generalizability; the current study addresses this limitation. We used a national cohort that included multiple engineering disciplines (biomedical, mechanical, chemical, electrical, computer, aerospace), types of formal design projects (e.g., first-year, design-spine, senior capstone) and institution types, including private religious; Hispanic-serving; public land-grant; and research flagship institutions (N=449). We report sample characteristics and used confirmatory factor analysis (CFA) to provide validity evidence, reporting the chi-square and standardized root mean square residual as estimates of fit. We report Cronbach’s alpha as a measure of internal consistency. We found that overall, the CFA aligned with the prior exploratory results, in this case, recovering four factors, measured on a seven-point scale: shared consequentiality (the extent to which the student identifies that their understanding of the problem changed as result of a teammate’s decision, M = 6.15; SD = 1.13); learning as consequentiality (the extent to which the student identifies learning as the result of decisions, M = 5.88; SD = 0.98); constrainedness (the extent to which the student reports the ability to make decisions despite design constraints, M = 4.95; SD = 1.49); and shared tentativeness (the extent to which the student identifies uncertainty about the problem and solution, M = 4.02; SD = 1.76). This suggests the survey can provide valid data for instructional decisions and further research into how students learn to frame engineering design problems and what role framing plays in their professional formation. 
    more » « less
  2. Laboratory experimentation is a key component of the development of professional engineers. However, experiments conducted in chemical engineering laboratory classes are commonly more prescriptive than the problems faced by practicing engineers, who have agency to make consequential decisions across the experiment and communication of results. Thus, understanding how experiments in laboratory courses vary in offering students opportunities to make such decisions, and how students navigate higher agency learning experiences is important for preparing graduates ready to direct these practices. In this study, we sought to answer the following research questions: How do students perceive their agency in course-based undergraduate research experiences? What factors are measured by the Consequential Agency in Laboratory Experiments survey? To better understand student perceptions of their agency in relation to laboratory experiments, we first conducted a case study of a course-based research experience (CURE) in a senior-level chemical engineering laboratory course. We then surveyed six upper-division laboratory courses across two universities using an initial version of the Consequential Agency in Laboratory Experiments survey. We used exploratory factor analysis to investigate the validity of the data from the survey for measuring relevant constructs of authenticity, agency in specific domains, responsibility, and opportunity to make decisions. We found that with instructional support, students in the CURE recognized that failure could itself provide opportunities for learning. They valued having the agency to make consequential decisions, even when they also found the experience challenging. We also found strong support for items measuring agency as responsibility, authenticity, agency in the communication domain, agency in the experimental design domain, and opportunity to make decisions. These findings give us insight into the value of higher agency laboratory experiments, and they provide a foundation for developing a more precise survey capable of measuring agency across various laboratory experiment practices. Such a survey will enable future studies that investigate the impacts of increasing agency in just one domain versus in several. In turn, this can aid faculty in developing higher agency learning experiences that are more feasible to implement, compared to CUREs. 
    more » « less
  3. Understanding the underlying psychological constructs that affect undergraduate engineering students’ academic achievement and persistence can inform curricular and programmatic changes in engineering education, with the goal of increasing access and advancement in engineering for a diverse population of students. As part of a larger study examining student experiences in a civil engineering department undergoing curricular and cultural changes, this quantitative study investigated the relationship between goal orientation, agency, and time-oriented motivation, differences in this relationship across academic years, and potential influences from personality types. The larger project seeks to examine the motivation, identity, and sense of belonging for undergraduate civil engineering students; this paper seeks to construct a conceptual model explaining the interactive nature of some of these constructs. A previously tested and established survey that draws from multiple theories of motivation and other affective factors such as agency and identity, and that includes Big 5 personality constructs, was used to collect data from second, third-and fourth-year civil engineering students over a two-year period. Prior studies have focused on the instrument’s latent constructs with sense of belonging. However, no analysis has been conducted to examine how some of the constructs influence each other. Specific latent constructs of goal orientation, agency (students’ beliefs that their career in science or engineering can lead to positive effects on the world), FTP, and personality were selected for secondary data analysis based on theory presented in the literature about relationships between motivation, goal setting, agency, and student perceptions of their future. The sample size of respondents was 843; data cleaning and deletion of missing data (65cases; 7.7%) resulted in a final sample size of 778(92.3% of the original data). This included328 second year, 294 third year and 156 fourth year students. Statistical analyses and modeling included bivariate correlational analysis, MANOVA and MANCOVA. Results indicated significant correlation between goal orientation, agency, and time-oriented motivation. Furthermore, differences in these constructs between academic years and personality type influenced the relationship. FTP differed between sophomores and seniors, with seniors having higher scores, suggesting motivation increases as time in the program increases. Personality significantly influenced these relationships in different ways but had the strongest effect on agency. The findings that certain types of people are not only motivated to go into civil engineering but believe their major will make a difference in the world, have implications for educational practice. Results align with current literature but also shed light onto the effects of personality on time-oriented motivation and agency, expanding theory in engineering education. Further research is needed to determine if the effects of personality hold true for other engineering and science majors. 
    more » « less
  4. Laboratory experimentation is a key component of the development of professional engineers. However, experiments conducted in chemical engineering laboratory classes are commonly more prescriptive than the problems faced by practicing engineers, who have agency to make consequential decisions across the experiment and communication of results. Thus, understanding how experiments in laboratory courses vary in offering students opportunities to make such decisions, and how students navigate higher agency learning experiences is important for preparing graduates ready to direct these practices. In this study, we sought to answer the following research question: What factors are measured by the Consequential Agency in Laboratory Experiments survey? To better understand student perceptions of their agency in relation to laboratory experiments, developed an initial version of the Consequential Agency in Laboratory Experiments survey, following research-based survey development guidelines. We implemented it in six upper-division laboratory courses across two universities. We used exploratory factor analysis to investigate the validity of the data from the survey for measuring relevant constructs of authenticity, agency in specific domains, responsibility, and opportunity to make decisions. We found strong support for items measuring agency as responsibility, authenticity, agency in the communication domain, agency in the experimental design domain, and opportunity to make decisions. These findings provide a foundation for developing a more precise survey capable of measuring agency across various laboratory experiment practices. Such a survey will enable future studies that investigate the impacts of increasing agency in just one domain versus in several. In turn, this can aid faculty in developing higher agency learning experiences that are more feasible to implement, compared to authentic research experiences. 
    more » « less
  5. Laboratory experimentation is a key component of the development of professional engineers. However, experiments conducted in chemical engineering laboratory classes are commonly more prescriptive than the problems faced by practicing engineers, who have agency to make consequential decisions across the experiment and communication of results. Thus, understanding how experiments in laboratory courses vary in offering students opportunities to make such decisions, and how students navigate higher agency learning experiences is important for preparing graduates ready to direct these practices. In this study, we sought to answer the following research question: What factors are measured by the Consequential Agency in Laboratory Experiments survey? To better understand student perceptions of their agency in relation to laboratory experiments, developed an initial version of the Consequential Agency in Laboratory Experiments survey, following research-based survey development guidelines. We implemented it in six upper-division laboratory courses across two universities. We used exploratory factor analysis to investigate the validity of the data from the survey for measuring relevant constructs of authenticity, agency in specific domains, responsibility, and opportunity to make decisions. We found strong support for items measuring agency as responsibility, authenticity, agency in the communication domain, agency in the experimental design domain, and opportunity to make decisions. These findings provide a foundation for developing a more precise survey capable of measuring agency across various laboratory experiment practices. Such a survey will enable future studies that investigate the impacts of increasing agency in just one domain versus in several. In turn, this can aid faculty in developing higher agency learning experiences that are more feasible to implement, compared to authentic research experiences. 
    more » « less