Search for: All records

This is the first of a series of studies that explore the relationship between disciplinary background and the weighting of various elements of a manuscript in peer reviewers’ determination of publication recommendations. Research questions include: (1) To what extent are tacit criteria for determining quality or value of EER manuscripts influenced by reviewers’ varied disciplinary backgrounds and levels of expertise? and (2) To what extent does mentored peer review professional development influence reviewers’ EER manuscript evaluations? Data were collected from 27 mentors and mentees in a peer review professional development program. Participants reviewed the same two manuscripts, using a form to identify strengths, weaknesses, and recommendations. Responses were coded by two researchers (70% IRR). Our findings suggest that disciplinary background influences reviewers’ evaluation of EER manuscripts. We also found evidence that professional development can improve reviewers’ understanding of EER disciplinary conventions. Deeper understanding of the epistemological basis for manuscript reviews may reveal ways to strengthen professional preparation in engineering education as well as other disciplines.

This paper describes the Engineering Education Research (EER) Peer Review Training (PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences. Supported by the National Science Foundation, the overall programmatic goals of the PERT project are to establish and evaluate a mentored reviewer program for 1) EER journal manuscripts and 2) EER grant proposals. Concurrently, the project seeks to explore how EER scholars develop schema for evaluating EER scholarship, whether these schema are shared in the community, and how schema influence recommendations made to journal editors during the peer review process. To accomplish these goals, the PERT project leveraged the previously established Journal of Engineering Education (JEE) Mentored Reviewer Program, where two researchers with little reviewing experience are paired with an experienced mentor to complete three manuscript reviews collaboratively. In this paper we report on focus group and exit survey findings from the JEE Mentored Reviewer Program and discuss revisions to the program in response to those findings.

There are significant disparities between the conferring of science, technology, engineering, and mathematics (STEM) bachelor’s degrees to minoritized groups and the number of STEM faculty that represent minoritized groups at four-year predominantly White institutions (PWIs). Studies show that as of 2019, African American faculty at PWIs have increased by only 2.3% in the last 20 years. This study explores the ways in which this imbalance affects minoritized students in engineering majors. Our research objective is to describe the ways in which African American students navigate their way to success in an engineering program at a PWI where the minoritized faculty representation is less than 10%. In this study, we define success as completion of an undergraduate degree and matriculation into a Ph.D. program. Research shows that African American students struggle with feeling like the “outsider within” in graduate programs and that the engineering culture can permeate from undergraduate to graduate programs. We address our research objective by conducting interviews using navigational capital as our theoretical framework, which can be defined as resilience, academic invulnerability, and skills. These three concepts come together to denote the journey of an individual as they achieve success in an environment not created with them inmore »mind. Navigational capital has been applied in education contexts to study minoritized groups, and specifically in engineering education to study the persistence of students of color. Research on navigational capital often focuses on how participants acquire resources from others. There is a limited focus on the experience of the student as the individual agent exercising their own navigational capital. Drawing from and adapting the framework of navigational capital, this study provides rich descriptions of the lived experiences of African American students in an engineering program at a PWI as they navigated their way to academic success in a system that was not designed with them in mind. This pilot study took place at a research-intensive, land grant PWI in the southeastern United States. We recruited two students who identify as African American and are in the first year of their Ph.D. program in an engineering major. Our interview protocol was adapted from a related study about student motivation, identity, and sense of belonging in engineering. After transcribing interviews with these participants, we began our qualitative analysis with a priori coding, drawing from the framework of navigational capital, to identify the experiences, connections, involvement, and resources the participants tapped into as they maneuvered their way to success in an undergraduate engineering program at a PWI. To identify other aspects of the participants’ experiences that were not reflected in that framework, we also used open coding. The results showed that the participants tapped into their navigational capital when they used experiences, connections, involvement, and resources to be resilient, academically invulnerable, and skillful. They learned from experiences (theirs or others’), capitalized on their connections, positioned themselves through involvement, and used their resources to achieve success in their engineering program. The participants identified their experiences, connections, and involvement. For example, one participant who came from a blended family (African American and White) drew from the experiences she had with her blended family. Her experiences helped her to understand the cultures of Black and White people. She was able to turn that into a skill to connect with others at her PWI. The point at which she took her familial experiences to use as a skill to maneuver her way to success at a PWI was an example of her navigational capital. Another participant capitalized on his connections to develop academic invulnerability. He was able to build his connections by making meaningful relationships with his classmates. He knew the importance of having reliable people to be there for him when he encountered a topic he did not understand. He cultivated an environment through relationships with classmates that set him up to achieve academic invulnerability in his classes. The participants spoke least about how they used their resources. The few mentions of resources were not distinct enough to make any substantial connection to the factors that denote navigational capital. The participants spoke explicitly about the PWI culture in their engineering department. From open coding, we identified the theme that participants did not expect to have role models in their major that looked like them and went into their undergraduate experience with the understanding that they will be the distinct minority in their classes. They did not make notable mention of how a lack of minority faculty affected their success. Upon acceptance, they took on the challenge of being a racial minority in exchange for a well-recognized degree they felt would have more value compared to engineering programs at other universities. They identified ways they maneuvered around their expectation that they would not have representative role models through their use of navigational capital. Integrating knowledge from the framework of navigational capital and its existing applications in engineering and education allows us the opportunity to learn from African American students that have succeeded in engineering programs with low minority faculty representation. The future directions of this work are to outline strategies that could enhance the path of minoritized engineering students towards success and to lay a foundation for understanding the use of navigational capital by minoritized students in engineering at PWIs. Students at PWIs can benefit from understanding their own navigational capital to help them identify ways to successfully navigate educational institutions. Students’ awareness of their capacity to maintain high levels of achievement, their connections to networks that facilitate navigation, and their ability to draw from experiences to enhance resilience provide them with the agency to unleash the invisible factors of their potential to be innovators in their collegiate and work environments.« less

Understanding the underlying psychological constructs that affect undergraduate engineering students’ academic achievement and persistence can inform curricular and programmatic changes in engineering education, with the goal of increasing access and advancement in engineering for a diverse population of students. As part of a larger study examining student experiences in a civil engineering department undergoing curricular and cultural changes, this quantitative study investigated the relationship between goal orientation, agency, and time-oriented motivation, differences in this relationship across academic years, and potential influences from personality types. The larger project seeks to examine the motivation, identity, and sense of belonging for undergraduate civil engineering students; this paper seeks to construct a conceptual model explaining the interactive nature of some of these constructs. A previously tested and established survey that draws from multiple theories of motivation and other affective factors such as agency and identity, and that includes Big 5 personality constructs, was used to collect data from second, third-and fourth-year civil engineering students over a two-year period. Prior studies have focused on the instrument’s latent constructs with sense of belonging. However, no analysis has been conducted to examine how some of the constructs influence each other. Specific latent constructs of goal orientation, agencymore »(students’ beliefs that their career in science or engineering can lead to positive effects on the world), FTP, and personality were selected for secondary data analysis based on theory presented in the literature about relationships between motivation, goal setting, agency, and student perceptions of their future. The sample size of respondents was 843; data cleaning and deletion of missing data (65cases; 7.7%) resulted in a final sample size of 778(92.3% of the original data). This included328 second year, 294 third year and 156 fourth year students. Statistical analyses and modeling included bivariate correlational analysis, MANOVA and MANCOVA. Results indicated significant correlation between goal orientation, agency, and time-oriented motivation. Furthermore, differences in these constructs between academic years and personality type influenced the relationship. FTP differed between sophomores and seniors, with seniors having higher scores, suggesting motivation increases as time in the program increases. Personality significantly influenced these relationships in different ways but had the strongest effect on agency. The findings that certain types of people are not only motivated to go into civil engineering but believe their major will make a difference in the world, have implications for educational practice. Results align with current literature but also shed light onto the effects of personality on time-oriented motivation and agency, expanding theory in engineering education. Further research is needed to determine if the effects of personality hold true for other engineering and science majors.« less

This paper describes a peer reviewer mentoring program called the Engineering Education Research Peer Review Training (EER PERT) project and serves as a pilot study on longitudinal effects on researchers’ productivity and the impact of their work, differences in these factors for those who review journal manuscripts and those who review grant proposals, and what aspects of peer review training (knowledge, resources, collaborations, etc.) participants actually carry forward in their own research. Overall, the project seeks to investigate how engineering education research (EER) scholars develop skills and schema for reviewing scholarship, particularly in terms of developing constructive reviews that build expertise and advance knowledge. The Journal of Engineering Education (JEE) Mentored Reviewer Program constitutes the first phase of the EER PERT project. In this paper, we report on goals, structure and activities for the JEE Mentored Reviewer Program, pilot data from participants’ applications and exit surveys that will inform the EER PERT project in terms of participants’ developing skills and schema for reviewing and conducting EER, and provide initial suggestions from the training program that may benefit scholars new to EER.

https://peer.asee.org/27950 This paper presents results of work completed on our project, Intersectionality of Non-normative Identities in the Cultures of Engineering (InIce). The overarching focus of this project is on how students who hold non-normative identities position themselves, grow through their education, and navigate the cultures of engineering they experience in college. Our goal is to investigate ways to engage students who hold non-normative identities to become more active and lifelong participants in engineering disciplines. Our work is proceeding in three phases: 1) Identify, through a quantitative instrument, the attitudinal profiles of normative and non-normative students in engineering; 2) Characterize students’ normative and non-normative identities through in-depth interviews and analysis of differences between students with normative and non-normative identities in engineering; and 3) Drawing from our findings, develop a workshop and set of courses to incorporate diversity topics into engineering programs to enhance the culture of engineering to be more responsive towards, and inclusive of, a diverse range of student identities. We have completed the first phase of the project in which we quantitatively measured and characterized student groups with normative and non-normative identities in engineering. Our definitions of normative and non-normative for this project are developed through Topological Data Analysismore »(TDA) of a set of multi-institution survey data (n = 2916). TDA allows identification of groups without imposing a priori hypotheses on how the attitudes of students may group together (nor how they may distinguish between demographic groups). This approach allows the underlying structure of the data to emerge rather than imposing pre-defined definitions of normative attitudes or identities. Our TDA results revealed one group that contains a relatively large number of students (the “normative” group) and a total of seven other distinct, but relatively populated, groups (the “non-normative” groups). We have compiled a summary of the most salient attitudinal constructs in terms of characterizing and distinguishing between all these groups including: motivation (value, goal orientation, future time perspective), engineering and physics identities (performance/competence and recognition beliefs for each), personality traits (neuroticism, extraversion, belongingness) and grit (consistency of interest). We are currently in Phase 2 of our study in which we are conducting a series of qualitative, longitudinal interviews with students selected from normative and non-normative groups to understand how they navigate their engineering experiences and define their educational trajectories over the first two years of college. This data will be deductively analyzed based on our existing attitudinal frameworks as well as inductively coded for emerging themes on how students feel belongingness within engineering culture. This project promises to move traditional measures of demographic data beyond socially constructed perceptions of others and allows for the representation of student diversity from the perspective of each participant. This more accurate reflection of diversity provides novel insight into the experiences of students who might otherwise be ignored or unjustifiably lumped in with other students with whom they share some demographic indicator and how residing at the intersection of multiple measures of diversity can influence students’ experiences in engineering culture.« less