skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Impact of the Emerging Engineering Education Research and Innovation Community
The Engineering Education departments at three large public universities are collaborating on an NSF-funded program to document the impact of the emerging EER&I community. This paper is a report on what has been learned to date. Goals of the program include (1) identifying the broader EER&I network, (2) identifying examples of EER&I impact, (3) organizing and hosting a summit of EER&I leaders to develop a systematic process for documenting the impact of EER&I, (4) piloting the process, and (5) compiling and disseminating best practices. Members of the community have been identified, including many who are conducting engineering education research without being part of a formal engineering education program, and some examples of the impact of engineering education research have been gathered. The summit has been held, and a process for documenting the impact of EER&I has been proposed. Results of the summit include a range of possible metrics that can be used to document EER&I impact and ways to communicate that impact. Some pilots have been conducted at the three collaborating schools and several other sites, and a few institutions are now preparing documentation. Results of the summit and the pilots will be shared. In their pilots, engineering education programs have been able to collect and analyze data that describe their efforts to impact how engineering is taught at the university level. Quantitative metrics include research expenditures, publications, number of graduates, positions graduates hold, faculty leadership in groups that influence engineering education policy, and so on. It has proven to be more difficult to demonstrate a direct causal relationship between those efforts and actual changes in the way engineering is taught in the traditional disciplines. The path to each change seems to be unique, and the most effective way to convey the impact is through telling each individual story. Thus, ongoing work focuses on generating a range of qualitative approaches that can be used to document and analyze these change processes. Collaborators on the NSF program are currently piloting ways to convey those stories to the many audiences interested in the results.  more » « less
Award ID(s):
1736469
PAR ID:
10196350
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
ASEE Annual Conference and Exposition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This theory paper describes the development and use of a framework for supporting early career faculty development, especially in competitive National Science Foundation (NSF) CAREER proposals. Engineering Education Research (EER) has developed into a field of expertise and a career pathway over the past three decades. In response to numerous reports in the 1990s and early 2000s, multiple EER graduate programs were established in the mid-2000s and a growing number continue to emerge to educate and train the next generation of EER faculty and policy makers. Historically, many came to EER as individuals trained in other disciplines, but with an interest in improving teaching and learning. This approach created an interdisciplinary space where many could learn the norms, practices, and language of EER, as they became scholars. This history combined with the emergence of EER as a discipline with academic recognition; specific knowledge, frameworks, methodologies, and ways of conducting research; and particular emphasis and goals, creates a tension for building capacity to continue to develop EER and also include engineering education researchers who have not completed PhDs in an engineering education program. If EER is to continue to develop and emerge as a strong and robust discipline with high quality engineering education research, support mechanisms must be developed to both recognize outstanding EER scholars and develop the next generation of researchers in the field. The Five I’s framework comes from a larger project on supporting early career EER faculty in developing NSF CAREER proposals. Arguably, a NSF CAREER award is significant external recognition of EER that signals central membership in the community. The Five I’s were developed using collaborative inquiry, a tool and process to inform practice, with 19 EER CAREER awardees during a retreat in March 2019. The Five I’s include: Ideas, Integration, Impact, Identity, and Infrastructure. Ideas is researchers’ innovative and potentially transformative ideas that can make a significant contribution to EER. All NSF proposals are evaluated using the criteria of intellectual merit and broader impacts, and ideas aligned with these goals are essential for funding success. The integration of research and education is a specific additional consideration of CAREER proposals. Both education and research must inform one another in the proposal process. Demonstrating the impact of research is essential to convey why research should be funded. This impact is essential to address as it directly relates to the NSF criteria of broader impacts as well as why an individual is positioned to carry out that impact. This positioning is tied to identity or the particular research expertise from which a faculty member will be a leader in the field. Finally, infrastructure includes the people and physical resources from which a faculty member must draw to be successful. This framework has proven useful in helping early career faculty evaluate their readiness to apply for an NSF CAREER award or highlight the particular areas of their development that could be improved for future success. 
    more » « less
  2. This research category full paper explores National Science Foundation (NSF) Faculty Early Career Development (CAREER) Program awardees from the Division of Engineering Education and Centers. The NSF CAREER Award distinguishes researchers as promising future leaders who are advancing the frontier of engineering education research (EER). Additionally, the multidisciplinary rise of EER has resulted in a diverse community of researchers from many backgrounds and academic departments. Given the recognition associated with the CAREER award, it is crucial that all early career faculty members possess the knowledge and support to create high quality CAREER applications. In this study, we investigated the educational backgrounds, institutional affiliation, and public abstracts of CAREER awardees to document prevailing patterns in recognition through CAREER awards. This knowledge informs future work to provide additional support for early career faculty planning on applying to the program. 
    more » « less
  3. Whether developing new programs or updating existing programs, educators and their industry partners must effectively – and efficiently – communicate and collaborate to create curricula needed to help graduates meet the needs of the workforce. The “IT Skill Standards 2020 and Beyond” (ITSS) National Science Foundation (NSF) Advanced Technological Education (ATE) project collaborated with over 250 employers across the country to identify and develop future-facing skill standards for the most critical IT job clusters. The Texas Skills Standards Board has recognized and adopted those six standards clusters. The “engine” that powered this work was the Business and Industry Leadership Team (BILT) model, which provides a structured, repeatable method for engaging employers nationwide to ensure curriculum aligns with workforce needs. To date, over 150 colleges, universities, and projects across 35 states have adopted the BILT model. In 2023 and 2024, the overall skill standards development process – which includes the BILT Model – was taught to faculty and administrators across multiple technical disciplines. Overall, six ITSS Summit workshops were held for over 100 attendees from 44 schools in 21 states. Ten ITSS Summit teams participated in 1:1 mentoring sessions in Spring 2024 with grant staff to support their implementation. Each team pursued customized goals to strengthen their own programs’ relationships with employers and better align the curriculum to workforce needs. Quantitative and qualitative survey data on the impact of the ITSS Summit program demonstrate the value of the ITSS Process and the BILT model of industry engagement. 
    more » « less
  4. Peer review of grant proposals is critical to the National Science Foundation (NSF) funding process for STEM disciplinary and education research. Despite this, scholars receive little training in effective and constructive review of proposals beyond definitions of review criteria and an overview of strategies to avoid bias and communicate clearly. Senior researchers often find that their reviewing skills improve and develop over time, but variations in reviewer starting points can have a negative impact on the value of reviews for their intended audiences of program officers, who make funding recommendations, and principal investigators, who drive the research or want to improve their proposals. Building on the journal review component of the Engineering Education Research Peer Review Training (EER PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences, this paper describes a program designed to provide professional development for proposal reviewing and provides initial evaluation results. 
    more » « less
  5. Peer review of grant proposals is critical to the National Science Foundation (NSF) funding process for STEM disciplinary and education research. Despite this, scholars receive little training in effective and constructive review of proposals beyond definitions of review criteria and an overview of strategies to avoid bias and communicate clearly. Senior researchers often find that their reviewing skills improve and develop over time, but variations in reviewer starting points can have a negative impact on the value of reviews for their intended audiences of program officers, who make funding recommendations, and principal investigators, who drive the research or want to improve their proposals. Building on the journal review component of the Engineering Education Research Peer Review Training (EER PERT) project, which is designed to develop EER scholars’ peer review skills through mentored reviewing experiences, this paper describes a program designed to provide professional development for proposal reviewing and provides initial evaluation results. 
    more » « less