skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on September 4, 2026

Title: Formative Evaluation on Faculty Participation in Instructional Change Initiatives in Undergraduate Chemistry
In STEM disciplines, there has been a growing emphasis on implementing instructional changes in undergraduate education to enhance student success. Despite collecting different types of data, there are few applications of mid-project formative evaluations in instructional reform projects to explore faculty members' perceptions and interactions as change agents. This study conducted a formative evaluation focusing on a group of faculty participants involved in a project as part of a faculty learning community aimed at revising the chemistry curriculum at a public urban U.S. university, utilizing both qualitative and quantitative approaches. Using interview data, this study revealed that faculty participants in the reform project perceived their interactive involvement, as well as environmental changes and diverse student needs, as facilitators for their instructional improvement. Additionally, based on department-wide survey measures related to departmental culture and discussion networks for undergraduate education change, faculty participants in the reform efforts had more favorable perceptions of departmental culture about making changes and higher centrality scores within departmental discussion networks compared to their peer faculty members. Implications of these findings are discussed in relation to future project implementation and faculty development as change agents.  more » « less
Award ID(s):
2111446
PAR ID:
10634233
Author(s) / Creator(s):
;
Editor(s):
Holme, Thomas A
Publisher / Repository:
American Chemical Society
Date Published:
Journal Name:
Journal of Chemical Education
Edition / Version:
1
Volume:
102
ISSN:
0021-9584
Subject(s) / Keyword(s):
Faculty Learning Community, Formative Evaluation, Undergraduate Education, Social Network Analysis
Format(s):
Medium: X Other: pdf
Sponsoring Org:
National Science Foundation
More Like this
  1. In response to the well-documented themes of unique challenges URM doctoral student experience (tokenism, stereotyping, microaggressions, etc.), faculty mentoring remains an especially critical resource to change the trajectory for URM students in graduate education. The purpose of this study is to examine the frst two years of change in institutional culture which will increase the number of URM doctoral students who pursue the STEM professoriate. The primary research question asked is “Can a focus on developing and mentoring faculty catalyze change in the culture and practices of their doctoral programs to increase faculty diversity?” Based on the idea that faculty are drivers of lasting institutional change, three diverse public universities collaborate to adapt and implement an institutional change project, called “AGEP-NC Alliance: A Change Model for Doctoral to Faculty Diversity in STEM,” that prioritizes cultural frameworks for deep change in postsecondary education (Gumpertz et al., 2019). Key model components include faculty learning communities; use of national faculty mentoring networks; and use of institutional diversity data. Culturally relevant mentoring is among several approaches of interest to STEM reformers to shift the focus to institutional-level change and not student defciencies. Operationalized as “cultural integrity,” the approach calls upon students’ racial and ethnic backgrounds as assets for reform in pedagogies and learning activities, while valuing those backgrounds as critical ingredients for acquiring academic capital and career success (Tierney, 1999). Kezar’s (2018) cultural framework for institutional change emphasizes knowledge formation in context as well as analysis of espoused meaning and values organizational members maintain. The researchers present the AGEP-NC Alliance as a narrative, rich case study and collaborative mentoring model, an approach allowing participant researchers to detail sustained data use in collaborative social interaction (Patton, 1990). Results will be shared that highlight faculty as cultural change agents, and organizational learning as a cultural process. Preliminary results show evidence of institutional change at several levels from classroom and laboratory practices to key departmental policies. 
    more » « less
  2. In response to the well-documented themes of unique challenges URM doctoral student experience (tokenism, stereotyping, microaggressions, etc.), faculty mentoring remains an especially critical resource to change the trajectory for URM students in graduate education. The purpose of this study is to examine the first two years of change in institutional culture which will increase the number of URM doctoral students who pursue the STEM professoriate. The primary research question asked is “Can a focus on developing and mentoring faculty catalyze change in the culture and practices of their doctoral programs to increase faculty diversity?” Based on the idea that faculty are drivers of lasting institutional change, three diverse public universities collaborate to adapt and implement an institutional change project, called “AGEP-NC Alliance: A Change Model for Doctoral to Faculty Diversity in STEM,” that prioritizes cultural frameworks for deep change in postsecondary education (Gumpertz et al., 2019). Key model components include faculty learning communities; use of national faculty mentoring networks; and use of institutional diversity data. Culturally relevant mentoring is among several approaches of interest to STEM reformers to shift the focus to institutional-level change and not student deficiencies. Operationalized as “cultural integrity,” the approach calls upon students’ racial and ethnic backgrounds as assets for reform in pedagogies and learning activities, while valuing those backgrounds as critical ingredients for acquiring academic capital and career success (Tierney, 1999). Kezar’s (2018) cultural framework for institutional change emphasizes knowledge formation in context as well as analysis of espoused meaning and values organizational members maintain. The researchers present the AGEP-NC Alliance as a narrative, rich case study and collaborative mentoring model, an approach allowing participant researchers to detail sustained data use in collaborative social interaction (Patton, 1990). Results will be shared that highlight faculty as cultural change agents, and organizational learning as a cultural process. Preliminary results show evidence of institutional change at several levels from classroom and laboratory practices to key departmental policies. 
    more » « less
  3. Electrical and computer engineering technologies have evolved into dynamic, complex systems that profoundly change the world we live in. Designing these systems requires not only technical knowledge and skills but also new ways of thinking and the development of social, professional and ethical responsibility. A large electrical and computer engineering department at a Midwestern public university is transforming to a more agile, less traditional organization to better respond to student, industry and society needs. This is being done through new structures for faculty collaboration and facilitated through departmental change processes. Ironically, an impetus behind this effort was a failed attempt at department-wide curricular reform. This failure led to the recognition of the need for more systemic change, and a project emerged from over two years of efforts. The project uses a cross-functional, collaborative instructional model for course design and professional formation, called X-teams. X-teams are reshaping the core technical ECE curricula in the sophomore and junior years through pedagogical approaches that (a) promote design thinking, systems thinking, professional skills such as leadership, and inclusion; (b) contextualize course concepts; and (c) stimulate creative, socio-technical-minded development of ECE technologies. An X-team is comprised of ECE faculty members including the primary instructor, an engineering education and/or design faculty member, an industry practitioner, context experts, instructional specialists (as needed to support the process of teaching, including effective inquiry and inclusive teaching) and student teaching assistants. X-teams use an iterative design thinking process and reflection to explore pedagogical strategies. X-teams are also serving as change agents for the rest of the department through communities of practice referred to as Y-circles. Y-circles, comprised of X-team members, faculty, staff, and students, engage in a process of discovery and inquiry to bridge the engineering education research-to-practice gap. Research studies are being conducted to answer questions to understand (1) how educators involved in X-teams use design thinking to create new pedagogical solutions; (2) how the middle years affect student professional ECE identity development as design thinkers; (3) how ECE students overcome barriers, make choices, and persist along their educational and career paths; and (4) the effects of department structures, policies, and procedures on faculty attitudes, motivation and actions. This paper will present the efforts that led up to the project, including failures and opportunities. It will summarize the project, describe related work, and present early progress implementing new approaches. 
    more » « less
  4. A 2019 report from the National Academies on Minority Serving Institutions (MSIs) concluded that MSIs need to change their culture to successfully serve students with marginalized racial and/or ethnic identities. The report recommends institutional responsiveness to meet students “where they are,” metaphorically, creating supportive campus environments and providing tailored academic and social support structures. In recent years, the faculty, staff, and administrators at California State University, Los Angeles have made significant efforts to enhance student success through multiple initiatives including a summer bridge program, first-year in engineering program, etc. However, it has become clear that more profound changes are needed to create a culture that meets students “where they are.” In 2020, we were awarded NSF support for Eco-STEM, an initiative designed to change a system that demands "college-ready" students into one that is "student-ready." Aimed at shifting the deficit mindset prevailing in engineering education, the Eco-STEM project embraces an asset-based ecosystem model that thinks of education as cultivation, and ideas as seeds we are planting, rather than a system of standards and quality checks. This significant paradigm and culture transformation is accomplished through: 1) The Eco-STEM Faculty Fellows’ Community of Practice (CoP), which employs critically reflective dialogue[ ][ ] to enhance the learning environment using asset-based learner-centered instructional approaches; 2) A Leadership CoP with department chairs and program directors that guides cultural change at the department/program level; 3) A Facilitators’ CoP that prepares facilitators to lead, sustain, update, and expand the Faculty and Leadership CoPs; 4) Reform of the teaching evaluation system to sustain the cultural changes. This paper presents the progress and preliminary findings of the Eco-STEM project. During the first project year, the project team formulated the curriculum for the Faculty CoP with a focus on inclusive pedagogy, community cultural wealth, and community building, developed a classroom peer observation tool to provide formative data for teaching reflection, and designed research inquiry tools. The latter investigates the following research questions: 1) To what extent do the Eco-STEM CoPs effectively shift the mental models of participants from a factory-like model to an ecosystem model of education? 2) To what extent does this shift support an emphasis on the assets of our students, faculty, and staff members and, in turn, allow for enhanced motivation, excellence and success? 3) To what extent do new faculty assessment tools designed to provide feedback that reflects ecosystem-centric principles and values allow for individuals within the system to thrive? In Fall 2021, the first cohort of Eco-STEM Faculty Fellows were recruited, and rich conversations and in-depth reflections in our CoP meetings indicated Fellows’ positive responses to both the CoP curriculum and facilitation practices. This paper offers a work-in-progress introduction to the Eco-STEM project, including the Faculty CoP, the classroom peer observation tool, and the proposed research instruments. We hope this work will cultivate broader conversations within the engineering education research community about cultural change in engineering education and methods towards its implementation. 
    more » « less
  5. null (Ed.)
    We detail an exploratory study of faculty members’ perceptions of activities associated with undergraduate engineering programs in university-based makerspaces. Our study examines the affordances and constraints faculty perceive regarding teaching and learning in these spaces and, specifically, how makerspaces support engineering faculty members in accomplishing the goals and expectations they have for undergraduate students’ learning and development. We found that makerspaces inspired faculty members’ curricular and instructional innovations, including design of new courses and implementation of practices meant to result in more team-based and active learning. Faculty perceived student activities in makerspaces as fostering of student agency and development of engineering skills, knowledge, and affect. Faculty also identified concerns related to the teaching of engineering in these spaces, including the need to change their instructional practices to more fully engage students and to balance the sophisticated tools and resources with the rigor of completing complex engineering tasks. We use structuration theory to illuminate how faculty act, rationalize, and reflect on their teaching practices and goals in relation to structures present in university-based makerspace. Our study is intended to inform faculty and administrators working to engage students through interactions in makerspaces or similar innovations, and to consider how access to and impact of these structures support undergraduate engineering education. 
    more » « less