skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Which evidence-based teaching practices change over time? Results from a university-wide STEM faculty development program
Abstract Background There is overwhelming evidence that evidence-based teaching improves student performance; however, traditional lecture predominates in STEM courses. To provide support as faculty transform their lecture-based classrooms with evidence-based teaching practices, we created a faculty development program based on best practices, Consortium for the Advancement of Undergraduate STEM Education (CAUSE). CAUSE paired exploration of evidence-based teaching with support for classroom implementation over two years. Each year for three years, CAUSE recruited cohorts of faculty from seven STEM departments. Faculty met biweekly to discuss evidence-based teaching and receive feedback on their implementation. We used the PORTAAL observation tool to document evidence-based teaching practices (PORTAAL practices) across four randomly chosen class sessions each term. We investigated if the number of PORTAAL practices used or the amount of practices increased during the program. Results We identified identical or equivalent course offerings taught at least twice by the same faculty member while in CAUSE ( n  = 42 course pairs). We used a one-way repeated measures within-subjects multivariate analysis to examine the changes in average use of 14 PORTAAL practices between the first and second timepoint. We created heat maps to visualize the difference in number of practices used and changes in level of implementation of each PORTAAL practice. Post-hoc within-subjects effects indicated that three PORTAAL practices were significantly higher and two were lower at timepoint two. Use of prompting prior knowledge and calling on volunteers to give answers decreased, while instructors doubled use of prompting students to explain their logic, and increased use of random call by almost 40% when seeking answers from students. Heat maps indicated increases came both from faculty’s adoption of these practices and increased use, depending on the practice. Overall, faculty used more practices more frequently, which contributed to a 17% increase in time that students were actively engaged in class. Conclusions Results suggest that participation in a long-term faculty development program can support increased use of evidence-based teaching practices which have been shown to improve student exam performance. Our findings can help prioritize the efforts of future faculty development programs.  more » « less
Award ID(s):
1725149
PAR ID:
10386121
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
International Journal of STEM Education
Volume:
9
Issue:
1
ISSN:
2196-7822
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Dalby, Andrew R. (Ed.)
    Traditional teaching practices in undergraduate science, technology, engineering, and mathematics (STEM) courses have failed to support student success, causing many students to leave STEM fields and disproportionately affecting women and students of color. Although much is known about effective STEM teaching practices, many faculty continue to adhere to traditional methods, such as lecture. In this study, we investigated the factors that affect STEM faculty members’ instructional decisions about evidence-based instructional practices (EBIPs). We performed a qualitative analysis of semi-structured interviews with faculty members from the Colleges of Physical and Mathematical Sciences, Life Sciences, and Engineering who took part in a professional development program to support the use of EBIPs by STEM faculty at the university. We used an ecological model to guide our investigation and frame the results. Faculty identified a variety of personal, social, and contextual factors that influenced their instructional decision-making. Personal factors included attitudes, beliefs, and self-efficacy. Social factors included the influence of students, colleagues, and administration. Contextual factors included resources, time, and student characteristics. These factors interact with each other in meaningful ways that highlight the hyper-local social contexts that exist within departments and sub-department cultures, the importance of positive feedback from students and colleagues when implementing EBIPs, and the need for support from the administration for faculty who are in the process of changing their teaching. 
    more » « less
  2. This work in progress paper discusses XXX, an NSF S-STEM supported program, which employs known best practices to support and retain underrepresented students in engineering through graduation. The goal is to graduate more students from underrepresented populations in an effort to ultimately diversity the engineering workforce. This paper describes this program’s unique implementation of a specific subset of retention best practices, such as facilitating (1) the development of both a feeling of institutional inclusion and engineering identity by providing opportunities for faculty-student and student-student interaction as well as major and career exploration, (2) academic support, including support for the development of broader success skills, such as time management, and (3) professional development. These opportunities are embedded in an organized, cohort-based, program consisting of: (1) a brief summer bridge program, (2) a common fall professional development course, and (3) a common spring course exploring the role of engineering in societal development. Throughout its implementation, the program faced and addressed challenges related to recruitment as well as program length and cost. Now, in its eighth year, three with S-STEM funding, an analysis of program data provides evidence of increased retention of the targeted populations in engineering to the second year, but only a small positive effect on overall retention. Results of investigations of why students leave, lessons learned through the development, implementation, and assessment of this program, and suggested actions for continued progress in increasing retention of underrepresented populations are presented. 
    more » « less
  3. Bati, Ayse Hilal (Ed.)
    One of the primary reasons why students leave STEM majors is due to the poor quality of instruction. Teaching practices can be improved through professional development programs; however, several barriers exist. Creating lasting change by overcoming these barriers is the primary objective of the STEM Faculty Institute (STEMFI). STEMFI was designed according to the framework established by Ajzen’s Theory of Planned Behavior. To evaluate its effectiveness, the Classroom Observation Protocol for Undergraduate STEM (COPUS) tool was used before and after an intensive year-long faculty development program and analyzed using copusprofiles.org , a tool that classifies each COPUS report into one of three instructional styles: didactic, interactive lecture, and student-centered. We report the success of our program in changing faculty teaching behaviors and we categorize them into types of reformers. Then, thematically coded post-participation interviews give us clues into the characteristics of each type of reformer. Our results demonstrate that faculty can significantly improve the student-centeredness of their teaching practices in a relatively short time. We also discuss the implications of faculty attitudes for future professional development efforts. 
    more » « less
  4. Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction. 
    more » « less
  5. Powell, Roger (Ed.)
    Abstract The teaching practices used in college science classrooms have a profound influence on which students pass their courses (and continue to major in science) and which are ‘weeded out.’ Students from traditionally marginalized backgrounds have lower grades and learning gains compared to their nonmarginalized peers in courses that rely heavily on lecture and high-stakes exams. This achievement gap narrows or disappears when instructors use student-centered, evidence-based teaching practices. These teaching practices can include actions that shape our classroom environment, communicate course material, and assess student learning. In this paper, we provide a summary of the evidence supporting the use of student-centered teaching practices, followed by examples of several effective evidence-based teaching practices that can be integrated into organismal courses. Examples include faculty mindset for inclusion, teaching practices to increase student confidence and to reduce stereotype threat, increasing course structure by spreading points among several different types of activities, several active learning methods, jigsaws, Scientist Spotlights, course-based undergraduate research experiences, and inquiry-based labs. Each example is linked to supporting resources to help instructors easily implement these practices in their classrooms. The American Society of Mammalogists endeavors to be equitable and inclusive through numerous initiatives, and modifying our teaching practices can increase equity and inclusion of future mammalogists into our own classrooms. 
    more » « less