skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Investigation of physics departments' assessment and change practices
It is important that change in physics programs is deliberate, evidenced-based, and engages multiple stakeholders. To assess the state of departmental change practices, the Effective Practices for Physics Programs (EP3) Initiative regularly runs a survey of department chairs to measure departmental cultures of assessment. The 2023 survey received 163 research-consenting responses. This paper presents two claims based on these survey results: (1) assessments are largely not seen as leading to change, although chairs aspire for them to do so, and (2) chairs see substantial room for improvement in how they go about changing the undergraduate physics program, especially when it comes to engaging multiple stakeholders and using data effectively. The significant difference between current and ideal points to areas where shifting the culture within departments could have support from departmental leadership.  more » « less
Award ID(s):
1821372
PAR ID:
10553527
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
American Association of Physics Teachers
Date Published:
Page Range / eLocation ID:
262 to 267
Format(s):
Medium: X
Location:
Boston, MA
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, American Association of Physics Teachers)
    Many reports, research, and initiatives have presented evidence-based strategies to create strong departments. The Effective Practices for Physics Programs (EP3) Initiative is a collaborative effort between the American Physical Society (APS) and the American Association of Physics Teachers (AAPT) to compile and curate such resources in an online "Guide" for departments to empower high-quality physics education. To ensure the Guide helps improve physics education, this work aims to understand whether the Guide (a written document) can effectively support departmental change efforts (which can be complex). We draw from findings from a 2020 survey (N=310), 2022 survey (N=239), and 2022 interviews (N=8) of physics department chairs at colleges and universities in the US. In the survey, 22% of respondents had used the Guide and 18% had plans to use it, e.g., for strategic planning. Our interviewees spoke about their limited ability to engage in anything that is not immediately urgent and/or requires a significant investment of time. However, many also talked about getting good ideas from the EP3 Guide and using the EP3 Guide in a strategic way, such as during faculty meetings to spark discussion. We find that among EP3 Guide users, the Guide is a potentially effective tool to support first-order change, i.e., change that works within existing systems and worldviews, since interviewees reported using content from the EP3 Guide to understand, frame, and promote their departmental change efforts. These successes can also be leveraged to potentially engage the EP3 audience in second-order change, i.e., change that requires reframing goals and/or values, developing new structures, or other transformational processes. However, additional active supports such as webinars, short courses, or leadership institutes may be necessary for effective and sustained second-order change. 
    more » « less
  2. ; ; ; (, Physics Education Research Conference 2022)
    This study aims to understand how physics faculty seeking guidance in making departmental changes related to recruitment and retention frame the challenges in their program. We focus our analysis on one set of applications submitted to the Departmental Action Leadership Institute (DALI) in its first year of operation. DALI is the community engagement activity of the Effective Practices for Physics Programs (EP3) initiative. It brings together a cohort of physics faculty to apprentice into strategies for sustainable institutional change and facilitation practices associated with leading change teams. Through analysis of DALI applications, we find that many applicants attribute their enrollment challenges to sources outside of their immediate control, while those that do propose solutions to these challenges primarily focus on curriculum change. By understanding how DALI applicants frame their enrollment challenges, developers of departmental change resources can better mold their recommendations and community engagement activities to what is needed, whether that be meeting faculty and departments where they are at or pushing departments to explore new strategies and frameworks for evaluating their challenges. 
    more » « less
  3. ; ; ; ; (, Physical Review Physics Education Research)
    Leaders, policymakers, and researchers have called attention to the need to improve critical aspects of physics programs, from teaching and pedagogy to making physics more diverse and equitable. As such programmatic changes are challenging and require a second-order change to be effective, many physics faculty responsible for carrying them out are not equipped with the necessary experience and support to do so. This can result in a significant waste of resources and time. Moreover, while there is a robust body of literature in higher education focusing on institutional and cultural change, there is a limited understanding of the baseline of the culture of physics programs (where physics programs are starting from), a critical aspect that shapes the change effort. Dr. David Craig and Dr. Joel Corbo with the support of the American Physical Society and the American Association of Physics Teachers developed the Departmental Action Leadership Institutes (DALIs) to meet the needs of the physics community by supporting physics faculty to effectively design and implement departmental change focusing on areas needing improvement. In this research project, we developed case studies of five DALI-active physics programs from two DALI cohorts. We use a cultural dynamics lens to document facets of the dominant culture around how physics faculty approach and pursue change work. We see evidence of DALI participants’ growing awareness of taken-for-granted assumptions about educational change processes and assessment practices within their departmental cultures and coming to recognize and value alternative ways of collaborating and enacting change in their local contexts. We found that physics faculty typically approach change work in a rushed and way ignoring the use of formal evidence. In particular, we found that any data collection efforts are the primary responsibility of a single person, rarely becoming the focus of joint attention. Whenever data did receive joint attention, it was approached in a cursory way without meaningfully informing collective change efforts. This study lays the foundation to explore critical aspects of the dominant physics culture that may constrain enacting particular forms of programmatic change. In future work, we document the cultural shifts made by these DALI-active departments around change work. 
    more » « less
  4. ; ; ; ; ; (, American Association of Physics Teachers)
    The Communities of Transformation (CoT) framework is a variation on Communities of Practice that models groups aimed at changing existing institutional practices by challenging underlying value systems. The CoT framework has the potential to provide insight into STEM initiatives designed to promote institutional change. We share results from applying this framework to the Effective Practices for Physics Programs' (EP3) Departmental Action Leadership Institute (DALI). DALI supports cohorts of physics faculty (change leaders) in leading change efforts in their departments. Change leaders apprentice into effective change strategies though sustained programming while enacting these strategies within their own Departmental Action Team (DAT). Through analysis of interviews with change leaders, we identify ways in which DALI aligns with, and departs from, the CoT framework. We present the results of this initial study to showcase which aspects of STEM change initiatives can be highlighted, and what may not be captured, by a CoT lens. 
    more » « less
  5. ; ; ; ; ; (, CBE—Life Sciences Education)
    Bauerle, Cynthia (Ed.)
    Most science, technology, engineering, and mathematics (STEM) departments inadequately evaluate teaching, which means they are not equipped to recognize or reward effective teaching. As part of a project at one institution, we observed that departmental chairs needed help recognizing the decisions they would need to make to improve teaching evaluation practices. To meet this need, we developed the Guides to Advance Teaching Evaluation (GATEs), using an iterative development process. The GATEs are designed to be a planning tool that outlines concrete goals to guide reform in teaching evaluation practices in STEM departments at research-intensive institutions. The GATEs are grounded in the available scholarly literature and guided by existing reform efforts and have been vetted with STEM departmental chairs. The GATEs steer departments to draw on three voices to evaluate teaching: trained peers, students, and the instructor. This research-based resource includes three components for each voice: 1) a list of departmental target practices to serve as goals; 2) a characterization of common starting places to prompt reflection; and 3) ideas for getting started. We provide anecdotal examples of potential uses of the GATEs for reform efforts in STEM departments and as a research tool to document departmental practices at different time points. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email