skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Comparison of Cluster Analysis Methodologies for Characterization of Classroom Observation Protocol for Undergraduate STEM (COPUS) Data
Title: Comparison of Cluster Analysis Methodologies for Characterization of Classroom Observation Protocol for Undergraduate STEM (COPUS) Data
The Classroom Observation Protocol for Undergraduate STEM (COPUS) provides descriptive feedback to instructors by capturing student and instructor behaviors occurring in the classroom. Due to the increasing prevalence of COPUS data collection, it is important to recognize how researchers determine whether groups of courses or instructors have unique classroom characteristics. One approach uses cluster analysis, highlighted by a recently developed tool, the COPUS Analyzer, that enables the characterization of COPUS data into one of seven clusters representing three groups of instructional styles (didactic, interactive, and student centered). Here, we examine a novel 250 course data set and present evidence that a predictive cluster analysis tool may not be appropriate for analyzing COPUS data. We perform a de novo cluster analysis and compare results with the COPUS Analyzer output and identify several contrasting outcomes regarding course characterizations. Additionally, we present two ensemble clustering algorithms: 1) k-means and 2) partitioning around medoids. Both ensemble algorithms categorize our classroom observation data into one of two clusters: traditional lecture or active learning. Finally, we discuss implications of these findings for education research studies that leverage COPUS data.  more » « less
Award ID(s):
1821724
PAR ID:
10296650
Author(s) / Creator(s):
; ; ; ;
Editor(s):
Feldon, David
Date Published:
Journal Name:
CBE—Life Sciences Education
Volume:
20
Issue:
1
ISSN:
1931-7913
Page Range / eLocation ID:
ar3
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; (, PLOS ONE)
    Bati, Ayse Hilal (Ed.)
    One of the primary reasons why students leave STEM majors is due to the poor quality of instruction. Teaching practices can be improved through professional development programs; however, several barriers exist. Creating lasting change by overcoming these barriers is the primary objective of the STEM Faculty Institute (STEMFI). STEMFI was designed according to the framework established by Ajzen’s Theory of Planned Behavior. To evaluate its effectiveness, the Classroom Observation Protocol for Undergraduate STEM (COPUS) tool was used before and after an intensive year-long faculty development program and analyzed using copusprofiles.org , a tool that classifies each COPUS report into one of three instructional styles: didactic, interactive lecture, and student-centered. We report the success of our program in changing faculty teaching behaviors and we categorize them into types of reformers. Then, thematically coded post-participation interviews give us clues into the characteristics of each type of reformer. Our results demonstrate that faculty can significantly improve the student-centeredness of their teaching practices in a relatively short time. We also discuss the implications of faculty attitudes for future professional development efforts. 
    more » « less
  2. ; ; ; ; ; ; ; (, 2018 IEEE Frontiers in Education Conference (FIE)
    This Research Work-in-progress paper presents a project that intends to increase student engagement, retention, and success through the implementation of a faculty development program focused on implicit bias and active learning. To assess the extent to which the program resulted in transformative changes in instructor teaching, the project team conducted classroom observations using minute-by-minute environmental scans and the Classroom Observation Protocol for Undergraduate STEM (COPUS). The project team found that the COPUS could not capture all the behaviors that needed to be observed to assess the faculty development project. Thus, 12 emergent COPUS codes were developed to code the required behaviors. Each code is defined, examples are provided, and excerpts of classroom observations with and without the emergent COPUS codes are examined. The project team thinks the emergent COPUS codes, generally focused on faculty behaviors related to classroom climate, will be useful in other classroom observation projects. 
    more » « less
  3. ; ; ; (, ASEE annual conference & exposition proceedings)
    Flexible classroom spaces, which have movable tables and chairs that can be easily rearranged into different layouts, make it easier for instructors to effectively implement active learning than a traditional lecture hall. Instructors can move throughout the room to interact with students during active learning, and they can rearrange the tables into small groups to facilitate conversation between students. Classroom technology, such as wall-mounted monitors and movable whiteboards, also facilitates active learning by allowing students to collaborate. In addition to enabling active learning, the flexible classroom can still be arranged in front-facing rows that support traditional lecture-based pedagogies. As a result, instructors do not have to make time- and effort-intensive changes to the way their courses are taught in order to use the flexible classroom. Instead, they can make small changes to add active learning. We are in the second year of a study of flexible classroom spaces funded by the National Science Foundation’s Division of Undergraduate Education. This project asks four research questions that investigate the relationships between the instructor, the students, and the classroom: 1) What pedagogy do instructors use in a flexible classroom space? 2) How do instructors take advantage of the instructional affordances (including the movable furniture, movable whiteboards, wall-mounted whiteboards, and wall-mounted monitors) of a flexible classroom? 3) What is the impact of faculty professional development on instructors’ use of flexible classroom spaces? and 4) How does the classroom influence the ways students interpret and engage in group learning activities? In the first year of our study we have developed five research instruments to answer these questions: a three-part classroom observation protocol, an instructor interview protocol, two instructor surveys, and a student survey. We have collected data from nine courses taught in one of ten flexible classrooms at the University of Michigan during the Fall 2018 semester. Two of these courses were first-year introduction to engineering courses co-taught by two instructors, and the other seven courses were sophomore- and junior-level core technical courses taught by one instructor. Five instructors participated in a faculty learning community that met three times during the semester to discuss active learning, to learn how to make the best use of the flexible classroom affordances, and to plan activities to implement in their courses. In each course we gathered data from the perspective of the instructor (through pre- and post-semester interviews), the researcher (through observations of three class meetings with our observation protocol), and the students (through conducting a student survey at the end of the semester). This poster presents qualitative and qualitative analyses of these data to answer our research questions, along with evidence based best practices for effectively using a flexible classroom. 
    more » « less
  4. ; ; ; ; ; ; ; (, ASEE Conferences)
    This research paper investigates how classroom observation tools can be effectively combined to promote engagement in STEM education. Specifically, it explores the integration of the Classroom Observation Protocol for Undergraduate STEM (COPUS) and a culturally responsive Classroom Observation Instrument (COI) to evaluate and improve teaching practices. COPUS, developed by Smith et al. [21], captures instructional dynamics and student-faculty interactions, while the Classroom Observation Instrument COI, created by Dr. Jennifer G. Cromley and the University of Illinois Urbana-Champaign (UIUC) Developing Equity-Minded Engineering Practitioners (DEEP) research team [6], focuses on observing and assessing culturally responsive-related instructional practices. At Morgan State University (MSU), a Historically Black University (HBCU), coders formally trained by the UIUC DEEP team used both tools to analyze classroom recordings of faculty who had undergone professional development in engaging pedagogy. Findings indicate measurable improvements and balanced engagement in the classroom. This fusion of COPUS and COI tools offers a replicable framework for enhancing inclusive STEM instruction and cultivating more equitable learning environments. 
    more » « less
  5. ; ; ; ; ; ; ; (, CBE—Life Sciences Education)
    Momsen, Jennifer L (Ed.)
    Student impressions formed during the first day of class can impact course satisfaction and performance. Despite its potential importance, little is known about how instructors format the first day of class. Here, we report on observations of the first day of class in 23 introductory science, technology, engineering, and math (STEM) courses. We first described how introductory STEM instructors structure their class time by characterizing topics covered on the first day through inductive coding of class videos. We found that all instructors discussed policies and basic information. However, a cluster analysis revealed two groups of instructors who differed primarily in their level of STEM content coverage. We then coded the videos with the noncontent Instructor Talk framework, which organizes the statements instructors make unrelated to disciplinary content into several categories and subcategories. Instructors generally focused on building the instructor–student relationship and establishing classroom culture. Qualitative analysis indicated that instructors varied in the specificity of their noncontent statements and may have sent mixed messages by making negatively phrased statements with seemingly positive intentions. These results uncovered variation in instructor actions on the first day of class and can help instructors more effectively plan this day by providing messages that set students up for success. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email