In this study, two universities created and implemented a student-centered graduate student instructor observation protocol (GSIOP) and a post-observational Red-Yellow-Green feedback structure (RYG feedback). The GSIOP and RYG feedback was used with novice mathematics graduate student instructors (GSIs) by experienced GSIs through a peer-mentorship program. Ten trained mentor GSIs observed novice GSIs, completed a GSIOP, and provided RYG feedback as part of an observation-feedback cycle. This generated 50 semester-long data sets of three observation-feedback cycles of novice GSIs. Analyzing these data sets helped identify how certain feedback influenced GSIOP scores. 
                        more » 
                        « less   
                    
                            
                            Mathematics Graduate Student Instructor Observation Protocol (GSIOP): Development and Validation Study
                        
                    
    
            Abstract This paper presents the development and validation of the 17-item mathematics Graduate Student Instructor Observation Protocol (GSIOP) at two universities. The development of this instrument attended to some unique needs of novice undergraduate mathematics instructors while building on an existing instrument that focused on classroom interactions particularly relevant for students’ development of conceptual understanding, called the Mathematical Classroom Observation Protocol for Practices (MCOP2). Instrument validation involved content input from mathematics education researchers and upper-level mathematics graduate student instructors at two universities, internal consistency analysis, interrater reliability analysis, and structure analyses via scree plot analysis and exploratory factor analysis. A Cronbach-Alpha level of 0.868 illustrated a viable level for internal consistency. Crosstabulation and correlations illustrate high level of interrater reliability for all but one item, and high levels across all subsections. Collaborating a scree plot with the exploratory factor analysis illustrated three critical groupings aligning with the factors from the MCOP2(student engagement and teacher facilitation) while adding a third factor, lesson design practices. Taken collectively, these results indicate that the GSIOP measures the degree to which instructors’ and students’ actions in undergraduate mathematics classrooms align with practices recommended by the Mathematical Association of America (MAA) using a three-factor structure of teacher facilitation, student engagement, and design practices. 
        more » 
        « less   
        
    
    
                            - PAR ID:
- 10373063
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- International Journal of Research in Undergraduate Mathematics Education
- Volume:
- 6
- Issue:
- 2
- ISSN:
- 2198-9745
- Format(s):
- Medium: X Size: p. 186-212
- Size(s):
- p. 186-212
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            In this study, two universities created and implemented a student-centered graduate student instructor observation protocol (GSIOP) and a post-observational Red-Yellow-Green feedback structure (RYG feedback). The GSIOP and RYG feedback was used with novice mathematics graduate student instructors (GSIs) by experienced GSIs through a peer-mentorship program. Ten trained mentor GSIs observed novice GSIs, completed a GSIOP, and provided RYG feedback as part of an observation-feedback cycle. This generated 50 semester-long data sets of three observation-feedback cycles of novice GSIs. Analyzing these 50 semester-long data sets helped identify how certain feedback influenced GSIOP scores.more » « less
- 
            The purpose of this study was to develop a valid, reliable, and brief measure of active learning in college classrooms that is cheap and easy to complete and yields results that faculty can easily use to inform their development as instructors. Initial construct and face validity was achieved by modifying existing instruments and creating a draft of a brief measure of active learning for external expert review. Following the suggested revisions, the engaging classroom observation was then piloted and revised as necessary. Reliability was tested and measures of internal consistency and interrater reliability were acceptable. A principal component analysis showed two components that were moderately correlated, which indicated the potential they could be combined. An Exploratory Factor Analysis confirmed the instrument is measuring one factor, which we propose as active learning. This study is significant because it offers a brief instrument based on students’ perceptions that can be used formatively by faculty.more » « less
- 
            In this study, two universities created and implemented a student-centered graduate student instructor observation protocol (GSIOP) and a post-observational Red-Yellow-Green feedback structure (RYG feedback). The GSIOP and RYG feedback was used with novice graduate student instructors (GSIs) by experienced GSIs through a peer-mentorship program. Ten trained mentor GSIs completed 50 sets of three observations of novice GSIs. Analyzing 151 GSIOPs and 151 RYG feedback meetings longitudinally provided insight to identify what types of feedback informed and influenced GSIOP scores. After qualitatively coding feedback along multiple dimensions, we found certain forms of feedback were more influential for GSI development than others with respect to change in GSIOP score. Our results indicate contextually-specific feedback leads to more observed changes and improvement across multiple observations than decontextualized feedback.more » « less
- 
            In this study, two universities created and implemented a student-centered graduate student instructor observation protocol (GSIOP) and a post-observational Red-Yellow-Green feedback structure (RYG feedback). The GSIOP and RYG feedback was used with novice graduate student instructors (GSIs) by experienced GSIs through a peer-mentorship program. Ten trained mentor GSIs completed 50 sets of three observations of novice GSIs. Analyzing 151 GSIOPs and 151 RYG feedback meetings longitudinally provided insight to identify what types of feedback informed and influenced GSIOP scores. After qualitatively coding feedback along multiple dimensions, we found certain forms of feedback were more influential for GSI development than others with respect to change in GSIOP score. Our results indicate contextually-specific feedback leads to more observed changes and improvement across multiple observations than decontextualized feedback.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
