Hwang, Gwo-Jen
; Xie, Haoran
; Wah, Benjamin
; Gasevic, Dragan
(Ed.)
Classroom videos are a common source of data for educational researchers studying classroom interactions as
well as a resource for teacher education and professional development. Over the last several decades emerging
technologies have been applied to classroom videos to record, transcribe, and analyze classroom interactions.
With the rise of machine learning, we report on the development and validation of neural networks to classify
instructional activities using video signals, without analyzing speech or audio features, from a large corpus of
nearly 250 h of classroom videos from elementary mathematics and English language arts instruction. Results
indicated that the neural networks performed fairly-well in detecting instructional activities, at diverse levels of
complexity, as compared to human raters. For instance, one neural network achieved over 80% accuracy in
detecting four common activity types: whole class activity, small group activity, individual activity, and transition.
An issue that was not addressed in this study was whether the fine-grained and agnostic instructional
activities detected by the neural networks could scale up to supply information about features of instructional
quality. Future applications of these neural networks may enable more efficient cataloguing and analysis of
classroom videos at scale and the generation of fine-grained data about the classroom environment to inform
potential implications for teaching and learning.
more »
« less
