skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Design and Implementation of an Automated Classroom Analytics System: Stakeholder Engagement and Mapping
Abstract Computational analysis methods and machine learning techniques introduce innovative ways to capture classroom interactions and display data on analytics dashboards. Automated classroom analytics employ advanced data analysis, providing educators with comprehensive insights into student participation, engagement, and behavioral trends within classroom settings. Through the provision of context-sensitive feedback, automated classroom analytics systems can be integrated into the evidence-based pedagogical decision-making and reflective practice processes of faculty members in higher education institutions. This paper presents TEACHActive, an automated classroom analytics system, by detailing its design and implementation. It outlines the processes of stakeholder engagement and mapping, elucidates the benefits and obstacles associated with a comprehensive classroom analytics system design, and concludes by discussing significant implications. These implications propose user-centric design approaches for higher education researchers and practitioners to consider.  more » « less
Award ID(s):
2021118
PAR ID:
10556641
Author(s) / Creator(s):
; ;
Publisher / Repository:
TechTrends
Date Published:
Journal Name:
TechTrends
Volume:
67
Issue:
6
ISSN:
8756-3894
Page Range / eLocation ID:
945 to 954
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Proceedings of Society for Information Technology & Teacher Education International Conference)
    E. Langran (Ed.)
    Faculty professional development is known to be a key factor contributing to the effective implementation of evidence-based teaching in STEM classrooms. In this research, we developed TEACHActive, an innovative classroom analytics-driven professional development model that supports the reflective practices of engineering instructors in higher education. TEACHActive uses machine learning techniques within a camera-based classroom sensing system that tracks behavioral features of interest in classrooms. Following design-based implementation research, we rapidly enacted, tested, and revised the TEACHActive model with engineering instructors. This study reports the results of the first iteration completed in the spring semester of 2021. Specifically, we examined the TEACHActive implementation and deployment in engineering classrooms with the analysis of instructors’ perceived successes and challenges. The paper presents implications for using the classroom analytics-driven professional development with educators in higher education. 
    more » « less
  2. ; ; ; ; ; (, Journal of Information Technology in Construction)
    Classification of construction resource states, using sensor data analytics, has implications for improving informed decision-making for safety and productivity. However, training on sensor data analytics in construction education faces challenges owing to the complexity of analytical processes and the large stream of raw data involved. This research presents the development and user evaluation of ActionSens, a block-based end-user programming platform, for training students from construction-related disciplines to classify resources using sensor data analytics. ActionSens was designed for construction students to perform sensor data analytics such as activity recognition in construction. ActionSens was compared to traditional tools (i.e., combining Excel and MATLAB) used for performing sensor data analytics in terms of usability, workload, visual attention, and processing time using the System Usability Scale, NASA Task Load Index, eye-tracking, and qualitative feedback. Twenty students participated, performing data analytics tasks with both approaches. ActionSens exhibited a better user experience compared to conventional platforms, through higher usability scores and lower cognitive workload. This was evident through participants' interaction behavior, showcasing optimized attentional resource allocation across key tasks. The study contributes to knowledge by illustrating how the integration of construction domain information into block-based programming environments can equip students with the necessary skills for sensor data analytics. The development of ActionSens contributes to the Learning-for-Use framework by employing graphical and interactive programming objects to foster procedural knowledge for addressing challenges in sensor data analytics. The formative evaluation provides insights into how students engage with the programming environment and assesses the impact of the environment on their cognitive load. 
    more » « less
  3. ; ; ; (, Journal of Applied Research in Higher Education)
    PurposeThe research enterprise within higher education is becoming more competitive as funding agencies require more collaborative research projects, higher-level of accountability and competition for limited resources. As a result, research analytics has emerged as a field, like many other areas within higher education to act as a data-informed unit to better understand how research institutions can effectively grow their research strategy. This is a new and emerging field within higher education. Design/methodology/approachAs businesses and other industries are embracing recent advances in data technologies such as cloud computing and big data analytic tools to inform decision making, research administration in higher education is seeing a potential in incorporating advanced data analytics to improve day-to-day operations and strategic advancement in institutional research. This paper documents the development of a survey measuring research administrators’ perspectives on how higher education and other research institutions perceive the use of data and analytics within the research administration functions. The survey development process started with composing a literature review on recent developments in data analytics within the research administration in the higher education domain, from which major components of data analytics in research administration were conceptualized and identified. This was followed by an item matrix mapping the evidence from literature with corresponding, newly drafted survey items. After revising the initial survey based on suggestions from a panel of subject matter experts to review, a pilot study was conducted using the revised survey instrument and validated by employing the Rasch measurement analysis. FindingsAfter revising the survey based on suggestions from the subject matter experts, a pilot study was conducted using the revised survey instrument. The resultant survey instrument consists of six dimensions and 36 survey items with an establishment of reasonable item fit, item separation and reliability. This survey protocol is useful for higher educational institutions to gauge research administrators’ perceptions of the culture of data analytics use in the workplace. Suggestions for future revisions and potential use of the survey were made. Originality/valueVery limited scholarly work has been published on this topic. The use of data-informed and data-driven approaches with in research strategy within higher education is an emerging field of study and practice. 
    more » « less
  4. ; (, Journal of Learning Analytics)
    There is a growing interest in the research and use of automated feedback dashboards that display classroom analytics; yet little is known about the detailed processes instructors use to make sense of these tools, and to determine the impact on their teaching practices. This research was conducted at a public Midwestern university within the context of an automated classroom observation and feedback implementation project. Fifteen engineering instructors engaged in this research. The overarching goal was to investigate instructor teaching beliefs, pedagogical practices, and sensemaking processes regarding dashboard use. A grounded theory approach was used to identify categories related to instructor perceptions. Results revealed that instructor experiences inform both their present use of the dashboard and consequential future actions. A model is presented that illustrates categories included in instructor pre-use, use, and post-use of an automated feedback dashboard. An extension to this model is presented and accompanied by recommendations for a more effective future use of automated dashboards. The model’s practical implications inform both instructors and designers on effective design and use of dashboards, ultimately paving a way to improve pedagogical practices and instruction 
    more » « less
  5. ; ; ; ; ; ; ; (, Journal of Learning Analytics)
    Classroom sensing systems can capture data on teacher-student behaviours and interactions at a scale far greater than human observers can. These data, translated to multi-modal analytics, can provide meaningful insights to educational stakeholders. However, complex data can be difficult to make sense of. In addition, analyses done on these data are often limited by the organization of the underlying sensing system, and translating sensing data into meaningful insights often requires custom analyses across different modalities. We present Edulyze, an analytics engine that processes complex, multi-modal sensing data and translates them into a unified schema that is agnostic to the underlying sensing system or classroom configuration. We evaluate Edulyze’s performance by integrating three sensing systems (Edusense, ClassGaze, and Moodoo) and then present data analyses of five case studies of relevant pedagogical research questions across these sensing systems. We demonstrate how Edulyze’s flexibility and customizability allow us to answer a broad range of research questions made possible by Edulyze’s translation of a breadth of raw sensing data from different sensing systems into relevant classroom analytics.  
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email