skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Expanding the Frame: Designing a Learning Analytics System Using a Theory of Learning
This essay presents the case of designing a learning analytics system using a theory of learning. Learning analytics systems are often institutional artifacts using data collected from and to support educational practice and practitioners including learners, teachers, and administrators. There is a substantial and growing body of work under the learning analytics banner. Much of it framed technically around data harvested from digital tools and presentation mechanisms called dashboards. Using a specific case involving a collaborative game-based education research project, this paper provides a broad, sociotechnical design perspective through three frame expanding sections: the educational game’s learning theory-driven approach, the information architecture of the learning analytics system, and the activity system that the information from learning analytics information are used within. This paper illustrates a portion of the conceptual landscape that can guide the design, development, and research for these data systems that are potentially consequential for students and educators.  more » « less
Award ID(s):
1915563
PAR ID:
10258076
Author(s) / Creator(s):
Date Published:
Journal Name:
International Conference of the Learning Sciences
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Research in educational psychology involves empirical investigation into the learning process with an aim to refine psychological theories of learning and their application to real-world settings where they can be used to benefit learners. Emergent methodological processes involved in learning analytics include the study of event-based data produced by individuals in learning environments where they use technology. Paradigms for substantive-methodological synergy can be used to align the strengths of educational psychology and learning analytics research. The Journal of Educational Psychology invites such collaborations. This issue illustrates the advancements to educational theory and practice that can be attained when learning analytics practices are aligned to reflect the assumptions within psychological theories of learning and learning analytics methods including feature engineering and multimodal modeling are leveraged. Exemplars demonstrate learning analytics’ potential contribution to the refinement and application of theories of learning and motivation. Educational Impact and Implications Statement Theories about learning describe complex processes and how the ways individuals undertake them affect the understanding they obtain and performances they achieve. Many of these learning processes are difficult to observe in the naturalistic settings where people learn. When data individuals produce during learning with technologies are collected and modeled in alignment with learning theories and using learning analytics methods, they can make learning processes observable. Incorporating learning analytics into the study of learning and the development of instruction can help refine learning theories and the design of technologies that individuals use to learn. 
    more » « less
  2. Benjamin, Paaßen; Carrie, Demmans Epp (Ed.)
    Although the fields of educational data mining and learning analytics have grown in terms of the analytic sophistication and breadth of applications, the impact on theory-building has been limited. To move these fields forward, studies should not only be driven by learning theory but also the analytics should be used to inform theory. In this paper, we present an approach for integrating educational data mining models with design-based research approaches to promote theory-building that is informed by data-based models. This approach aligns theory, design of the learning environment, data collection, and analytic methods through iterations that focus on the refinement and improvement of all these components. We provide an example from our own work which is driven by a critical constructionist learning framework, the design and development of a digital learning environment for elementary-school aged children to learn about artificial intelligence within sociopolitical contexts, and the use of epistemic network analysis as a tool for modeling learning. We conclude with how this approach can be reciprocally beneficial in that educational data miners can use their models to inform theory and learning scientists can augment their theory-building practices through big data models. 
    more » « less
  3. This chapter provides an overview of an exploratory case study involving a multiteam system in the fire and rescue emergency context incorporating human sensor analytics (e.g., proximity sensors) and other data sources to reveal important insights on within- and between-team learning and training. Incorporating a design research approach, the case study consisting of two live simulation scenarios that informed the design and development of a wearable technology-based system targeted to capture team-based behavior in the live simulation and visualize it during the debriefing session immediately following to potentially inform within- and cross-team behavior from a multiteam systems perspective informed by theory and practice. 
    more » « less
  4. Classroom sensing systems can capture data on teacher-student behaviours and interactions at a scale far greater than human observers can. These data, translated to multi-modal analytics, can provide meaningful insights to educational stakeholders. However, complex data can be difficult to make sense of. In addition, analyses done on these data are often limited by the organization of the underlying sensing system, and translating sensing data into meaningful insights often requires custom analyses across different modalities. We present Edulyze, an analytics engine that processes complex, multi-modal sensing data and translates them into a unified schema that is agnostic to the underlying sensing system or classroom configuration. We evaluate Edulyze’s performance by integrating three sensing systems (Edusense, ClassGaze, and Moodoo) and then present data analyses of five case studies of relevant pedagogical research questions across these sensing systems. We demonstrate how Edulyze’s flexibility and customizability allow us to answer a broad range of research questions made possible by Edulyze’s translation of a breadth of raw sensing data from different sensing systems into relevant classroom analytics.  
    more » « less
  5. de Vries, E; Hod, Y; Ahn, J (Ed.)
    Researchers in the Learning Sciences take two prevalent stances: research as building theories or as developing designs. The connection between theories and designs is most often filled in by methods, but an alternative stance is possible: research as improving models. The modeling stance seeks parsimonious, useful, illuminating descriptions of learning activity systems. Models can help us understand and express how variability (in all its forms) plays into, is enacted during, and results from designed learning activities. Building models often requires employing multiple theories, methods, and design elements; a modeling stance recognizes that our research often elaborates a multi-level systems view. An explicit modeling stance may lead to developing descriptions of complex systems, inviting multi-stakeholder teamwork to improve these systems, integrating advances in learning analytics and educational data mining, and adding to ability of learning sciences research to tackle challenges at scale. 
    more » « less