skip to main content


Title: A Systematic Review of Research on Personalized Learning: Personalized by Whom, to What, How, and for What Purpose(s)?
Teachers, schools, districts, states, and technology developers endeavor to personalize learning experiences for students, but definitions of personalized learning (PL) vary and designs often span multiple components. Variability in definition and implementation complicate the study of PL and the ways that designs can leverage student characteristics to reliably achieve targeted learning outcomes. We document the diversity of definitions of PL that guide implementation in educational settings and review relevant educational theories that could inform design and implementation. We then report on a systematic review of empirical studies of personalized learning using PRISMA guidelines. We identified 376 unique studies that investigated one or more PL design features and appraised this corpus to determine (1) who studies personalized learning; (2) with whom, and in what contexts; and (3) with focus on what learner characteristics, instructional design approaches, and learning outcomes. Results suggest that PL research is led by researchers in education, computer science, engineering, and other disciplines, and that the focus of their PL designs differs by the learner characteristics and targeted outcomes they prioritize. We further observed that research tends to proceed without a priori theoretical conceptualization, but also that designs often implicitly align to assumptions posed by extant theories of learning. We propose that a theoretically guided approach to the design and study of PL can organize efforts to evaluate the practice, and forming an explicit theory of change can improve the likelihood that efforts to personalize learning achieve their aims. We propose a theory-guided method for the design of PL and recommend research methods that can parse the effects obtained by individual design features within the “many-to-many-to-many” designs that characterize PL in practice.  more » « less
Award ID(s):
1759195
NSF-PAR ID:
10274018
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Educational Psychology Review
ISSN:
1040-726X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This article introduces a special issue comprising research on efforts to personalize learning in different academic subjects. We first consider the emergence of personalized learning (PL) and the myriad of definitions that describe its essential features. Thereafter, we introduce the articles in the special issue by examining their alignment to extant theories of learning, the instructional design features that personalize the learning experience based on a learner characteristic, and the relationships between PL design and outcomes achieved in an educational context. Based on observations of contemporary PL research, we identify key issues to be addressed by the field and recommendations for future researchers to undertake to advance a PL theory. Chief among issues with PL are the role of technology, the agency of the learner, and the absence of a consistent theoretical grounding to motivate PL design choices. Future directions that would advance PL include the adoption of a theory of change in PL design, a design-based research approach to refine PL initiatives, more intensive and iterative research in authentic classroom contexts, and a greater focus on student input into and ownership of the PL experience. 
    more » « less
  2. Who and by what means do we ensure that engineering education evolves to meet the ever changing needs of our society? This and other papers presented by our research team at this conference offer our initial set of findings from an NSF sponsored collaborative study on engineering education reform. Organized around the notion of higher education governance and the practice of educational reform, our open-ended study is based on conducting semi-structured interviews at over three dozen universities and engineering professional societies and organizations, along with a handful of scholars engaged in engineering education research. Organized as a multi-site, multi-scale study, our goal is to document differences in perspectives and interest the exist across organizational levels and institutions, and to describe the coordination that occurs (or fails to occur) in engineering education given the distributed structure of the engineering profession. This paper offers for all engineering educators and administrators a qualitative and retrospective analysis of ABET EC 2000 and its implementation. The paper opens with a historical background on the Engineers Council for Professional Development (ECPD) and engineering accreditation; the rise of quantitative standards during the 1950s as a result of the push to implement an engineering science curriculum appropriate to the Cold War era; EC 2000 and its call for greater emphasis on professional skill sets amidst concerns about US manufacturing productivity and national competitiveness; the development of outcomes assessment and its implementation; and the successive negotiations about assessment practice and the training of both of program evaluators and assessment coordinators for the degree programs undergoing evaluation. It was these negotiations and the evolving practice of assessment that resulted in the latest set of changes in ABET engineering accreditation criteria (“1-7” versus “a-k”). To provide an insight into the origins of EC 2000, the “Gang of Six,” consisting of a group of individuals loyal to ABET who used the pressure exerted by external organizations, along with a shared rhetoric of national competitiveness to forge a common vision organized around the expanded emphasis on professional skill sets. It was also significant that the Gang of Six was aware of the fact that the regional accreditation agencies were already contemplating a shift towards outcomes assessment; several also had a background in industrial engineering. However, this resulted in an assessment protocol for EC 2000 that remained ambiguous about whether the stated learning outcomes (Criterion 3) was something faculty had to demonstrate for all of their students, or whether EC 2000’s main emphasis was continuous improvement. When it proved difficult to demonstrate learning outcomes on the part of all students, ABET itself began to place greater emphasis on total quality management and continuous process improvement (TQM/CPI). This gave institutions an opening to begin using increasingly limited and proximate measures for the “a-k” student outcomes as evidence of effort and improvement. In what social scientific terms would be described as “tactical” resistance to perceived oppressive structures, this enabled ABET coordinators and the faculty in charge of degree programs, many of whom had their own internal improvement processes, to begin referring to the a-k criteria as “difficult to achieve” and “ambiguous,” which they sometimes were. Inconsistencies in evaluation outcomes enabled those most discontented with the a-k student outcomes to use ABET’s own organizational processes to drive the latest revisions to EAC accreditation criteria, although the organization’s own process for member and stakeholder input ultimately restored much of the professional skill sets found in the original EC 2000 criteria. Other refinements were also made to the standard, including a new emphasis on diversity. This said, many within our interview population believe that EC 2000 had already achieved much of the changes it set out to achieve, especially with regards to broader professional skills such as communication, teamwork, and design. Regular faculty review of curricula is now also a more routine part of the engineering education landscape. While programs vary in their engagement with ABET, there are many who are skeptical about whether the new criteria will produce further improvements to their programs, with many arguing that their own internal processes are now the primary drivers for change. 
    more » « less
  3. We STEM educators often hear that so many of our students fail because they are not college ready. But interventions at various levels, despite the hard work of implementation, have not resulted in dramatic improvements. What if, instead, the problem is that the institutional system – including instructional approaches and policies – is not student ready? The goal of our NSF supported project, called “Eco-STEM,” is to establish a healthy STEM educational ecosystem that allows all individuals within the ecosystem to thrive. The context for our work on STEM educational ecosystems is a Very High Hispanic Enrolling Hispanic-Serving Institution (HSI) at California State University, Los Angeles, where the majority of our students are also low-income and first-generation college students. Guided by an ecosystem paradigm, the project aims to: 1) create a supportive and culturally responsive learning/working environment for both students and faculty; 2) make teaching and learning rewarding and fulfilling experiences; and 3) emphasize the assets of our community to enhance motivation, excellence, and success. Currently, many STEM educators have a mental model of the education system as a pipeline or pathway, and this factory-like model requires standard inputs, expecting students to come prepared with certain knowledge and skills [4]. When the educational system is viewed as a factory assembly line (as shown in Figure 1), interventions are focused on fixing the inputs by trying to increase students’ preparedness, which contributes to a prevailing deficit-focused mindset. This not only hinders student growth but also makes educational institutions less inclusive and teaching less rewarding for faculty. Increasingly, equity-minded educators and researchers employing the framework of community cultural wealth suggest that we need an asset-based mindset if we are to help all students achieve success in STEM. Research on ecosystem models offers a new way of thinking. In contrast to pipelines or pathways, which focus on student outcomes, an ecosystem model is centered on the learning environment, communities, and the experiences that diverse students, faculty, and staff have in the system as active agents. The Eco-STEM project proposes to: 1) shift the mental models of STEM faculty from factory- based to ecosystem-based so that they will intentionally establish healthy classroom ecosystems that facilitate learning for all students regardless of their backgrounds; 2) change the mental models and develop the capacity of department chairs and program coordinators so they can lead the cultural changes needed to create a healthy ecosystem at the department level; and 3) revise the teaching evaluation system to promote faculty development and enhance the student experience, which will help to create a healthy ecosystem at the institution. One fundamental aspect of this project is the Eco-STEM Faculty Fellows Community of Practice (CoP), which is designed to help foster these changes. As a work-in-progress paper, this paper presents the design and structure of the Eco-STEM Faculty Fellows CoP and seeks input from the faculty development community on our approach to fostering a healthy educational ecosystem for the majority marginalized student population we serve. 
    more » « less
  4. This Innovate Practice full paper presents a cloud-based personalized learning lab platform. Personalized learning is gaining popularity in online computer science education due to its characteristics of pacing the learning progress and adapting the instructional approach to each individual learner from a diverse background. Among various instructional methods in computer science education, hands-on labs have unique requirements of understanding learner's behavior and assessing learner's performance for personalization. However, it is rarely addressed in existing research. In this paper, we propose a personalized learning platform called ThoTh Lab specifically designed for computer science hands-on labs in a cloud environment. ThoTh Lab can identify the learning style from student activities and adapt learning material accordingly. With the awareness of student learning styles, instructors are able to use techniques more suitable for the specific student, and hence, improve the speed and quality of the learning process. With that in mind, ThoTh Lab also provides student performance prediction, which allows the instructors to change the learning progress and take other measurements to help the students timely. For example, instructors may provide more detailed instructions to help slow starters, while assigning more challenging labs to those quick learners in the same class. To evaluate ThoTh Lab, we conducted an experiment and collected data from an upper-division cybersecurity class for undergraduate students at Arizona State University in the US. The results show that ThoTh Lab can identify learning style with reasonable accuracy. By leveraging the personalized lab platform for a senior level cybersecurity course, our lab-use study also shows that the presented solution improves students engagement with better understanding of lab assignments, spending more effort on hands-on projects, and thus greatly enhancing learning outcomes. 
    more » « less
  5. Purpose This study aims to present theory, practice and original research findings to support the proposition that broad enquiry and problem-based learning (EPBL) approaches provide an appropriate pedagogical lens for sustainability educators to develop the knowledge and skills needed to work effectively within mission-oriented innovation policy (MIP) environments. Design/methodology/approach The research study comprised four elements, each of which used different research methods. The first element involved a literature review mapping the synergies between MIP and EPBL; the second element piloted the use of EPBL for undergraduate modules related to sustainability challenges; the third element involved external stakeholders in the co-creation of a postgraduate programme that brought together innovation and sustainability, with EPBL fundamental to the design and development; the fourth element curated and comparatively analysed international cases of EPBL in the context of MIP, and sustainability challenges in particular, highlighting the versatility of EPBL and the importance of creativity in EPBL design and implementation. Findings The systematic literature review reveals synergies between the key features of EPBL and defining characteristics of MIP, indicating the relevance of applying EPBL to support MIP. Two in situ pilots generated 13 recommendations on the benefits and operational challenges of applying EPBL. These recommendations informed the design and development of a postgraduate programme, involving a transdisciplinary consultation process with key industrial and societal stakeholders. Comparative analysis of four international case studies describing EPBL applied in practice in different international settings show there is no “one size fits all”. Instead, the application of EPBL to different sustainability challenges and for different learner groups demonstrates the versatility of the pedagogical approach and the creativity of the sustainability educators. Originality/value A discourse around the appropriate pedagogical methods and teaching/learning practice to equip the current and future workforce with the knowledge and skills to respond to MIP and global sustainability challenges is nascent but emerging. This paper makes a scientific and practical contribution to the discourse. The authors show how EPBL can underpin the design of programmes to provide learners with the knowledge and skills to support organisations working effectively within an MIP context, especially addressing sustainability challenges. The authors provide recommendations for educators seeking to embed EPBL within their curriculum and call for external stakeholders to proactively engage with educators to co-create programmes with context-specific outcomes. 
    more » « less