More Like this

1. A human‐centred learning analytics approach for developing contextually scalable K‐12 teacher dashboards

   https://doi.org/10.1111/bjet.13383  

   Wiley, Korah ; Dimitriadis, Yannis ; Linn, Marcia ( September 2023 , British Journal of Educational Technology)

   This paper describes a Human‐Centred Learning Analytics (HCLA) design approach for developing learning analytics (LA) dashboards for K‐12 classrooms that maintain both contextual relevance and scalability—two goals that are often in competition. Using mixed methods, we collected observational and interview data from teacher partners and assessment data from their students' engagement with the lesson materials. This DBR‐based, human‐centred design process resulted in a dashboard that supported teachers in addressing their students' learning needs. To develop the dashboard features that could support teachers, we found that a design refinement process that drew on the insights of teachers with varying teaching experience, philosophies and teaching contexts strengthened the resulting outcome. The versatile nature of the approach, in terms of student learning outcomes, makes it useful for HCLA design efforts across diverse K‐12 educational contexts.

   What is already known about this topic

   Learning analytics that are aligned to both a learning theory and learning design support student learning.

   LA dashboards that support users to understand the associated learning analytics data provide actionable insight.

   Design‐based research is a promising methodology for Human‐Centred Learning Analytics design, particularly in the K‐12 educational context.

   What this paper adds

   Leveraging a longstanding, yet fluid, research‐practice partnership is an effective design‐based research adaptation for addressing the high variation in instructional practices that characterize K‐12 education.

   Using both quantitative and qualitative data that reflects students' developing knowledge effectively supports teachers' inquiry into student learning.

   Teachers' use of learning analytics dashboards is heavily influenced by their perspectives on teaching and learning.

   Implications for practice and/or policy

   Impact on student learning outcomes, alongside usability and feasibility, should be included as a necessary metric for the effectiveness of LA design.

   LA dashboard developers should both leverage learning data that reflect students' developing knowledge and position teachers to take responsive pedagogical action to support student learning.

   LA researchers and developers should utilize a long‐term, yet fluid, research‐practice partnership to form a multi‐stakeholder, multidisciplinary design team for Human‐Centred Learning Analytics design.

    

   more » « less
2. Low-Barrier Strategies to Increase Student-Centered Learning Low-Barrier Strategies to Increase Student-Centered Learning

   Friend, Nicole Erin Woodcock ( July 2021 , ASEE annual conference exposition proceedings)

   Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction. 

   more » « less
3. Embracing a culture of talk: STEM teachers’ engagement in small-group discussions about photovoltaics

   https://doi.org/10.1186/s40594-023-00442-7  

   Firetto, Carla M. ; Starrett, Emily ; Jordan, Michelle E. ( July 2023 , International Journal of STEM Education)

   Small-group discussions are well established as an effective pedagogical tool to promote student learning in STEM classrooms. However, there are a variety of factors that influence how and to what extent K-12 teachers use small-group discussions in their classrooms, including both their own STEM content knowledge and their perceived ability to facilitate discussions. We designed the present study to specifically target these two factors in the context of photovoltaics, an interdisciplinary field at the intersection of all STEM disciplines with potential to yield widespread benefits related to the use of solar technologies as a sustainable, renewable energy source. Teachers engaged in a series of small-group discussions based on photovoltaic source material (e.g., scientific articles) to build both their STEM content knowledge and capability with discussions, promoting their potential to design and deliver STEM instruction in their own classrooms using small-group discussion.

   Overall, teachers productively engaged in rich STEM talk as they spent most of the time in the discussion asking authentic questions about photovoltaic topics in alignment with a variety of science and engineering disciplinary core ideas, responding to the questions with rich, elaborative talk, and taking on ownership of the discussions. Teachers also evidenced increases in their photovoltaic knowledge and their perceived capability to facilitate discussions. Finally, most teachers’ end-of-program lesson plans included the use of small-group discussions, and a subsample of teachers who completed a follow-up interview one year after the summer program reported greater enactment of discussion in their STEM classrooms.

   Our manuscript forwards an important contribution that draws from a practice-based approach to professional development in a way that not only better prepares teachers on what to teach (i.e., through enhanced PV content knowledge), but it also supports their ability to implement this instruction into their classrooms more effectively (i.e., though the use of small-group discussion). As such, this manuscript illustrates an innovative pedagogical approach for potential use in supporting teacher education and informs ways to enable teachers to build enhanced curricula for their STEM students.

    

   more » « less
4. Development, Implementation, Refining and Revising of Adaptive Platform Lessons for an Engineering Course

   Kaw, A. ; Yalcin, A. ; Gomes, R. ; Serrano, L. ; Scott, A. ; Lou, Y. ; Clark, R. ( July 2022 , Proceedings of ASEE Annual Conference and Exposition)

   Since the 2014 high-profile meta-analysis of undergraduate STEM courses, active learning has become a standard in higher education pedagogy. One way to provide active learning is through the flipped classroom. However, finding suitable pre-class learning activities to improve student preparation and the subsequent classroom environment, including student engagement, can present a challenge in the flipped modality. To address this challenge, adaptive learning lessons were developed for pre-class learning for a course in Numerical Methods. The lessons would then be used as part of a study to determine their cognitive and affective impacts. Before the study could be started, it involved constructing well-thought-out adaptive lessons. This paper discusses developing, refining, and revising the adaptive learning platform (ALP) lessons for pre-class learning in a Numerical Methods flipped course. In a prior pilot study at a large public southeastern university, the first author had developed ALP lessons for the pre-class learning for four (Nonlinear Equations, Matrix Algebra, Regression, Integration) of the eight topics covered in a Numerical Methods course. In the current follow-on study, the first author and two other instructors who teach Numerical Methods, one from a large southwestern urban university and another from an HBCU, collaborated on developing the adaptive lessons for the whole course. The work began in Fall 2020 by enumerating the various chapters and breaking each one into individual lessons. Each lesson would include five sections (introduction, learning objectives, video lectures, textbook content, assessment). The three instructors met semi-monthly to discuss the content that would form each lesson. The main discussion of the meetings centered on what a student would be expected to learn before coming to class, choosing appropriate content, agreeing on prerequisites, and choosing and making new assessment questions. Lessons were then created by the first author and his student team using a commercially available platform called RealizeIT. The content was tested by learning assistants and instructors. It is important to note that significant, if not all, parts of the content, such as videos and textbook material, were available through previously done work. The new adaptive lessons and the revised existing ones were completed in December 2020. The adaptive lessons were tested for implementation in Spring 2021 at the first author's university and made 15% of the students' grade calculation. Questions asked by students during office hours, on the LMS discussion board, and via emails while doing the lessons were used to update content, clarify questions, and revise hints offered by the platform. For example, all videos in the ALP lessons were updated to HD quality based on student feedback. In addition, comments from the end-of-semester surveys conducted by an independent assessment analyst were collated to revise the adaptive lessons further. Examples include changing the textbook content format from an embedded PDF file to HTML to improve quality and meet web accessibility standards. The paper walks the reader through the content of a typical lesson. It also shows the type of data collected by the adaptive learning platform via three examples of student interactions with a single lesson. 

   more » « less
5. Development, Implementation, Refining and Revising of Adaptive Platform Lessons for an Engineering Course

   Kaw, A. ( June 2023 , Proceedings of the 2022 ASEE Annual Conference and Exposition)

   Since the 2014 high-profile meta-analysis of undergraduate STEM courses, active learning has become a standard in higher education pedagogy. One way to provide active learning is through the flipped classroom. However, finding suitable pre-class learning activities to improve student preparation and the subsequent classroom environment, including student engagement, can present a challenge in the flipped modality. To address this challenge, adaptive learning lessons were developed for pre-class learning for a course in Numerical Methods. The lessons would then be used as part of a study to determine their cognitive and affective impacts. Before the study could be started, it involved constructing well-thought-out adaptive lessons. This paper discusses developing, refining, and revising the adaptive learning platform (ALP) lessons for pre-class learning in a Numerical Methods flipped course. In a prior pilot study at a large public southeastern university, the first author had developed ALP lessons for the pre-class learning for four (Nonlinear Equations, Matrix Algebra, Regression, Integration) of the eight topics covered in a Numerical Methods course. In the current follow-on study, the first author and two other instructors who teach Numerical Methods, one from a large southwestern urban university and another from an HBCU, collaborated on developing the adaptive lessons for the whole course. The work began in Fall 2020 by enumerating the various chapters and breaking each one into individual lessons. Each lesson would include five sections (introduction, learning objectives, video lectures, textbook content, assessment). The three instructors met semi-monthly to discuss the content that would form each lesson. The main discussion of the meetings centered on what a student would be expected to learn before coming to class, choosing appropriate content, agreeing on prerequisites, and choosing and making new assessment questions. Lessons were then created by the first author and his student team using a commercially available platform called RealizeIT. The content was tested by learning assistants and instructors. It is important to note that significant, if not all, parts of the content, such as videos and textbook material, were available through previously done work. The new adaptive lessons and the revised existing ones were completed in December 2020. The adaptive lessons were tested for implementation in Spring 2021 at the first author's university and made 15% of the students' grade calculation. Questions asked by students during office hours, on the LMS discussion board, and via emails while doing the lessons were used to update content, clarify questions, and revise hints offered by the platform. For example, all videos in the ALP lessons were updated to HD quality based on student feedback. In addition, comments from the end-of-semester surveys conducted by an independent assessment analyst were collated to revise the adaptive lessons further. Examples include changing the textbook content format from an embedded PDF file to HTML to improve quality and meet web accessibility standards. The paper walks the reader through the content of a typical lesson. It also shows the type of data collected by the adaptive learning platform via three examples of student interactions with a single lesson. 

   more » « less