More Like this

1. Co‐designing teacher support technology for problem‐based learning in middle school science

   https://doi.org/10.1111/bjet.13363  

   Hutchins, Nicole M. ; Biswas, Gautam ( July 2023 , British Journal of Educational Technology)

   This paper provides an experience report on a co‐design approach with teachers to co‐create learning analytics‐based technology to support problem‐based learning in middle school science classrooms. We have mapped out a workflow for such applications and developed design narratives to investigate the implementation, modifications and temporal roles of the participants in the design process. Our results provide precedent knowledge on co‐designing with experienced and novice teachers and co‐constructing actionable insight that can help teachers engage more effectively with their students' learning and problem‐solving processes during classroom PBL implementations.

   What is already known about this topic

   Success of educational technology depends in large part on the technology's alignment with teachers' goals for their students, teaching strategies and classroom context.

   Teacher and researcher co‐design of educational technology and supporting curricula has proven to be an effective way for integrating teacher insight and supporting their implementation needs.

   Co‐designing learning analytics and support technologies with teachers is difficult due to differences in design and development goals, workplace norms, and AI‐literacy and learning analytics background of teachers.

   What this paper adds

   We provide a co‐design workflow for middle school teachers that centres on co‐designing and developing actionable insights to support problem‐based learning (PBL) by systematic development of responsive teaching practices using AI‐generated learning analytics.

   We adapt established human‐computer interaction (HCI) methods to tackle the complex task of classroom PBL implementation, working with experienced and novice teachers to create a learning analytics dashboard for a PBL curriculum.

   We demonstrate researcher and teacher roles and needs in ensuring co‐design collaboration and the co‐construction of actionable insight to support middle school PBL.

   Implications for practice and/or policy

   Learning analytics researchers will be able to use the workflow as a tool to support their PBL co‐design processes.

   Learning analytics researchers will be able to apply adapted HCI methods for effective co‐design processes.

   Co‐design teams will be able to pre‐emptively prepare for the difficulties and needs of teachers when integrating middle school teacher feedback during the co‐design process in support of PBL technologies.

    

   more » « less
2. How teachers conceptualise shared control with an AI co‐orchestration tool: A multiyear teacher‐centred design process

   https://doi.org/10.1111/bjet.13372  

   Lawrence, LuEttaMae ; Echeverria, Vanessa ; Yang, Kexin ; Aleven, Vincent ; Rummel, Nikol ( August 2023 , British Journal of Educational Technology)

   Artificial intelligence (AI) can enhance teachers' capabilities by sharing control over different parts of learning activities. This is especially true for complex learning activities, such as dynamic learning transitions where students move between individual and collaborative learning in un‐planned ways, as the need arises. Yet, few initiatives have emerged considering how shared responsibility between teachers and AI can support learning and how teachers' voices might be included to inform design decisions. The goal of our article is twofold. First, we describe a secondary analysis of our co‐design process comprising six design methods to understand how teachers conceptualise sharing control with an AI co‐orchestration tool, calledPair‐Up. We worked with 76 middle school math teachers, each taking part in one to three methods, to create a co‐orchestration tool that supports dynamic combinations of individual and collaborative learning using two AI‐based tutoring systems. We leveraged qualitative content analysis to examine teachers' views about sharing control withPair‐Up, and we describe high‐level insights about the human‐AI interaction, including control, trust, responsibility, efficiency, and accuracy. Secondly, we use our results as an example showcasing how human‐centred learning analytics can be applied to the design of human‐AI technologies and share reflections for human‐AI technology designers regarding the methods that might be fruitful to elicit teacher feedback and ideas. Our findings illustrate the design of a novel co‐orchestration tool to facilitate the transitions between individual and collaborative learning and highlight considerations and reflections for designers of similar systems.

   What is already known about this topic:

   Artificial Intelligence (AI) can help teachers facilitate complex classroom activities, such as having students move between individual and collaborative learning in unplanned ways.

   Designers should use human‐centred design approaches to give teachers a voice in deciding what AI might do in the classroom and if or how they want to share control with it.

   What this paper adds:

   Presents teacher views about how they want to share control with AI to support students moving between individual and collaborative learning.

   Describes how we adapted six design methods to design AI features.

   Illustrates a complete, iterative process to create human‐AI interactions to support teachers as they facilitate students moving from individual to collaborative learning.

   Implications for practice:

   We share five implications for designers that teachers highlighted as necessary when designing AI‐features, including control, trust, responsibility, efficiency and accuracy.

   Our work also includes a reflection on our design process and implications for future design processes.

    

   more » « less
3. Programming as a language for young children to express and explore mathematics in school

   https://doi.org/10.1111/bjet.13080  

   Goldenberg, E. Paul ; Carter, Cynthia J. ( May 2021 , British Journal of Educational Technology)

   Natural language helps express mathematical thinking and contexts. Conventional mathematical notation (CMN) best suits expressions and equations. Each is essential; each also has limitations, especially for learners. Our research studies how programming can be a advantageous third language that can also help restore mathematical connections that are hidden by topic‐centred curricula. Restoring opportunities for surprise and delight reclaims mathematics' creative nature. Studies of children's use of language in mathematics and their programming behaviours guide our iterative design/redesign of mathematical microworlds in which students, ages 7–11, use programming in their regular school lessonsas a language for learning mathematics. Though driven by mathematics, not coding, the microworlds develop the programming over time so that it continues to support children's developing mathematical ideas. This paper briefly describes microworlds EDC has tested with well over 400 7‐to‐8‐year‐olds in school, and others tested (or about to be tested) with over 200 8‐to‐11‐year‐olds. Our challenge was to satisfy schools' topical orientation and fit easily within regular classroom study but use and foreshadow other mathematical learning to remove the siloes. The design/redesign research and evaluation is exploratory, without formal methodology. We are also more formally studying effects on children's learning. That ongoing study is not reported here.

   What is already known

   Active learning—doing—supports learning.

   Collaborative learning—doingtogether—supports learning.

   Classroom discourse—focused, relevantdiscussion, not just listening—supports learning.

   Clear articulation of one's thinking, even just to oneself, helps develop that thinking.

   What this paper adds

   The common languages we use for classroom mathematics—natural language for conveying the meaning and context of mathematical situations and for explaining our reasoning; and the formal (written) language of conventional mathematical notation, the symbols we use in mathematical expressions and equations—are both essential but each presents hurdles that necessitate the other. Yet, even together, they are insufficient especially for young learners.

   Programming, appropriately designed and used, can be the third language that both reduces barriers and provides the missing expressive and creative capabilities children need.

   Appropriate design for use in regular mathematics classrooms requires making key mathematical content obvious, strong and the ‘driver’ of the activities, and requires reducing tech ‘overhead’ to near zero.

   Continued usefulness across the grades requires developing children's sophistication and knowledge with the language; the powerful ways that children rapidly acquire facility with (natural) language provides guidance for ways they can learn a formal language as well.

   Implications for policy and/or practice

   Mathematics teaching can take advantage of the ways children learn through experimentation and attention to the results, and of the ways children use their language brain even for mathematics.

   In particular, programming—in microworlds driven by the mathematical content, designed to minimise distraction and overhead, open to exploration and discoveryen routeto focused aims, and in which childrenself‐evaluate—can allow clear articulation of thought, experimentation with immediate feedback.

   As it aids the mathematics, it also builds computational thinking and satisfies schools' increasing concerns to broaden access to ideas of computer science.

    

   more » « less
4. A human‐centred learning analytics approach for developing contextually scalable K‐12 teacher dashboards

   https://doi.org/10.1111/bjet.13383  

   Wiley, Korah ; Dimitriadis, Yannis ; Linn, Marcia ( September 2023 , British Journal of Educational Technology)

   This paper describes a Human‐Centred Learning Analytics (HCLA) design approach for developing learning analytics (LA) dashboards for K‐12 classrooms that maintain both contextual relevance and scalability—two goals that are often in competition. Using mixed methods, we collected observational and interview data from teacher partners and assessment data from their students' engagement with the lesson materials. This DBR‐based, human‐centred design process resulted in a dashboard that supported teachers in addressing their students' learning needs. To develop the dashboard features that could support teachers, we found that a design refinement process that drew on the insights of teachers with varying teaching experience, philosophies and teaching contexts strengthened the resulting outcome. The versatile nature of the approach, in terms of student learning outcomes, makes it useful for HCLA design efforts across diverse K‐12 educational contexts.

   What is already known about this topic

   Learning analytics that are aligned to both a learning theory and learning design support student learning.

   LA dashboards that support users to understand the associated learning analytics data provide actionable insight.

   Design‐based research is a promising methodology for Human‐Centred Learning Analytics design, particularly in the K‐12 educational context.

   What this paper adds

   Leveraging a longstanding, yet fluid, research‐practice partnership is an effective design‐based research adaptation for addressing the high variation in instructional practices that characterize K‐12 education.

   Using both quantitative and qualitative data that reflects students' developing knowledge effectively supports teachers' inquiry into student learning.

   Teachers' use of learning analytics dashboards is heavily influenced by their perspectives on teaching and learning.

   Implications for practice and/or policy

   Impact on student learning outcomes, alongside usability and feasibility, should be included as a necessary metric for the effectiveness of LA design.

   LA dashboard developers should both leverage learning data that reflect students' developing knowledge and position teachers to take responsive pedagogical action to support student learning.

   LA researchers and developers should utilize a long‐term, yet fluid, research‐practice partnership to form a multi‐stakeholder, multidisciplinary design team for Human‐Centred Learning Analytics design.

    

   more » « less
5. The information won't just sink in: Helping teachers provide technology‐assisted data literacy instruction in social studies

   https://doi.org/10.1111/bjet.13255  

   Shreiner, Tamara L. ; Guzdial, Mark ( July 2022 , British Journal of Educational Technology)

   In this study, support for teaching data literacy in social studies is provided through the design of a pedagogical support system informed by participatory design sessions with both pre‐service and in‐service social studies teachers. It provides instruction on teaching and learning data literacy in social studies, examples of standards‐based lesson plans, made‐to‐purpose data visualization tools and minimal manuals that put existing online tools in a social studies context. Based on case studies of eleven practicing teachers, this study provides insight into features of technology resources that social studies teachers find usable and useful for using data visualizations as part of standards‐ and inquiry‐based social studies instruction, teaching critical analysis of data visualizations and helping students create data visualizations with online computing tools. The final result, though, is that few of our participating teachers have yet adopted the provided resources into their own classrooms, which highlights weaknesses of the technology acceptance model for describing teacher adoption.

   What is already known about this topic

   Data literacy is an important part of social studies education in the United States.

   Most teachers do not teach data literacy as a part of social studies.

   Teachers may adopt technology to help them teach data literacy if they think it is useful and usable.

   What this paper adds

   Educational technology can help teachers learn about data literacy in social studies.

   Social studies teachers want simple tools that fit with their existing curricula, give them new project ideas and help students learn difficult concepts.

   Making tools useful and usable does not predict adoption; context plays a large role in a social studies teachers' adoption.

   Implications for practice and/or policy

   Designing purpose‐built tools for social studies teachers will encourage them to teach data literacy in their classes.

   Professional learning opportunities for teachers around data literacy should include opportunities for experimentation with tools.

   Teachers are not likely to use tools if they are not accompanied by lesson and project ideas.

    

   more » « less