skip to main content


Title: Design of Real-time Scaffolding of Middle School Science Writing Using Automated Techniques
Science writing skills depend on a student’s ability to co-ordinate conceptual understanding of science with the ability to articulate ideas independently, and to distinguish between gradations of importance in ideas. Real-time scaffolding of student writing during and immediately after the writing process could ease the cognitive burden of learning to co-ordinate these skills and enhance student learning of science. This paper presents a design process for automated support of real-time scaffolding of middle school students’ science explanations. We describe our adaptation of an existing tool for automatic content assessment to align more closely with a rubric, and our reliance on data mining of historical examples of middle school science writing. On a reserved test set of semi-synthetic examples of science explanations, the modified tool demonstrated high correlation with the manual rubric. We conclude the tool can support a wide range of design options for customized student feedback in real time.  more » « less
Award ID(s):
2010483
NSF-PAR ID:
10329329
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
International Society for the Learning Sciences Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The way high school chemistry curricula are structured has the potential to convey consequential messages about knowledge and knowing to students and teachers. If a curriculum is built around practicing skills and recalling facts to reach “correct” answers, it is unlikely class activities will be seen (by students or the teacher) as opportunities to figure out causes for phenomena. Our team of teachers and researchers is working to understand how enactment of transformed curricular materials can support high school chemistry students in making sense of perplexing, relatable phenomena. Given this goal, we were surprised to see that co-developers who enacted our materials overwhelmingly emphasized the importance of acquiring true facts/skills when writing weekly reflections. Recognition that teachers’ expressed aims did not align with our stated goal of “supporting molecular-level sensemaking” led us to examine whether the tacit epistemological commitments reflected by our materials were, in fact, consistent with a course focused on figuring out phenomena. We described several aspects of each lesson in our two-semester curriculum including: the role of phenomena in lesson activities, the extent to which lessons were 3-dimensional, the role of student ideas in class dialogue, and who established coherence between lessons. Triangulation of these lesson features enabled us to infer messages about valued knowledge products and processes materials had the potential to send. We observed that our materials commonly encouraged students to mimic the structure of science practices for the purpose of being evaluated by the teacher. That is, students were asked to “go through the motions” of explaining, modeling etc. but had little agency regarding the sorts of models and explanations they found productive in their class community. This study serves to illustrate the importance of surfacing the tacit epistemological commitments that guide curriculum development. Additionally, it extends existing scholarship on epistemological messaging by considering curricular materials as a potentially consequential sources of messages. 
    more » « less
  2. Abstract

    To promote a justice‐oriented approach to science education, we formed a research‐practice partnership between middle school science teachers, their students, curriculum designers, learning scientists, and experts in social justice to co‐design and test an environmental justice unit for middle school instruction. We examine teacher perspectives on the challenges and possibilities of integrating social justice into their standards‐aligned science teaching as they participate in co‐design and teach the unit. The unit supports students to investigate racially disparate rates of asthma in their community by examining pollution maps and historical redlining maps. We analyze interviews and co‐design artifacts from two teachers who participated in the co‐design and taught the unit in their classrooms. Our findings point to the benefits of a shared pedagogical framework and an initial unit featuring local historical content to structure co‐design. Findings also reveal that teachers can share similar goals for empowering students to use science knowledge for civic action while framing the local socio‐political factors contributing to the injustice differently, due in part to different institutional supports and constraints. Student interviews and a pre/postassessment illustrate how the unit facilitated students' progress in connecting socio‐political and science ideas to explain the impacts of particulate matter pollution and who is impacted most. Analyses illuminate how teachers' pedagogical choices may influence whether and how students discuss the impact of systemic racism in their explanations. The findings inform refinement of the unit and suggest supports needed for co‐design partnerships focused on integrating social justice and science.

     
    more » « less
  3. Abstract

    Collaborative inquiry learning affords educators a context within which to support understanding of scientific practices, disciplinary core ideas, and crosscutting concepts. One approach to supporting collaborative science inquiry is through problem‐based learning (PBL). However, there are two key challenges in scaffolding collaborative inquiry learning in technology rich environments. First, it is unclear how we might understand the impact of scaffolds that address multiple functions (e.g., to support inquiry and argumentation). Second, scaffolds take different forms, further complicating how to coordinate the forms and functions of scaffolds to support effective collaborative inquiry. To address these issues, we identify two functions that needed to be scaffolded, the PBL inquiry cycle and accountable talk. We then designed predefined hard scaffolds and just‐in‐time soft scaffolds that target the regulation of collaborative inquiry processes and accountable talk. Drawing on a mixed method approach, we examine how middle school students from a rural school engaged with Crystal Island: EcoJourneys for two weeks (N=45). Findings indicate that hard scaffolds targeting the PBL inquiry process and soft scaffolds that targeted accountable talk fostered engagement in these processes. Although the one‐to‐one mapping between form and function generated positive results, additional soft scaffolds were also needed for effective engagement in collaborative inquiry and that these soft scaffolds were often contingent on hard scaffolds. Our findings have implications for how we might design the form of scaffolds across multiple functions in game‐based learning environments.

     
    more » « less
  4. Abstract Background

    Providing adaptive scaffolds to help learners develop effective self‐regulated learning (SRL) behaviours has been an important goal for intelligent learning environments. Adaptive scaffolding is especially important in open‐ended learning environments (OELE), where novice learners often face difficulties in completing their learning tasks.

    Objectives

    This paper presents a systematic framework for adaptive scaffolding in Betty's Brain, a learning‐by‐teaching OELE for middle school science, where students construct a causal model to teach a virtual agent, generically named Betty. We evaluate the adaptive scaffolding framework and discuss its implications on the development of more effective scaffolds for SRL in OELEs.

    Methods

    We detect key cognitive/metacognitiveinflection points, that is, moments where students' behaviours and performance change during learning, often suggesting an inability to apply effective learning strategies. At inflection points, Mr. Davis (a mentor agent in Betty's Brain) or Betty (the teachable agent) provides context‐specific conversational feedback, focusing on strategies to help the student become a more productive learner, or encouragement to support positive emotions. We conduct a classroom study with 98 middle schoolers to analyse the impact of adaptive scaffolds on students' learning behaviours and performance. We analyse how students with differential pre‐to‐post learning outcomes receive and use the scaffolds to support their subsequent learning process in Betty's Brain.

    Results and Conclusions

    Adaptive scaffolding produced mixed results, with some scaffolds (viz., strategic hints that supported debugging and assessment of causal models) being generally more useful to students than others (viz., encouragement prompts). Additionally, there were differences in how students with high versus low learning outcomes responded to some hints, as suggested by the differences in their learning behaviours and performance in the intervals after scaffolding. Overall, our findings suggest how adaptive scaffolding in OELEs like Betty's Brain can be further improved to better support SRL behaviours and narrow the learning outcomes gap between high and low performing students.

    Implications

    This paper contributes to our understanding and impact of adaptive scaffolding in OELEs. The results of our study indicate that successful scaffolding has to combine context‐sensitive inflection points with conversational feedback that is tailored to the students' current proficiency levels and needs. Also, our conceptual framework can be used to design adaptive scaffolds that help students develop and apply SRL behaviours in other computer‐based learning environments.

     
    more » « less
  5. Asynchronous online courses are popular because they offer benefits to both students and instructors. Students benefit from the convenience, flexibility, affordability, freedom of geography, and access to information. Instructors and institutions benefit by having a broad geographical reach, scalability, and cost-savings of no physical classroom. A challenge with asynchronous online courses is providing students with engaging, collaborative and interactive experiences. Here, we describe how an online poster symposium can be used as a unique educational experience and assessment tool in a large-enrollment (e.g., 500 students), asynchronous, natural science, general education (GE) course. The course, Introduction to Environmental Science (ENR2100), was delivered using distance education (DE) technology over a 15-week semester. In ENR2100 students learn a variety of topics including freshwater resources, surface water, aquifers, groundwater hydrology, ecohydrology, coastal and ocean circulation, drinking water, water purification, wastewater treatment, irrigation, urban and agricultural runoff, sediment and contaminant transport, water cycle, water policy, water pollution, and water quality. Here we present a is a long-term study that takes place from 2017 to 2022 (before and after COVID-19) and involved 5,625 students over 8 semesters. Scaffolding was used to break up the poster project into smaller, more manageable assignments, which students completed throughout the semester. Instructions, examples, how-to videos, book chapters and rubrics were used to accommodate Students’ different levels of knowledge. Poster assignments were designed to teach students how to find and critically evaluate sources of information, recognize the changing nature of scientific knowledge, methods, models and tools, understand the application of scientific data and technological developments, and evaluate the social and ethical implications of natural science discoveries. At the end of the semester students participated in an asynchronous online poster symposium. Each student delivered a 5-min poster presentation using an online learning management system and completed peer reviews of their classmates’ posters using a rubric. This poster project met the learning objectives of our natural science, general education course and taught students important written, visual and verbal communication skills. Students were surveyed to determine, which parts of the course were most effective for instruction and learning. Students ranked poster assignments first, followed closely by lectures videos. Approximately 87% of students were confident that they could produce a scientific poster in the future and 80% of students recommended virtual poster symposiums for online courses. 
    more » « less