An official website of the United States government
With the increasing prevalence of large language models (LLMs) such as ChatGPT, there is a growing need to integrate natural language processing (NLP) into K-12 education to better prepare young learners for the future AI landscape. NLP, a sub-field of AI that serves as the foundation of LLMs and many advanced AI applications, holds the potential to enrich learning in core subjects in K-12 classrooms. In this experience report, we present our efforts to integrate NLP into science classrooms with 98 middle school students across two US states, aiming to increase students’ experience and engagement with NLP models through textual data analyses and visualizations. We designed learning activities, developed an NLP-based interactive visualization platform, and facilitated classroom learning in close collaboration with middle school science teachers. This experience report aims to contribute to the growing body of work on integrating NLP into K-12 education by providing insights and practical guidelines for practitioners, researchers, and curriculum designers.
more »
« less
NLP4Science: Designing a Platform for Integrating Natural Language Processing in Middle School Science Classrooms
Artificial Intelligence (AI) and Natural Language Processing (NLP) have become increasingly relevant across multiple fields, creating a necessity for young learners to understand these concepts. However, resources enabling learners to apply AI and NLP, particularly in middle school science, remain limited. To address this gap, we present the early development of NLP4Science, an interactive visualization application facilitating the integration of NLP concepts such as sentiment analysis and keyword extraction into middle school science. We adopted an iterative co-design process starting with a professional development workshop with four teachers, followed by a 2-day pilot study with 48 eighth graders, and concluding with a 5-day study involving 50 sixth graders. This poster presents an overview of NLP4Science, highlighting its key features, and sharing insights gained from the iterative design process, demonstrating the potential of NLP4Science to transform AI and NLP learning within middle school science classrooms.
more »
« less
- PAR ID:
- 10496814
- Publisher / Repository:
- IEEE
- Date Published:
- Journal Name:
- IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
- ISBN:
- 979-8-3503-2946-9
- Page Range / eLocation ID:
- 269 - 273
- Format(s):
- Medium: X
- Location:
- Washington, DC, USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
An extensive number of empirical research studies support the engagement of young children and youth in out-of-school science, technology, engineering, and/or mathematics learning experiences. In this case study, we add to this knowledge base through examining how rural middle school learners engage with science and math concepts and practices through an afterschool program that emphasized the development of STEM content, skills, and practices using the field of archaeology, as well as Indigenous knowledges, as mediums. Results highlighted how various syncretic approaches within the afterschool program afforded 61 middle school aged learners’ opportunities to engage with math and science concepts common to archaeologists and Indigenous peoples. We illustrate this through five “doings.” For example, learners engaged in similar science practices to Indigenous peoples through considering how local landscapes and the natural environment informed decisions regarding settlements. This study concludes with recommendations for professional archaeologists and educators to adapt and/or develop a similar afterschool program to support students’ participation as ARCH + STEM learners.more » « less
-
As use of artificial intelligence (AI) has increased, concerns about AI bias and discrimination have been growing. This paper discusses an application called PyrEval in which natural language processing (NLP) was used to automate assessment and pro- vide feedback on middle school science writing with- out linguistic discrimination. Linguistic discrimination in this study was operationalized as unfair assess- ment of scientific essays based on writing features that are not considered normative such as subject- verb disagreement. Such unfair assessment is espe- cially problematic when the purpose of assessment is not assessing English writing but rather assessing the content of scientific explanations. PyrEval was implemented in middle school science classrooms. Students explained their roller coaster design by stat- ing relationships among such science concepts as potential energy, kinetic energy and law of conser- vation of energy. Initial and revised versions of sci- entific essays written by 307 eighth- grade students were analyzed. Our manual and NLP assessment comparison analysis showed that PyrEval did not pe- nalize student essays that contained non-normative writing features. Repeated measures ANOVAs and GLMM analysis results revealed that essay quality significantly improved from initial to revised essays after receiving the NLP feedback, regardless of non- normative writing features. Findings and implications are discussed.more » « less
-
As use of artificial intelligence (AI) has increased, concerns about AI bias and discrimination have been growing. This paper discusses an application called PyrEval in which natural language processing (NLP) was used to automate assessment and pro- vide feedback on middle school science writing with- out linguistic discrimination. Linguistic discrimination in this study was operationalized as unfair assess- ment of scientific essays based on writing features that are not considered normative such as subject- verb disagreement. Such unfair assessment is espe- cially problematic when the purpose of assessment is not assessing English writing but rather assessing the content of scientific explanations. PyrEval was implemented in middle school science classrooms. Students explained their roller coaster design by stat- ing relationships among such science concepts as potential energy, kinetic energy and law of conser- vation of energy. Initial and revised versions of sci- entific essays written by 307 eighth- grade students were analyzed. Our manual and NLP assessment comparison analysis showed that PyrEval did not pe- nalize student essays that contained non-normative writing features. Repeated measures ANOVAs and GLMM analysis results revealed that essay quality significantly improved from initial to revised essays after receiving the NLP feedback, regardless of non- normative writing features. Findings and implications are discussed.more » « less
-
As Artificial Intelligence (AI) becomes ubiquitous in children’s lives, it is crucial to introduce newand effective ways to teach the younger generation about AI. This study describes the experience of training undergraduate students as middle school AI summer camp facilitators. These undergraduates participated in a professional development session prior to camp for 9 days (54 hours), and then facilitated AI learning and camp activities within the two-week camp. Our findings indicate that the undergraduate facilitators benefited greatly from this experience, in turn providing benefits to the middle school learners. The undergraduates developed both professional and conceptual skills. By interacting with the facilitators as “near-peers”, the students learned about AI in a fun, engaging, and supportive way. These findings contribute to our understanding of how to effectively teach young learners about complex AI concepts.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/VL-HCC57772.2023.00050
