skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Standard Decomposition Process to Inform the Development of Game-Based Learning Environments Focused on Computational Thinking
This study describes a standard decomposition process, which is designed to decompose content standards into observable components that might illustrate computational thinking skills. These components will be integrated into an online game-based learning environment as evidence of learning (EoL) and mastery (EoM). Focusing on three computer science standards, we describe how the standard decomposition process was used to generate standard decomposition tables. We show samples of the content of these decomposition tables and describe how these tables evolved based on educator feedback.  more » « less
Award ID(s):
1933848
PAR ID:
10353043
Author(s) / Creator(s):
Date Published:
Journal Name:
Fifth APSCE International Conference on Computational Thinking and STEM Education 2021
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The Computer Science Teachers Association (CSTA) K-12 Standards were last updated in 2017, when only six states in the United States had adopted learning standards for primary and secondary education (K-12) computer science. Fast forward to 2024, and 41 states now have K-12 CS standards (and one has high school CS standards only). In preparation for writing an updated set of standards, CSTA is engaging in three stages of work: reimagining CS for high school students, conducting a crosswalk of K-12 CS standards across all 50 states compared to the CSTA standards (2017), and engaging in the technical process of defining final standards content via research and revision. All three stages draw significantly from the community of practitioners, researchers, curriculum designers, postsecondary faculty, and other interested parties. They also draw significantly from research published since the last revision to take into account the current evidence on learning computer science. In this poster, we describe our process for building the groundwork of knowledge for revising the standards, share highlights of the results to date, and describe how this data will be used to inform the upcoming revision of the CSTA standards. 
    more » « less
  2. This paper introduces a new type of smart learning content, an automatically generated trace table, that can easily integrate and adapt to existing curriculum and learning systems for computer science education. In addition to current features of the software, we describe how this tool constructs trace tables using only source code as an input. The potential of this tool is also explored by examining future opportunities in adaptation, feedback, and learning specifications. Last, we report a pilot integration into an existing system to demonstrate interoperability with a tangible use case. 
    more » « less
  3. This paper introduces a new type of smart learning content, an automatically generated trace table, that can easily integrate and adapt to existing curriculum and learning systems for computer science education. In addition to current features of the software, we describe how this tool constructs trace tables using only source code as an input. The potential of this tool is also explored by examining future opportunities in adaptation, feedback, and learning specifications. Last, we report a pilot integration into an existing system to demonstrate interoperability with a tangible use case. 
    more » « less
  4. Introduction: Because developing integrated computer science (CS) curriculum is a resource-intensive process, there is interest in leveraging the capabilities of AI tools, including large language models (LLMs), to streamline this task. However, given the novelty of LLMs, little is known about their ability to generate appropriate curriculum content. Research Question: How do current LLMs perform on the task of creating appropriate learning activities for integrated computer science education? Methods: We tested two LLMs (Claude 3.5 Sonnet and ChatGPT 4-o) by providing them with a subset of national learning standards for both CS and language arts and asking them to generate a high-level description of learning activities that met standards for both disciplines. Four humans rated the LLM output – using an aggregate rating approach – in terms of (1) whether it met the CS learning standard, (2) whether it met the language arts learning standard, (3) whether it was equitable, and (4) its overall quality. Results: For Claude AI, 52% of the activities met language arts standards, 64% met CS standards, and the average quality rating was middling. For ChatGPT, 75% of the activities met language arts standards, 63% met CS standards, and the average quality rating was low. Virtually all activities from both LLMs were rated as neither actively promoting nor inhibiting equitable instruction. Discussion: Our results suggest that LLMs are not (yet) able to create appropriate learning activities from learning standards. The activities were generally not usable by classroom teachers without further elaboration and/or modification. There were also grammatical errors in the output, something not common with LLM-produced text. Further, standards in one or both disciplines were often not addressed, and the quality of the activities was often low. We conclude with recommendations for the use of LLMs in curriculum development in light of these findings. 
    more » « less
  5. ‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard. We present a number of student challenges revealed by our analysis of student responses to a set of standards-aligned formative assessment tasks and discuss how teachers and researchers interpreted student responses differently, even when using the same rubrics. Our study underscores the importance of carefully designed standards-aligned formative assessment tasks for monitoring student progress and demonstrates the need for teacher content knowledge to effectively use formative assessments during CS instruction. 
    more » « less