skip to main content


Title: Design of an Evaluative Rubric for CT Integrated Curriculum in the Elementary Grades Authors
Despite the recent proliferation of research concerning integrating computational thinking (CT) into K-5th grade curriculum, there is little literature concerning how to evaluate the quality of CT integrated curricula, especially curricula integrating CT into language arts and social studies content areas. In this paper, we present a theoretically derived rubric for the evaluation of CT integrated curricula for grades K-5 across the curriculum (math, science, language arts, social studies). Our rubric is divided into two sections. The first section provides guidelines for identifying the integration type (disciplinary, multidisciplinary, interdisciplinary, or transdisciplinary). The second section presents six categories of evaluation that further subsume nine sub-categories. The principal categories of evaluation include the following: conceptual coherence, role of computational technology, assessment, use of multiple representations, play, and equity. We include the play category as an aspect of developmental appropriateness. Play is an important pedagogical approach for learning in the early grades. Our work takes place in the context of the Computer Science (CS) for All initiative in the United States which emphasizes the goal of improving racial and gender diversity in CS participation. Therefore, creating integrated lessons that address equity is important. Our paper describes rubric development from the theoretical perspectives that underlie the inclusion of each type, category, and sub-category. Our evaluative rubric can guide future efforts to integrate CT/CS into the elementary curricula. Researchers can utilize our rubric to evaluate and analyze CT-integrated curricula, and educators can benefit from using this rubric as a guideline for curriculum development.  more » « less
Award ID(s):
1837086
NSF-PAR ID:
10355727
Author(s) / Creator(s):
Date Published:
Journal Name:
CTE-STEM 2022 Conference.
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In recent years, Wyoming has developed Computer Science (CS) standards for adoption and use within K-12 classrooms. These standards, adopted in January of 2022, go into effect for the 2022-2023 school year. The University of Wyoming has offered two different computer science week-long professional developments for teachers. Many K-12 teachers do not have a CS background, so developing CS lessons plans can be a challenge in these PDs.This research study is centered around three central questions: 1) To what extent did K-12 teachers integrate computing topics into their PD created lesson plans; 2) How do the teacher perceptions from the two CS PDs compare to each other; and 3) How was the CS PD translated to classroom activity? The first PD opportunity (n=14), was designed to give hands-on learning with CS topics focused on cybersecurity. The second PD opportunity (n=28), focused on integrating CS into existing curricula. At the end of each of these PDs, teacher K-12 teachers incorporated CS topics into their selected existing lesson plan(s). Additionally, a support network was implemented to support excellence in CS education throughout the state. This research study team evaluated the lesson plans developed during each PD event, by using a rubric on each lesson plan. Researchers collected exit surveys from the teachers. Implementation metrics were also gathered, including, how long each lesson lasted, how many students were involved in the implementation, what grades the student belonged to, the basic demographics of the students, the type of course the lesson plan was housed in, if the K-12 teacher reached their intended purpose, what evidence the K-12 teacher had of the success of their lesson plan, data summaries based on supplied evidence, how the K-12 teachers would change the lesson, the challenges and successes they experienced, and samples of student work. Quantitative analysis was basic descriptive statistics. Findings, based on evaluation of 40+ lessons, taught to over 1500 K-12 students, indicate that when assessed on a three point rubric of struggling, emerging, or excellent - certain components (e.g., organization, objectives, integration, activities & assessment, questions, and catch) of K-12 teacher created lessons plans varied drastically. In particular, lesson plan organization, integration, and questions each had a significant number of submissions which were evaluated as "struggling" [45%, 46%, 41%] through interesting integration, objectives, activities & assessment, and catch all saw submissions which were evaluated as "excellent" [43%, 48%, 43%, 48%]. The relationship between existing K-12 policies and expectations surfaces within these results and in combination with other findings leads to implications for the translation of current research practices into pre-collegiate PDs. 
    more » « less
  2. Wyoming recently mandated that computer science instruction be provided in K-12 schools by 2022, and there is an urgent need for designing instruction that can integrate computer science into the teaching of other subjects. This project assembles a network improvement community comprised of partners from the University of Wyoming, community colleges, Wyoming school districts, the Wyoming Library System, the Wyoming Department of Education, and local software development firms. The community meets once monthly over the duration of the project to collaborate stakeholder agendas for meeting the project goals. The community enlists K-8 teachers from across the state to experience professional development and collaborate on integrating computer science into their instruction of STEM and social science topics. The project is producing units for teachers, who are implementing these units with support from master teachers and educational scholars. The community serves as a forum for teachers to debrief and learn from each other about ways to improve their instruction and design of the curricular units. Libraries in the state system act as partners for dissemination to rural areas of the innovative instructional approaches. WySLICE prepares 150 K-8 teachers and state librarians from all disciplines to integrate computer science into their teaching. The project is reaching almost half of all K-8 students in Wyoming. The research questions address how teachers use modeling practices as supports for student understanding of algorithms and coding in a variety of ways. The curricula involve cybersecurity as well as other topics relevant to measurement in mathematics and social studies topics that involve social concerns like voting. Data sources include teacher lesson plans and recordings of their instructional implementation, scoring of each of these according to a rubric, meeting notes of monthly meetings, and results from pre-post student assessments. The evaluation focuses on the meeting of project goals and the quality of the management of the network improvement community. This project is jointly funded by CS for All and the Established Program to Stimulate Competitive Research (EPSCoR). This work is supported by the National Science Foundation under DRL Grant #1923542 "CS For All:RPP - Booting Up Computer Science in Wyoming." 
    more » « less
  3. In this poster, we will present approaches and associated design principles for integrating computational thinking (CT) into middle school Social Studies, Arts, and Language Arts instruction to en- hance disciplinary learning. We used four steps to identify these ap- proaches and design principles: (1) co-design with teachers and ex- perts in computer science and CT education to ideate CT-integrated lessons; (2) research team meetings to identify initial design prin- ciples based on the ideated lessons; (3) consultation with subject matter experts; and (4) conducting a Delphi study with pedagogical experts (e.g., teachers, curriculum writers, teacher educators) to examine the clarity, feasibility and potential impact of the design principles. The process led to three broad approaches to integrate CT into Social Studies instruction that included 14 design principles, three for Arts with 16 design principles, and four for Language Arts with 13 design principles. 
    more » « less
  4. With the increased demand for introducing computational thinking (CT) in K-12 classrooms, educational researchers are developing integrated lesson plans that can teach CT fundamentals in non- computing specific classrooms. Although these lessons reach more students through the core curriculum, proper evaluation methods are needed to ensure the quality of the design and integration. As part of a research practice partnership, we work to infuse research- backed curricula into science courses. We find a three-pronged approach of evaluation can help us make better decisions on how to improve experimental curricula for active classrooms. This CEO model uses three data sources (student code traces, exit ticket responses, and field observations) as a triangulated approach that can be used to identify programming behavior among novice developers, preferred task ordering for the assignment, and scaffolding recommendations to teachers. This approach allows us to evaluate the practical implementations of our initiative and create a focused approach for designing more effective lessons. 
    more » « less
  5. In this article, we share examples from our project, Participating in Literacies and Computer Science (PiLaCS), which focuses on how students' language practices shape their participation and engagement in language arts projects that integrate code. Integrating Code into Language Arts: Ashley's Multimodal Translanguaging Approach Tasked with fulfilling her school's commitment to CS for All within her sixth grade bilingual language arts class, Ashley chose to teach a unit with a software and programming language called Scratch, created at the Massachusetts Institute of Technology, to support creative approaches to code (https://scratch.mit.edu/). What follows are examples from Ashley's class that demonstrate how a CS-integrated language arts curriculum provided her students with space to engage, create, and communicate using language, text, and their bodies in dynamic expressions. Álvaro's dynamic expression of sliding across the room animated his understanding of the connection between the text and the code, showing how integrating code into language arts provides a forum for students' language practices to be integrated and validated. 
    more » « less