skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Exploring Middle School Students’ Understanding of Algorithms Using Standards-Aligned Formative Assessments: Teacher and Researcher Perspectives
Title: Exploring Middle School Students’ Understanding of Algorithms Using Standards-Aligned Formative Assessments: Teacher and Researcher Perspectives
‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard. We present a number of student challenges revealed by our analysis of student responses to a set of standards-aligned formative assessment tasks and discuss how teachers and researchers interpreted student responses differently, even when using the same rubrics. Our study underscores the importance of carefully designed standards-aligned formative assessment tasks for monitoring student progress and demonstrates the need for teacher content knowledge to effectively use formative assessments during CS instruction.  more » « less
Award ID(s):
2010591
PAR ID:
10502123
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
International Society of the Learning Sciences
Date Published:
Page Range / eLocation ID:
114 to 121
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1)
    The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach. This often leads to a lack of deep understanding of the underlying CS concepts and how different curricula address the same concepts in different ways. Empowering teachers to develop a deep understanding of CS standards, and use formative assessments to recognize common student challenges associated with the standards, will enable teachers to provide more effective CS instruction, irrespective of the curriculum and/or programming language they are tasked with using. This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards. We share concrete examples of how to design standards-aligned educative resources and instructionally supportive tools that promote teachers' understanding of CS standards and common student challenges and develop teachers' formative assessment literacy, all essential components of CS pedagogical content knowledge. 
    more » « less
  2. ; ; ; ; (, Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA)
    The Computer Science Teachers Association (CSTA) K-12 Computer Science Standards identify ‘Algorithms and Programming’ as a key CS concept across all grade bands that encompasses sub-concepts such as algorithms, decomposition, variables, and control structures. Previous studies have shown that algorithms and programming concepts often pose challenges for novice programmers, and that instruction in these areas is often superficial. We developed formative assessment tasks to investigate middle school students’ understanding of four CS standards related to algorithms and programming and collected responses from over 100 students associated with five different teachers. We found that students demonstrated a limited understanding of the standards. These findings contribute to the growing literature on middle school students’ understanding of algorithms and programming, and provide insights that can inform CS teacher development, instruction, and curriculum design. 
    more » « less
  3. ; ; ; ; ; ; (, International Society of the Learning Sciences)
    This poster presents findings on middle school students’ understanding of core Computer Science (CS) concepts, such as variables and control structures, using cognitive think-aloud interviews with eight students. Each student worked on 16-22 formative assessment tasks designed to assess understanding on the ‘Algorithms and Programming’ middle school CS standards. Our study describes students’ interpretations of the CS concepts and discusses potential factors influencing student interpretations. Significance and next steps are described. 
    more » « less
  4. ; ; ; ; (, ACM)
    The "Computer Science for All" initiative advocates for universal access to computer science (CS) instruction. A key strategy toward this end has been to establish CS content standards outlining what all students should have the opportunity to learn. Standards can support curriculum quality and access to quality CS instruction, but only if they are used to inform curriculum design and instructional practice. Professional learning offered to teachers of CS has typically focused on learning to implement a specific curriculum, rather than deepening understanding of CS concepts. We set out to develop a set of educative resources, formative assessment tools and teacher professional development (PD) sessions to support middle school CS teachers' knowledge of CS standards and standards-aligned formative assessment literacy. Our PD and associated resources focus on five CS standards in the Algorithm and Programming strand and are meant to support teachers using any CS curriculum or programming language. In this experience report, we share what we learned from implementing our standards-based PD with four middle school CS teachers. Teachers initially perceived standards as irrelevant to their teaching but they came to appreciate how a deeper understanding of CS concepts could enhance their instructional practice. Analysis of PD observations and exit surveys, teacher interviews, and teacher responses to a survey assessing CS pedagogical content knowledge demonstrated the complexity of using content standards as a driver of high-quality CS instruction at the middle school level, and reinforced our position that more standards-focused PD is needed. 
    more » « less
  5. ; ; ; ; ; (, Disciplinary and Interdisciplinary Science Education Research)
    The complex and interdisciplinary nature of scientific concepts presents formidable challenges for students in developing their knowledge-in-use skills. The utilization of computerized analysis for evaluating students’ contextualized constructed responses offers a potential avenue for educators to develop personalized and scalable interventions, thus supporting the current teaching and learning of science. While prior research in artificial intelligence has demonstrated the effectiveness of algorithms, including Bidirectional Encoder Representations from Transformers (BERT), in tasks like automated classifications of constructed responses, these efforts have predominantly leaned towards text-level features, often overlooking the exploration of conceptual ideas embedded in students’ responses from a cognitive perspective. Despite BERT’s performance in downstream tasks, challenges may arise in domain-specific tasks, particularly in establishing knowledge connections between specialized and open domains. These challenges become pronounced in small-scale and imbalanced educational datasets, where the available information for fine-tuning is frequently inadequate to capture task-specific nuances and contextual details. The primary objective of the present study is to investigate the effectiveness of a pretrained language model, when integrated with an ontological framework aligned with a contextualized science assessment, in classifying students’ expertise levels in scientific explanation. Our findings indicate that while pretrained language models, such as BERT, contribute to enhanced performance in language-related tasks within educational contexts, the incorporation of identifying domain-specific terms and extracting and substituting with their associated sibling terms in sentences through ontology-based systems can significantly improve classification model performance. Further, we qualitatively examined student responses and found that, as expected, the ontology framework identified and substituted key domain-specific terms in student responses that led to more accurate predictive scores. The study explores the practical implementation of ontology in assessment evaluation to facilitate formative assessment and formulate instructional strategies. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email