skip to main content


Title: Toward A Framework for Formative Assessment of Conceptual Learning in K-12 Computer Science Classrooms
Unlike summative assessment that is aimed at grading students at the end of a unit or academic term, formative assessment is assess- ment for learning, aimed at monitoring ongoing student learning to provide feedback to both student and teacher, so that learning gaps can be addressed during the learning process. Education research points to formative assessment as a crucial vehicle for improving student learning. Formative assessment in K-12 CS and program- ming classrooms remains a crucial unaddressed need. Given that assessment for learning is closely tied to teacher pedagogical con- tent knowledge, formative assessment literacy needs to also be a topic of CS teacher PD. This position paper addresses the broad need to understand formative assessment and build a framework to understand the what, why, and how of formative assessment of introductory programming in K-12 CS. It shares specific pro- gramming examples to articulate the cycle of formative assessment, diagnostic evaluation, feedback, and action. The design of formative assessment items is informed by CS research on assessment design, albeit related largely to summative assessment and in CS1 contexts, and learning of programming, especially student misconceptions. It describes what teacher formative assessment literacy PD should entail and how to catalyze assessment-focused collaboration among K-12 CS teachers through assessment platforms and repositories.  more » « less
Award ID(s):
1943530
NSF-PAR ID:
10294638
Author(s) / Creator(s):
Date Published:
Journal Name:
52nd ACM Technical Symposium on Computer Science Education (SIGCSE ’21)
Page Range / eLocation ID:
31 to 37
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach. This often leads to a lack of deep understanding of the underlying CS concepts and how different curricula address the same concepts in different ways. Empowering teachers to develop a deep understanding of CS standards, and use formative assessments to recognize common student challenges associated with the standards, will enable teachers to provide more effective CS instruction, irrespective of the curriculum and/or programming language they are tasked with using. This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards. We share concrete examples of how to design standards-aligned educative resources and instructionally supportive tools that promote teachers' understanding of CS standards and common student challenges and develop teachers' formative assessment literacy, all essential components of CS pedagogical content knowledge. 
    more » « less
  2. null (Ed.)
    To meet the rising demand for computer science (CS) courses, K-12 educators need to be prepared to teach introductory concepts and skills in courses such as Computer Science Principles (CSP), which takes a breadth-first approach to CS and includes topics beyond programming such as data, impacts of computing, and networks. Educators are now also being asked to teach more advanced concepts in courses such as the College Board's Advanced Placement Computer Science A (CSA) course, which focuses on advanced programming using Java and includes topics such as objects, inheritance, arrays, and recursion. Traditional CSA curricula have not used content or pedagogy designed to engage a broad range of learners and support their success. Unlike CSP, which is attracting more underrepresented students to computing as it was designed, CSA continues to enroll mostly male, white, and Asian students [College Board 2019, Ericson 2020, Sax 2020]. In order to expand CS education opportunities, it is crucial that students have an engaging experience in CSA similar to CSP. Well-designed differentiated professional development (PD) that focuses on content and pedagogy is necessary to meet individual teacher needs, to successfully build teacher skills and confidence to teach CSA, and to improve engagement with students [Darling-Hammond 2017]. It is critical that as more CS opportunities and courses are developed, teachers remain engaged with their own learning in order to build their content knowledge and refine their teaching practice [CSTA 2020]. CSAwesome, developed and piloted in 2019, offers a College Board endorsed AP CSA curriculum and PD focused on supporting the transition of teachers and students from CSP to CSA. This poster presents preliminary findings aimed at exploring the supports and challenges new-to-CSA high school level educators face when transitioning from teaching an introductory, breadth-first course such as CSP to teaching the more challenging, programming-focused CSA course. Five teachers who completed the online CSAwesome summer 2020 PD completed interviews in spring 2021. The project employed an inductive coding scheme to analyze interview transcriptions and qualitative notes from teachers about their experiences learning, teaching, and implementing CSP and CSA curricula. Initial findings suggest that teachers’ experience in the CSAwesome PD may improve their confidence in teaching CSA, ability to effectively use inclusive teaching practices, ability to empathize with their students, problem-solving skills, and motivation to persist when faced with challenges and difficulties. Teachers noted how the CSAwesome PD provided them with a student perspective and increased feelings of empathy. Participants spoke about the implications of the COVID-19 pandemic on their own learning, student learning, and teaching style. Teachers enter the PD with many different backgrounds, CS experience levels, and strengths, however, new-to-CSA teachers require further PD on content and pedagogy to transition between CSP and CSA. Initial results suggest that the CSAwesome PD may have an impact on long-term teacher development as new-to-CSA teachers who participated indicated a positive impact on their teaching practices, ideologies, and pedagogies. 
    more » « less
  3. In recent years, Wyoming has developed Computer Science (CS) standards for adoption and use within K-12 classrooms. These standards, adopted in January of 2022, go into effect for the 2022-2023 school year. The University of Wyoming has offered two different computer science week-long professional developments for teachers. Many K-12 teachers do not have a CS background, so developing CS lessons plans can be a challenge in these PDs.This research study is centered around three central questions: 1) To what extent did K-12 teachers integrate computing topics into their PD created lesson plans; 2) How do the teacher perceptions from the two CS PDs compare to each other; and 3) How was the CS PD translated to classroom activity? The first PD opportunity (n=14), was designed to give hands-on learning with CS topics focused on cybersecurity. The second PD opportunity (n=28), focused on integrating CS into existing curricula. At the end of each of these PDs, teacher K-12 teachers incorporated CS topics into their selected existing lesson plan(s). Additionally, a support network was implemented to support excellence in CS education throughout the state. This research study team evaluated the lesson plans developed during each PD event, by using a rubric on each lesson plan. Researchers collected exit surveys from the teachers. Implementation metrics were also gathered, including, how long each lesson lasted, how many students were involved in the implementation, what grades the student belonged to, the basic demographics of the students, the type of course the lesson plan was housed in, if the K-12 teacher reached their intended purpose, what evidence the K-12 teacher had of the success of their lesson plan, data summaries based on supplied evidence, how the K-12 teachers would change the lesson, the challenges and successes they experienced, and samples of student work. Quantitative analysis was basic descriptive statistics. Findings, based on evaluation of 40+ lessons, taught to over 1500 K-12 students, indicate that when assessed on a three point rubric of struggling, emerging, or excellent - certain components (e.g., organization, objectives, integration, activities & assessment, questions, and catch) of K-12 teacher created lessons plans varied drastically. In particular, lesson plan organization, integration, and questions each had a significant number of submissions which were evaluated as "struggling" [45%, 46%, 41%] through interesting integration, objectives, activities & assessment, and catch all saw submissions which were evaluated as "excellent" [43%, 48%, 43%, 48%]. The relationship between existing K-12 policies and expectations surfaces within these results and in combination with other findings leads to implications for the translation of current research practices into pre-collegiate PDs. 
    more » « less
  4. Research shows formative assessments substantially strengthen learning and support summative assessment/evaluation practices. These practices are not widely applied in ATE's professional development (PD) efforts. This study focuses on participant teachers' assessment involvement to increase student learning and enhance outcome evaluations. We surveyed all principal investigators of ATE projects in 2022 who applied assessments in their 2021 PD efforts (N=70). Findings show that a minority of PD efforts apply formative assessment practices to strengthen PD outcomes or meet ATE's evaluation specifications. Assessment practices were most prevalent for summative purposes at the close of PD activity; a large majority assessed teachers' interest and learning in the PD and their intentions to use and teach what was learned on return to their classrooms. A third or less followed up to assess outcomes in teachers' schools. Similarly, thirty percent or less addressed matters of context at any stage of the PD efforts, and a few, 11 percent, followed up to assess the context in the schools. Concomitantly, the findings show where and how attention to formative assessment in the PD learning process can increase teacher involvement in assessment practices, making PD instruction more effective and strengthening outcome evaluations in participant teachers' home classrooms. 
    more » « less
  5. null (Ed.)
    The Covid-19 pandemic has offered new challenges and opportunities for teaching and research. It has forced constraints on in-person gathering of researchers, teachers, and students, and conversely, has also opened doors to creative instructional design. This paper describes a novel approach to designing an online, synchronous teacher professional development (PD) and curriculum co-design experience. It shares our work in bringing together high school teachers and researchers in four US states. The teachers participated in a 3-week summer PD on ideas of Distributed Computing and how to teach this advanced topic to high school students using NetsBlox, an extension of the Snap! block-based programming environment. The goal of the PD was to prepare teachers to engage in collaborative co-design of a 9-week curricular module for use in classrooms and schools. Between their own training and the co-design process, teachers co-taught a group of high school students enrolled in a remote summer internship at a university in North Carolina to pilot the learned units and leverage ideas from their teaching experience for subsequent curricular co-design. Formative and summative feedback from teachers suggest that this PD model was successful in meeting desired outcomes. Our generalizable FIRST principles—Flexibility, Innovativeness, Responsiveness (and Respect), Supports, and Teamwork (collaboration)—that helped make this unique PD successful, can help guide future CS teacher PD designs. 
    more » « less