The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach. This often leads to a lack of deep understanding of the underlying CS concepts and how different curricula address the same concepts in different ways. Empowering teachers to develop a deep understanding of CS standards, and use formative assessments to recognize common student challenges associated with the standards, will enable teachers to provide more effective CS instruction, irrespective of the curriculum and/or programming language they are tasked with using. This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards. We share concrete examples of how to design standards-aligned educative resources and instructionally supportive tools that promote teachers' understanding of CS standards and common student challenges and develop teachers' formative assessment literacy, all essential components of CS pedagogical content knowledge.
more »
« less
Toward A Framework for Formative Assessment of Conceptual Learning in K-12 Computer Science Classrooms
Unlike summative assessment that is aimed at grading students at the end of a unit or academic term, formative assessment is assess- ment for learning, aimed at monitoring ongoing student learning to provide feedback to both student and teacher, so that learning gaps can be addressed during the learning process. Education research points to formative assessment as a crucial vehicle for improving student learning. Formative assessment in K-12 CS and program- ming classrooms remains a crucial unaddressed need. Given that assessment for learning is closely tied to teacher pedagogical con- tent knowledge, formative assessment literacy needs to also be a topic of CS teacher PD. This position paper addresses the broad need to understand formative assessment and build a framework to understand the what, why, and how of formative assessment of introductory programming in K-12 CS. It shares specific pro- gramming examples to articulate the cycle of formative assessment, diagnostic evaluation, feedback, and action. The design of formative assessment items is informed by CS research on assessment design, albeit related largely to summative assessment and in CS1 contexts, and learning of programming, especially student misconceptions. It describes what teacher formative assessment literacy PD should entail and how to catalyze assessment-focused collaboration among K-12 CS teachers through assessment platforms and repositories.
more »
« less
- Award ID(s):
- 1943530
- PAR ID:
- 10294638
- Date Published:
- Journal Name:
- 52nd ACM Technical Symposium on Computer Science Education (SIGCSE ’21)
- Page Range / eLocation ID:
- 31 to 37
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Research shows formative assessments substantially strengthen learning and support summative assessment/evaluation practices. These practices are not widely applied in ATE's professional development (PD) efforts. This study focuses on participant teachers' assessment involvement to increase student learning and enhance outcome evaluations. We surveyed all principal investigators of ATE projects in 2022 who applied assessments in their 2021 PD efforts (N=70). Findings show that a minority of PD efforts apply formative assessment practices to strengthen PD outcomes or meet ATE's evaluation specifications. Assessment practices were most prevalent for summative purposes at the close of PD activity; a large majority assessed teachers' interest and learning in the PD and their intentions to use and teach what was learned on return to their classrooms. A third or less followed up to assess outcomes in teachers' schools. Similarly, thirty percent or less addressed matters of context at any stage of the PD efforts, and a few, 11 percent, followed up to assess the context in the schools. Concomitantly, the findings show where and how attention to formative assessment in the PD learning process can increase teacher involvement in assessment practices, making PD instruction more effective and strengthening outcome evaluations in participant teachers' home classrooms.more » « less
-
‘Algorithms’ is a core CS concept included in the K-12 CS standards, yet student challenges with understanding different aspects of algorithms are still not well documented, especially for younger students. This paper describes an approach to decompose the broad middle-school ‘algorithms’ standard into finer grained learning targets, develop formative assessment tasks aligned with the learning targets, and use the tasks to explore student understanding of, and challenges with, the various aspects of the standard. We present a number of student challenges revealed by our analysis of student responses to a set of standards-aligned formative assessment tasks and discuss how teachers and researchers interpreted student responses differently, even when using the same rubrics. Our study underscores the importance of carefully designed standards-aligned formative assessment tasks for monitoring student progress and demonstrates the need for teacher content knowledge to effectively use formative assessments during CS instruction.more » « less
-
In recent years, Wyoming has developed Computer Science (CS) standards for adoption and use within K-12 classrooms. These standards, adopted in January of 2022, go into effect for the 2022-2023 school year. The University of Wyoming has offered two different computer science week-long professional developments for teachers. Many K-12 teachers do not have a CS background, so developing CS lessons plans can be a challenge in these PDs.This research study is centered around three central questions: 1) To what extent did K-12 teachers integrate computing topics into their PD created lesson plans; 2) How do the teacher perceptions from the two CS PDs compare to each other; and 3) How was the CS PD translated to classroom activity? The first PD opportunity (n=14), was designed to give hands-on learning with CS topics focused on cybersecurity. The second PD opportunity (n=28), focused on integrating CS into existing curricula. At the end of each of these PDs, teacher K-12 teachers incorporated CS topics into their selected existing lesson plan(s). Additionally, a support network was implemented to support excellence in CS education throughout the state. This research study team evaluated the lesson plans developed during each PD event, by using a rubric on each lesson plan. Researchers collected exit surveys from the teachers. Implementation metrics were also gathered, including, how long each lesson lasted, how many students were involved in the implementation, what grades the student belonged to, the basic demographics of the students, the type of course the lesson plan was housed in, if the K-12 teacher reached their intended purpose, what evidence the K-12 teacher had of the success of their lesson plan, data summaries based on supplied evidence, how the K-12 teachers would change the lesson, the challenges and successes they experienced, and samples of student work. Quantitative analysis was basic descriptive statistics. Findings, based on evaluation of 40+ lessons, taught to over 1500 K-12 students, indicate that when assessed on a three point rubric of struggling, emerging, or excellent - certain components (e.g., organization, objectives, integration, activities & assessment, questions, and catch) of K-12 teacher created lessons plans varied drastically. In particular, lesson plan organization, integration, and questions each had a significant number of submissions which were evaluated as "struggling" [45%, 46%, 41%] through interesting integration, objectives, activities & assessment, and catch all saw submissions which were evaluated as "excellent" [43%, 48%, 43%, 48%]. The relationship between existing K-12 policies and expectations surfaces within these results and in combination with other findings leads to implications for the translation of current research practices into pre-collegiate PDs.more » « less
-
Design considerations for a middle school computer science pedagogical content knowledge instrument.K-12 Computer Science (CS) education is developing rapidly but still lacks a comprehensive measure for CS teachers’ pedagogical content knowledge (PCK). We respond to this need by describing the design of a CS-PCK instrument for ‘Algorithms and Programming’ that measures three broad constructs: (a) teachers’ understanding of standards and standards alignment, (b) teachers’ formative assessment practices, and (c) teachers’ self-efficacy for teaching and assessing CS.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3408877.3432460
