skip to main content


Title: Evaluating Computer Science Professional Development for Teachers in the United States
Teacher professional development (PD) is a key factor in enabling teachers to develop mindsets and skills that positively impact students. It is also a key step in building capacity for computer science (CS) education in K-12 schools. Successful CS PD meets primary learning goals and enable teachers to grow their self-efficacy, asset and equity mindset, and interest in teaching CS. As part of a larger study, we conducted a secondary analysis of CS PD evaluation instruments (). We found that instruments across providers were highly dissimilar with limited data collected for measures related to teacher learning, which has implications for future K-12 CS education. Likewise, the instruments were limited in being connected to student learning and academic growth. As a way to enable PD providers to construct measures that align with known impacting factors, we offer recommendations for collecting demographic data and measuring program satisfaction, content knowledge, pedagogical content knowledge, growth and equity mindset, and self-efficacy. We also highlight questions for PD providers to consider when constructing their evaluation, including reflecting community values, the goals of the PD, and how the data collected will be used to continually improve CS programs.  more » « less
Award ID(s):
2039175
NSF-PAR ID:
10308711
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  
Date Published:
Journal Name:
Koli Calling International Conference on Computing Education Research
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background: Researcher-practitioner partnerships (RPPs) have gained increasing prominence within education, since they are crucial for identifying partners’ problems of practice and seeking solutions for improving district (or school) problems. The CS Pathways RPP project brought together researchers and practitioners, including middle school teachers and administrators from three urban school districts, to build teachers’ capacity to implement an inclusive computer science and digital literacy (CSDL) curriculum for all students in their middle schools. Objective: This study explored the teachers’ self-efficacy development in teaching a middle school CSDL curriculum under the project’s RPP framework. The ultimate goal was to gain insights into how the project’s RPP framework and its professional development (PD) program supported teachers’ self-efficacy development, in particular its challenges and success of the partnership. Method: Teacher participants attended the first-year PD program and were surveyed and/or interviewed about their self-efficacy in teaching CSDL curriculum, spanning topics ranging from digital literacy skills to app creation ability and curriculum implementation. Both survey and interview data were collected and analyzed using mixed methods 1) to examine the reach of the RPP PD program in terms of teachers’ self-efficacy; 2) to produce insightful understandings of the PD program impact on the project’s goal of building teachers’ self-efficacy. Results and Discussion: We reported the teachers’ self-efficacy profiles based on the survey data. A post-survey indicated that a majority of the teachers have high self-efficacy in teaching the CSDL curriculum addressed by the RPP PD program. Our analysis identified five critical benefits the project’s RPP PD program provided, namely collaborative efforts on resource and infrastructure building, content and pedagogical knowledge growth, collaboration and communication, and building teacher identity. All five features have shown direct impacts on teachers' self-efficacy. The study also reported teachers’ perceptions on the challenges they faced and potential areas for improvements. These findings indicate some important features of an effective PD program, informing the primary design of an RPP CS PD program. 
    more » « less
  2. null (Ed.)
    Research Experience for Teachers (RET) programs are National Science Foundation (NSF) funded programs designed to provide K- 12 Science, Technology, Engineering, and Mathematics (STEM) teachers with immersive, hands-on research experiences at Universities around the country. The NSF RET in nanotechnology encourages teachers to translate cutting-edge research into culturally relevant Project-Based Learning (PjBL) and engineering curriculum. Traditionally, the evaluation of RET programs focuses on the growth and development of teacher self-efficacy, engineering content knowledge gains, or classroom implementation of developed curriculum materials. However, reported methods for evaluating the impact of RETs on their female, minority student populations' high school graduation and undergraduate STEM major rates are limited. This study's objective was to compare RET high school student graduation rates and undergraduate STEM major rates across gender, race, and ethnicity to a comparison sample to determine the RET program's long-term impact on students' likelihood of pursuing STEM careers. The approach of collecting and analyzing the Texas Education Research Center Database (EdRC) data is a novel methodology for assessing RET programs' effectiveness on students. The EdRC is a repository of K-12 student data from the Texas Education Agency (TEA) and Higher Education data from the Texas Higher Education Coordinating Board (THECB). This joint database contains demographic, course registration, graduation, standardized testing, and college major, among others, for all students that attended a K-12 public school in Texas and any college in Texas, public or private. The RET program participants at Rice University (2010 – 2018) taught numerous students, a sample size of 11,240 students. A propensity score matching generated the student comparison group within the database. Students' school campus, gender, race/ethnic status, and English proficiency status were applied to produce a graduation comparison sample size of 11,240 students of Non-RET participants. Linking the TEA database to the THECB database resulted in college STEM participants and comparison sample sizes of 4,029 students. The project team conducted a logistic regression using RET status to predict high school graduation rates as a whole and by individual variables: gender, Asian American, Black, Caucasian, and Latinx students. All models were significant at p less than 0.05, with models in favor of students RET teachers. The project team conducted a logistic regression using RET status to predict student STEM undergraduate major rates as a whole and by individual variables: Gender, Asian American, Black, Caucasian, and Latinx students. African American and Caucasian models were significant at p less than 0.05; Gender, Asian American, and Latinx models were marginally significant (0.05 less than p greater than 0.1), where RET students had higher STEM major rates than matched controls. The findings demonstrate that RET programs have a long-term positive impact on the students' high school graduation rates and undergraduate STEM major rates. As teachers who participate in the RET programs are more likely to conduct courses using PjBL strategies and incorporate real-world engineering practices, female and minority students are more likely to benefit from these practices and seek careers utilizing these skills. 
    more » « less
  3. Effective and equitable CS teaching in classrooms is contingent on teachers' high-levels of self-efficacy in CS as well as a robust understanding of equity issues in CS classrooms. To this end, our study examined the influence of a professional development (PD) course, Teaching Exploring Computer Science (TECS), on promoting teacher self-efficacy and equity awareness in CS education. This nine-week PD was offered in a hybrid format, delivering on-line and face-to-face classes to high school teachers across various disciplines who served under-represented students. The participants completed a selfefficacy survey focusing on their ability to teach ECS, both before and after the course. Results showed that teachers' selfefficacy in the content knowledge and pedagogical knowledge of ECS significantly increased as a result of taking the course. We also evaluated teacher's understanding of the equity issues by conducting a content analysis of their reflection essays written at the end of the course. Four major themes emerged from the content analysis, highlighting the impact of equitable practices on CS participation. This research demonstrates the role of a professional development course in promoting teachers' self-efficacy beliefs in teaching CS and their understanding of the equity issues and presents tools for assessing teachers' development in these areas. 
    more » « less
  4. In recent years, Wyoming has developed Computer Science (CS) standards for adoption and use within K-12 classrooms. These standards, adopted in January of 2022, go into effect for the 2022-2023 school year. The University of Wyoming has offered two different computer science week-long professional developments for teachers. Many K-12 teachers do not have a CS background, so developing CS lessons plans can be a challenge in these PDs.This research study is centered around three central questions: 1) To what extent did K-12 teachers integrate computing topics into their PD created lesson plans; 2) How do the teacher perceptions from the two CS PDs compare to each other; and 3) How was the CS PD translated to classroom activity? The first PD opportunity (n=14), was designed to give hands-on learning with CS topics focused on cybersecurity. The second PD opportunity (n=28), focused on integrating CS into existing curricula. At the end of each of these PDs, teacher K-12 teachers incorporated CS topics into their selected existing lesson plan(s). Additionally, a support network was implemented to support excellence in CS education throughout the state. This research study team evaluated the lesson plans developed during each PD event, by using a rubric on each lesson plan. Researchers collected exit surveys from the teachers. Implementation metrics were also gathered, including, how long each lesson lasted, how many students were involved in the implementation, what grades the student belonged to, the basic demographics of the students, the type of course the lesson plan was housed in, if the K-12 teacher reached their intended purpose, what evidence the K-12 teacher had of the success of their lesson plan, data summaries based on supplied evidence, how the K-12 teachers would change the lesson, the challenges and successes they experienced, and samples of student work. Quantitative analysis was basic descriptive statistics. Findings, based on evaluation of 40+ lessons, taught to over 1500 K-12 students, indicate that when assessed on a three point rubric of struggling, emerging, or excellent - certain components (e.g., organization, objectives, integration, activities & assessment, questions, and catch) of K-12 teacher created lessons plans varied drastically. In particular, lesson plan organization, integration, and questions each had a significant number of submissions which were evaluated as "struggling" [45%, 46%, 41%] through interesting integration, objectives, activities & assessment, and catch all saw submissions which were evaluated as "excellent" [43%, 48%, 43%, 48%]. The relationship between existing K-12 policies and expectations surfaces within these results and in combination with other findings leads to implications for the translation of current research practices into pre-collegiate PDs. 
    more » « less
  5. The rapid expansion of K-12 CS education has made it critical to support CS teachers, many of whom are new to teaching CS, with the necessary resources and training to strengthen their understanding of CS concepts and how to effectively teach CS. CS teachers are often tasked with teaching different curricula using different programming languages in different grades or during different school years, and tend to receive different professional development (PD) for each curriculum they are required to teach. This often leads to a lack of deep understanding of the underlying CS concepts and how different curricula address the same concepts in different ways. Empowering teachers to develop a deep understanding of CS standards, and use formative assessments to recognize common student challenges associated with the standards, will enable teachers to provide more effective CS instruction, irrespective of the curriculum and/or programming language they are tasked with using. This position paper advocates supporting CS teacher professional learning by supplementing existing curriculum-specific teacher PD with standards-aligned PD that focuses on teachers' conceptual understanding of CS standards and ability to adapt instruction based on student understanding of concepts underlying the CS standards. We share concrete examples of how to design standards-aligned educative resources and instructionally supportive tools that promote teachers' understanding of CS standards and common student challenges and develop teachers' formative assessment literacy, all essential components of CS pedagogical content knowledge. 
    more » « less