skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: An Examination of the Correlation of Exploring Computer Science Course Performance and the Development of Programming Expertise
This study investigated patterns in the development of computational thinking and programming expertise in the context of the Exploring Computer Science (ECS) program, a high school introductory CS course and professional development program designed to foster deep engagement through equitable inquiry around CS concepts. Prior research on programming expertise has identified three general areas of development — program comprehension, program planning, and program generation. The pedagogical practices in ECS are consistent with problem solving approaches that support the development of programming expertise. The study took place in a large urban district during the 2016–17 school year with 28 ECS teachers and 1,931 students. A validated external assessment was used to measure the development of programming expertise. The results indicate that there were medium-sized, statistically significant increases from pretest to posttest, and there were no statistically significant differences by gender or race/ethnicity. After controlling for prior academic achievement, performance in the ECS course correlated with performance on the posttest. With respect to specific programming concepts, the results also provide evidence on the progression of the development of programming expertise. Students seem to develop comprehension and planning expertise prior to expertise in program generation. In addition, students seem to develop expertise with concrete tasks prior to abstract tasks.  more » « less
Award ID(s):
1738691 1543217 1542971 1738776 1738572
PAR ID:
10088736
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
SIGCSE '19 Proceedings of the 50th ACM Technical Symposium on Computer Science Education
Page Range / eLocation ID:
1067 to 1073
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This study investigated patterns in the development of computational thinking practices in the context of the Exploring Computer Science (ECS) program, a high school introductory CS course and professional development program designed to foster deep engagement through equitable inquiry around CS concepts. Past research indicates that the personal relevance of the ECS experience influences students' expectancy-value towards computer science. Expectancy-value is a construct that is predictive of career choices. We extended our research to examine whether expectancy-value influences the development of computational thinking practices. This study took place in the context of two ECS implementation projects across two states. Twenty teachers, who implemented ECS in 2016–17, participated in the research. There were 906 students who completed beginning and end of year surveys and assessments. The surveys included demographic questions, a validated expectancy-value scale, and questions about students' course experiences. The assessments were developed and validated by SRI International as a companion to the ECS course. Overall, student performance statistically increased from pretest to posttest with effect size of 0.74. There were no statistically significant differences in performance by gender or race/ethnicity. These results are consistent with earlier findings that a personally relevant course experience positively influences students' expectancy for success. These results expanded on prior research by indicating that students' expectancy-value for computer science positively influenced student learning. 
    more » « less
  2. The Exploring Computer Science (ECS) curriculum provides foundational knowledge of Computer Science (CS) to high school students as a stand-alone course. ECS began in the Los Angeles Unified School District in the late 2000s where it gained eminence for broadening participation in computing (BPC), with Latinx students representing over 70% of enrollment. This experience report describes a partnership that consists of three Universities, dozens of school districts, the ECS team, and other stakeholders to bring the ECS curriculum in mainly rural school districts in Alabama that have a majority African-American student population. Sixty in-service teachers (one teacher per school) have received professional learning opportunities to gain knowledge and skills to teach ECS. Signs of early broader impacts are emerging: 78% of our ECS enrollment are underrepresented minority (URM) students with nearly half of the cohort consisting of female students. Students reported they were engaged in working collaboratively and sharing responsibilities with others. Furthermore, students who reported being more involved in the ECS course had deeper confidence in their ability to succeed in CS, reported greater overall outcomes, had more confidence in development of 21st century skills, found the course more relevant, were more motivated to persist in CS, and exhibited increased interest in CS careers. We provide a comprehensive description of the partnership’s accomplishments and the evaluation findings on student CS experiences and on teacher self-efficacy in ECS preparation and instruction. Our findings contribute to the BPC literature, specifically for schools with predominantly African-American enrollment in rural communities. 
    more » « less
  3. Expanding access to and engaging diverse groups of students in high school computer science (CS) classes depends on qualified CS teachers. In this paper, we describe how faculty at our liberal arts college built CS teacher capacity at over 20 school districts through comprehensive college/high school partnerships. The majority of these districts serve rural or high-needs students, groups underrepresented in CS classrooms. The program works primarily with in-service teachers from other disciplines, helping them develop the expertise to teach CS. It is comprehensive in that it includes curricula and professional development for a high school level CS course and a dual-enrollment college level CS course, pathways to CS certification, community events, and opportunities for teacher leadership and collaboration. These modes of engagement are structured so that novice and veteran teachers and college faculty have opportunities to interact in different capacities over several years to create a robust professional learning community. Initial survey results show increasing levels of teacher confidence and sense of belonging, and increasing student confidence in their CS abilities. 
    more » « less
  4. null (Ed.)
    The AP Computer Science A course and exam continually exhibit inequity among over- and under-represented populations. This paper explored three years of AP CS A data in the Chicago Public School district (CPS) from 2016-2019 (N = 561). We analyzed the impact of teacher and student-level variables to determine the extent AP CS A course taking and exam passing differences existed between over- and under-represented populations. Our analyses suggest four prominent findings: (1) CPS, in collaboration with their Research-Practice Partnership (Chicago Alliance for Equity in Computer Science; CAFÉCS), is broadening participation for students taking the AP CS A course; (2) Over- and under- represented students took the AP CS A exam at statistically comparable rates, suggesting differential encouragement to take or not take the AP CS A exam was not prevalent among these demographics; (3) After adjusting for teacher and student-level prior experience, there were no significant differences among over- and under-represented racial categorizations in their likelihoods to pass the AP CS A exam, albeit Female students were 3.3 times less likely to pass the exam than Males overall; (4) Taking the Exploring Computer Science course before AP CS A predicted students being 3.5 times more likely to pass the AP CS A exam than students that did not take ECS before AP CS A. Implications are discussed around secondary computer science course sequencing and lines of inquiry to encourage even greater broadening of participation in the AP CS A course and passing of the AP CS A exam. 
    more » « less
  5. The Computer Science Teachers Association (CSTA) K-12 Computer Science Standards identify ‘Algorithms and Programming’ as a key CS concept across all grade bands that encompasses sub-concepts such as algorithms, decomposition, variables, and control structures. Previous studies have shown that algorithms and programming concepts often pose challenges for novice programmers, and that instruction in these areas is often superficial. We developed formative assessment tasks to investigate middle school students’ understanding of four CS standards related to algorithms and programming and collected responses from over 100 students associated with five different teachers. We found that students demonstrated a limited understanding of the standards. These findings contribute to the growing literature on middle school students’ understanding of algorithms and programming, and provide insights that can inform CS teacher development, instruction, and curriculum design. 
    more » « less