Conventional assessment analysis of student results, referred to as rubric‐based assessments (RBA), has emphasized numeric scores as the primary way of communicating information to teachers about their students’ learning. In this light, rethinking and reflecting on not only how scores are generated but also what analyses are done with them to inform classroom practices is of utmost importance. Informed by Systemic Functional Linguistics and Latent Dirichlet Allocation analyses, this study utilizes an innovative bilingual (Spanish–English) constructed response assessment of science and language practices for middle and high school students to perform a multilayered analysis of student responses. We explore multiple ways of looking at students’ performance through their written assessments and discuss features of student responses that are made visible through these analyses. Findings from this study suggest that science educators would benefit from a multidimensional model which deploys complementary ways in which we can interpret student performance. This understanding leads us to think that researchers and developers in the field of assessment need to promote approaches that analyze student science performance as a multilayered phenomenon.
When low-SES students perform better-than-expected on a standardized test: The role of teacher professional development.
This paper describes a study using a quasi-experimental design to examine
teachers’ preparations in low-income schools for a revised version of the AP Biology and
AP Chemistry examinations, and explores variables associated with student scores on the
AP science examinations that are better than would be predicted based on their PSAT
scores. Considering the frequently-measured achievement gap on high-stakes
examinations, identifying “what works” to raise student performance of at-risk students is
an urgent area for research. The analyses indicate that (a) districts per-student funding
allocations, (b) teachers’ knowledge and experience, and (c) teachers’ participation in
professional development activities with a responsive agenda and effective support for
teaching the redesigned AP science course are significantly associated with higher
students’ average performance on the AP science exams than would be predicted.
more »
« less
- Award ID(s):
- 1221861
- NSF-PAR ID:
- 10067591
- Date Published:
- Journal Name:
- American Educational Research Association
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
This empirical study explored participation patterns of 1,733 Advanced Placement (AP) Physics teachers in the online AP teacher community (APTC) following the redesigned AP science examinations in the United States. We identified profiles of teachers with different levels of engagement in this peer-based online learning community. Our results provide insight into underrepresented user groups and the development of more personalized online teacher support systems. Our analysis suggested that teachers’ knowledge and experience, the enactment of AP practices, challenges with the AP redesign, and AP workload were all significantly associated with changes in the probability of teachers becoming APTC users. This indicated that the APTC attracted a non-representative population sample of all AP physics teachers. However, most teacher, teaching, and school characteristics provided no indication as to whether APTC users were posters or lurkers.more » « less
-
null (Ed.)CSAwesome is a new approved curriculum and professional development (PD) provider for the Advanced Placement (AP) Computer Science (CS) A high school course. AP courses are taken by secondary (typically ages 14-19) students for college placement and/or credit. CSAwesome's free curriculum and teacher resources were developed in 2019 by adapting the CSA Java Review ebook on the open-source Runestone platform. The goals of CSAwesome are to broaden participation in the AP CSA course and to support new-to-CS students and teachers as they transition from the AP Computer Science Principles (CSP) course to the AP CSA course by using inclusive teaching practices and curriculum design. The AP CSP course is equivalent to a first course for non-majors at the college level, while the AP CSA course is equivalent to a first course for majors. Currently, AP CSA attracts a much less diverse student body than AP CSP. This new curriculum supports student engagement and scaffolded learning through an interactive ebook with embedded executable and modifiable code (Active Code), a variety of practice types with immediate feedback, and adaptable mixed-up code (Parsons) problems. Collaborative learning is encouraged through pair programming and groupwork. Our pilot Professional Development (PD) incorporates inclusive teaching strategies and active recruitment with the goal of broadening participation in CSA. This paper presents the design of the CSAwesome curriculum and teacher professional development and initial results from the curriculum use and pilot PD during the first year of CSAwesome.more » « less
-
null (Ed.)The AP Computer Science A course and exam continually exhibit inequity among over- and under-represented populations. This paper explored three years of AP CS A data in the Chicago Public School district (CPS) from 2016-2019 (N = 561). We analyzed the impact of teacher and student-level variables to determine the extent AP CS A course taking and exam passing differences existed between over- and under-represented populations. Our analyses suggest four prominent findings: (1) CPS, in collaboration with their Research-Practice Partnership (Chicago Alliance for Equity in Computer Science; CAFÉCS), is broadening participation for students taking the AP CS A course; (2) Over- and under- represented students took the AP CS A exam at statistically comparable rates, suggesting differential encouragement to take or not take the AP CS A exam was not prevalent among these demographics; (3) After adjusting for teacher and student-level prior experience, there were no significant differences among over- and under-represented racial categorizations in their likelihoods to pass the AP CS A exam, albeit Female students were 3.3 times less likely to pass the exam than Males overall; (4) Taking the Exploring Computer Science course before AP CS A predicted students being 3.5 times more likely to pass the AP CS A exam than students that did not take ECS before AP CS A. Implications are discussed around secondary computer science course sequencing and lines of inquiry to encourage even greater broadening of participation in the AP CS A course and passing of the AP CS A exam.more » « less
-
The Bureau of Statistics identified an urgent demand for science, technology, engineering, and mathematics (STEM) professionals in the coming years. In order to meet this demand, the number of students graduating with STEM degrees in the United States needs to increase by 34% annually [1]. Engineering for US All (E4USA): A National Pilot Program for High School Engineering Course and Database is a NSF-funded first-of-its-kind initiative designed to address this national need. The E4USA project aims to make engineering more inclusive and accessible to underrepresented minorities, while increasing racial, ethnic, and gender representation in higher education and the workforce. The “for us all” mission of E4USA encompasses both students and educators. The demand for engineering educators has increased, but relying on practicing engineers to switch careers and enter teacher preparation programs has been insufficient [2, 3, 4]. This has led schools to turn to educators with limited training in engineering, which could potentially have a significant national impact on student engineering education [5, 6, 7]. Part of the E4USA pilot year mission has been to welcome educators with varying degrees of experience in industry and teaching. Paramount to E4USA was the construction of professional development (PD) experiences and a community of practice that would prepare and support teachers with varying degrees of engineering training instruction as they implemented the yearlong course. The perspectives of four out of nine educators were examined during a weeklong, intensive E4USA PD. Two of four educators were considered ‘novices’; one with a background in music and the other in history. The remaining two educators were deemed ‘veterans’ with a total of 15 years of experience as engineers and more than 20 years as engineering educators. Data sources consist of focus groups, surveys, and artifacts created during the PD (e.g., educators’ responses to reflection prompts and letters written to welcome the next cohort). Focus group data is currently being analyzed using inductive coding and the constant comparative method in order to identify emergent themes that speak to the past experience or inexperience of educators with engineering. Artifacts were used to: 1) Triangulate the findings generated from the analysis of focus group, and 2) Further understand how the veteran educators supported the novice educators. We will also use quantitative survey data to examine descriptive statistics, observed score bivariate correlations, and differences in mean scores across novices and veterans to further examine potential common and unique experiences for these educators. The results aim to highlight how the inclusion of educators with a broad spectrum of past experiences with engineering and engineering education can increase educators’ empathy towards students who may be equally hesitant about engineering. The findings from this study are expected to result in implications for how PD and a community of practice may be developed to allow for reciprocal support and mentoring. Results will inform future efforts of E4USA and aim to change the structure of high school engineering education nationwide.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
