This report describes efforts by a group of science teachers, teacher educators, researchers, and content specialists to conceptualize, develop, and pilot practice‐based assessment items designed to measure elementary science teachers' content knowledge for teaching (CKT). The report documents the framework used to specify the content‐specific teaching practices and instructional tools that are critical to the work that elementary science teachers engage in with students, curriculum, and instruction. Drawing on this framework, the report details the development process for practice‐based assessment items designed to measure CKT elementary science in three content areas: (a) structure and properties of matter, (b) ecosystems, and (c) Earth's place in the universe. These practice‐based assessment items address the various content challenges elementary science teachers face in their work and were designed to be used as a foundation for building large‐scale assessments of elementary science teachers' CKT science. This report presents initial validity evidence examining the practice‐based CKT science item characteristics using results from online administrations of these items to 250 upper elementary science teachers. Findings reveal that the majority of these new assessment items capture variability in elementary science teachers' performance and that a large proportion of the items differentiate moderately well, supporting a beginning proof‐of‐concept for the conceptualization and design of these practice‐based CKT elementary science assessment items.
- Award ID(s):
- 2101590
- PAR ID:
- 10441200
- Date Published:
- Journal Name:
- Education Sciences
- Volume:
- 13
- Issue:
- 4
- ISSN:
- 2227-7102
- Page Range / eLocation ID:
- 405
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
Pedagogical content knowledge (PCK) is specialized knowledge necessary to teach a subject. PCK integrates subject-matter content knowledge with knowledge of students and of teaching strategies so that teachers can perform the daily tasks of teaching. Studies in mathematics education have found correlations between measures of PCK and student learning. Finding robust, scalable ways for developing and measuring computer science (CS) teachers’ PCK is particularly important in CS education in the United States, given the lack of formal CS teacher preparation programs and certifications. However, measuring pedagogical content knowledge is a challenge for all subject areas. It can be difficult to write assessment items that elicit the different aspects of PCK and there are often multiple appropriate pedagogical choices in any given teaching scenario. In this paper, we describe a framework and pilot data from a questionnaire intended to elicit PCK from teachers of high school introductory CS courses and we propose future directions for this work.more » « less
-
more » « less
Abstract There is strong agreement in science teacher education of the importance of teachers' content knowledge for teaching (CKT), which includes their subject matter knowledge and their pedagogical content knowledge. However, there are limited instruments that can be easily administered and scored on a large scale to assess and study elementary science teachers' CKT. Such measures would support strategic monitoring of large groups of science teachers' CKT and the investigation of comparative questions about science teachers' CKT longitudinally across the professional continuum or across teacher education or professional development sites. To address this gap, this study focused on designing an automatically scorable summative assessment that can be used to measure preservice elementary teachers' (PSETs') CKT in one high‐leverage science content area: matter and its interactions. We conducted a field test of this CKT instrument with 822 PSETs from across the United States and used the response data to examine how this instrument functions as a potential tool for measuring PSETs' CKT in this science content area. Results suggest this instrument is reliable and can be used on large scale to support valid inferences about PSETs' CKT in this content area. In addition, the dimensionality analysis showed that all items measure a single construct of CKT about matter and its interactions, as participants did not show any differential performance by content topic or work of teaching science instructional tool categories. Implications for progressing the field's understanding of the nature of CKT and approaches to developing summative instruments to assess science teachers' CKT are discussed.
-
null (Ed.)We report on the development of a new instrument for measuring teachers' knowledge of language as an epistemic tool in science classes. Language is essential for science learning, as all learning requires the use of language to constitute one's own ideas and to engage with others' ideas. Teachers with knowledge of language as an epistemic tool can recognize the ways that language allows students to generate and validate knowledge for themselves, rather than to replicate canonical knowledge transmitted by other sources.We used a construct‐driven development approach with iterations of domain analysis, item revision, teacher feedback, expert review, and item piloting to address the content, substance, and structure aspects of validity. Data from 158 preservice and in‐service teachers on 27 preliminary items were collected. Findings from Rasch measurement modeling indicate a single dimension fits the items well and can distinguish teachers of higher and lower knowledge. We revised and selected 15 items for an updated instrument. This contributes to ongoing measurement projects and provides a potential instrument for future, broader use by the field to gauge teachers' knowledge of language as an epistemic tool.more » « less
-
Lischka, A. E. (Ed.)Response Process Validity (RPV) reflects the degree to which items are interpreted as intended by item developers. In this study, teacher responses to constructed response (CR) items to assess pedagogical content knowledge (PCK) of middle school mathematics teachers were evaluated to determine what types of teacher responses signaled weak RPV. We analyzed 38 CR pilot items on proportional reasoning across up to 13 middle school mathematics teachers per item. By coding teacher responses and using think-alouds, we found teachers' responses deemed indicative of low item RPV often had one of the following characteristics: vague answers, unanticipated assumptions, a focus on unintended topics, and paraphrasing. To develop a diverse pool of items with strong RPV, we suggest it is helpful to be aware of these symptoms, use them to consider how to improve items, and then revise and retest items accordingly.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/educsci13040405
