skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: ATE Assessment Practices: Reconceptualizing the Role of Participants in Professional Development Evaluation
Research shows formative assessments substantially strengthen learning and support summative assessment/evaluation practices. These practices are not widely applied in ATE's professional development (PD) efforts. This study focuses on participant teachers' assessment involvement to increase student learning and enhance outcome evaluations. We surveyed all principal investigators of ATE projects in 2022 who applied assessments in their 2021 PD efforts (N=70). Findings show that a minority of PD efforts apply formative assessment practices to strengthen PD outcomes or meet ATE's evaluation specifications. Assessment practices were most prevalent for summative purposes at the close of PD activity; a large majority assessed teachers' interest and learning in the PD and their intentions to use and teach what was learned on return to their classrooms. A third or less followed up to assess outcomes in teachers' schools. Similarly, thirty percent or less addressed matters of context at any stage of the PD efforts, and a few, 11 percent, followed up to assess the context in the schools. Concomitantly, the findings show where and how attention to formative assessment in the PD learning process can increase teacher involvement in assessment practices, making PD instruction more effective and strengthening outcome evaluations in participant teachers' home classrooms.  more » « less
Award ID(s):
2000281
PAR ID:
10497406
Author(s) / Creator(s):
; ;
Publisher / Repository:
Zenodo
Date Published:
Journal Name:
Journal of advanced technological education
Volume:
3
Issue:
1
ISSN:
2832-9635
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. (, 52nd ACM Technical Symposium on Computer Science Education (SIGCSE ’21))
    null (Ed.)
    Unlike summative assessment that is aimed at grading students at the end of a unit or academic term, formative assessment is assess- ment for learning, aimed at monitoring ongoing student learning to provide feedback to both student and teacher, so that learning gaps can be addressed during the learning process. Education research points to formative assessment as a crucial vehicle for improving student learning. Formative assessment in K-12 CS and program- ming classrooms remains a crucial unaddressed need. Given that assessment for learning is closely tied to teacher pedagogical con- tent knowledge, formative assessment literacy needs to also be a topic of CS teacher PD. This position paper addresses the broad need to understand formative assessment and build a framework to understand the what, why, and how of formative assessment of introductory programming in K-12 CS. It shares specific pro- gramming examples to articulate the cycle of formative assessment, diagnostic evaluation, feedback, and action. The design of formative assessment items is informed by CS research on assessment design, albeit related largely to summative assessment and in CS1 contexts, and learning of programming, especially student misconceptions. It describes what teacher formative assessment literacy PD should entail and how to catalyze assessment-focused collaboration among K-12 CS teachers through assessment platforms and repositories. 
    more » « less
  2. ; ; ; (, Psychology of Mathematics Education North American)
    Olanoff, D; Johnson, K.; Spitzer, S (Ed.)
    Administrators, educators, and stakeholders have faced the dilemma of determining the most effective type of data for informing instruction for quite some time (Pella, 2015). While the type of standardized assessment a teacher gives during instruction is often set at the district or state level, teachers often have autonomy in the formative and summative assessments that serve as the day-to-day tools in assessing a student’s progress (Abrams et al., 2016). Choices about in-class assessment and instruction are building blocks towards a student’s success on standardized assessments. The purpose of this phenomenological qualitative study is to explore how 4th-8th grade math teachers’ preparation and instructional practices are influenced by the types of assessments administered to their students in one school. Research questions are as follows: (a) How do 4th-8th grade math teachers describe the math assessments they use? (b) How do 4th-8th grade math teachers adjust their instructional practices as a result of their students completing formative, summative, and standardized math assessments? 
    more » « less
  3. (, Earth Educator's Rendevous Abstracts)
    Our research, Landscapes of Deep Time in the Red Earth of France (NSF International Research Experience for Students project), aims to mentor U.S. undergraduate science students from underserved populations (e.g. students of Native American heritage and/or first-generation college students) in geological research. During the first field season (June 2018) formative and summative assessments (outlined below) will be issued to assist in our evaluation of student learning. The material advancement of a student's sedimentological skillsets and self-efficacy development in research applications are a direct measure of our program's success. (1) Immediately before and after the program, students will self-rank their competency of specific skillsets (e.g. data collection, lithologic description, use of field equipment) in an anonymous summative assessment. (2) Formative assessments throughout the field season (e.g. describing stratigraphic section independently, oral and written communication of results) will assess improved comprehension of the scientific process. (3) An anonymous attitudinal survey will be issued at the conclusion of the field season to shed light on the program's quality as a whole, influence on student desire to pursue a higher-level degree/career in STEM, and effectiveness of the program on aiding the development of participant confidence and self-efficacy in research design and application. We discuss herein the results of first-year assessments with a focus on strategies for improvement. We expect each individual's outcomes to differ depending on his/her own characteristics and background. Furthermore, some of the most valued intentions of this experience are inherently difficult to measure (e.g., improved understanding of the scientific process, a stimulated passion to pursue a STEM career). We hope to address shortcomings in design; e.g. Where did we lose visibility on certain aspects of the learning experience? How can we revise the format and content of our assessment to better evaluate student participants and improve our program in subsequent years? 
    more » « less
  4. ; ; ; ; ; (, Koli Calling International Conference on Computing Education Research)
    null (Ed.)
    The Covid-19 pandemic has offered new challenges and opportunities for teaching and research. It has forced constraints on in-person gathering of researchers, teachers, and students, and conversely, has also opened doors to creative instructional design. This paper describes a novel approach to designing an online, synchronous teacher professional development (PD) and curriculum co-design experience. It shares our work in bringing together high school teachers and researchers in four US states. The teachers participated in a 3-week summer PD on ideas of Distributed Computing and how to teach this advanced topic to high school students using NetsBlox, an extension of the Snap! block-based programming environment. The goal of the PD was to prepare teachers to engage in collaborative co-design of a 9-week curricular module for use in classrooms and schools. Between their own training and the co-design process, teachers co-taught a group of high school students enrolled in a remote summer internship at a university in North Carolina to pilot the learned units and leverage ideas from their teaching experience for subsequent curricular co-design. Formative and summative feedback from teachers suggest that this PD model was successful in meeting desired outcomes. Our generalizable FIRST principles—Flexibility, Innovativeness, Responsiveness (and Respect), Supports, and Teamwork (collaboration)—that helped make this unique PD successful, can help guide future CS teacher PD designs. 
    more » « less
  5. (, Journal of archaeology and education)
    null (Ed.)
    Participation in an archaeological field school is the entry point to a professional career in the discipline. Despite the importance of field schools, few scholars have investigated achieved student-learning outcomes or lasting impacts on students from participation in archaeological field research. We report on the educational design, learning objectives, and results of three years of formative and summative assessments for an interdisciplinary, archaeology and ecology research program for undergraduate students. Our learning objectives include promoting scientific literacy and communication, critical thinking and STEM skills, and capacities in archaeological and ecological interdisciplinarity. Using developed rubrics that account for both critical thinking and STEM understanding, self-administered competency surveys, and program-developed items, we found significant gains in nearly all learning objectives. Students demonstrated growth in program specific content, perceived abilities in their scientific and discipline specific skills, critical thinking skills, and scientific communication skills. These educational outcomes and assessment tools have implications for how we design and evaluate field learning in archaeology and may be applied to field school instruction. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email