More Like this

1. Assessment for Learning: Helping Children Build on What They Know

   Baroody, A. J. ; Pellegrino, J. W. ( January 2023 , American Educational Research Association Annual Meeting)

   Wiebe, E. N. ; Harris, C. J. ; Grover, S. (Ed.)

   Efforts to improve instruction frequently focus on fostering meaningful learning—learning based on conceptual understanding—as opposed to knowledge memorized by rote. Consistent with Dewey’s (1963) principle of interaction, fostering meaningful learning entails identifying what children already know and do not know and building on the former to learn (moderately) new knowledge (Claessens & Engel, 2013; Fyfe et al., 2012; Piaget, 1964; Vygotsky, 1978). A learning trajectory (LT) approach to instruction—which includes conceptually and research-based and goals, a research-based learning progression of successive developmental levels, and research-based teaching activities to promote each level—epitomizes such an effort (Clements & Sarama, 2008; Confrey et al., 2012). Formative, classroom-based assessment—ongoing assessment to guide and monitor student learning (Black et al., 2003; Cizek, 2010; Author, 2018a)—is an integral aspect of the LT approach (Daro et al., 2011). In contrast to more commonly used summative assessment strategy (e.g., a unit test given at the end of an instruction unit to assess whether unit content has been mastered and grade progress), formative assessment serves to identify what developmental level a child has already achieved and the next developmentally appropriate level on which instruction should begin (Author, 2018a). Moreover, children are regularly assessed during instruction to gauge whether they–individually or collectively–have mastered a developmental level before instruction proceeds with the next higher level. In sum, “the LT approach involves using formative assessment (National Mathematics Advisory Panel, 2008; Shepard et al., 2018) to provide instructional activities aligned with empirically validated developmental progressions (Fantuzzo, Gadsden, & McDermott, 2011). Although research has shown that LT-based instruction is more efficacious, research is needed to evaluate the add-on value of the formative assessment components of LT-based instruction on student outcomes and the professional development of teachers. This presentation will highlight future lines of research that would provide insight into underlying theory and more productive strategies. Because LTs “need to be supplemented with consideration of obstacles that the student must overcome,” much needs to be learned about the obstacles posed by the content itself, instructional materials, and teachers (Ginsburg, 2009). 

   more » « less
2. ATE Assessment Practices: Reconceptualizing the Role of Participants in Professional Development Evaluation

   Gullickson, A ; Datta, R ; Chen, M ( March 2024 , Journal of advanced technological education)

   Research shows formative assessments substantially strengthen learning and support summative assessment/evaluation practices. These practices are not widely applied in ATE's professional development (PD) efforts. This study focuses on participant teachers' assessment involvement to increase student learning and enhance outcome evaluations. We surveyed all principal investigators of ATE projects in 2022 who applied assessments in their 2021 PD efforts (N=70). Findings show that a minority of PD efforts apply formative assessment practices to strengthen PD outcomes or meet ATE's evaluation specifications. Assessment practices were most prevalent for summative purposes at the close of PD activity; a large majority assessed teachers' interest and learning in the PD and their intentions to use and teach what was learned on return to their classrooms. A third or less followed up to assess outcomes in teachers' schools. Similarly, thirty percent or less addressed matters of context at any stage of the PD efforts, and a few, 11 percent, followed up to assess the context in the schools. Concomitantly, the findings show where and how attention to formative assessment in the PD learning process can increase teacher involvement in assessment practices, making PD instruction more effective and strengthening outcome evaluations in participant teachers' home classrooms. 

   more » « less
3. Exploring the role of coherence in science teachers’ sensemaking of science‐specific formative assessment in professional development

   https://doi.org/10.1002/sce.21561  

   Heredia, Sara C. ( January 2020 , Science Education)

   This study explores the role of conceptual coherence in science teacher learning of science‐specific formative assessment. Conceptual coherence refers to the alignment of ideas about teaching and learning and may be difficult with certain teaching practices, like formative assessment, that have a central role in accountability mechanisms in schools. The case study analyzes how one department of science teachers surfaced and managed issues of coherence as they developed and implemented science‐specific formative assessments during a 3‐year, job‐embedded professional development program. The issues of coherence shifted over the course of the 3 years of professional development as organizational changes happened at the district and the school. These shifting sources of incoherence resulted in varied uptake and use of the resources provided through professional development. When the source of incoherence was with changes introduced by the district or the school administration, the teachers did not leverage the resources provided by the professional development team. However, when the teachers surfaced issues of coherence in their classroom instruction, the science teachers relied on the professional development resources in their sensemaking. The results of this study have implications for the design of science teacher professional learning to provide teachers opportunities to manage sources of incoherence as they work to implement new instructional practices in their classrooms.

    

   more » « less
4. Board 110: Work in Progress: Elementary Students’ Disciplinary Talk in a Classroom with an Explicit Engineering Decision-making Scaffold

   https://doi.org/10.18260/1-2--32188  

   Batrouny, Nicole ; Miel, Karen ; Wendell, Kristen ( June 2019 , ASEE Conferences)

   While engineering grows as a part of elementary education, important questions arise about the skills and practices we ask of students. Both collaboration and decision making are complex and critical to the engineering design process, but come with social and emotional work that can be difficult for elementary students to navigate. Productive engagement in collaborative teams has been seen to be highly variable; for some teams, interpersonal conflicts move the design process forward, while for others they stall the process. In this work in progress, we are investigating the research question, what is the nature of students’ disciplinary talk during scaffolded decision making? We explore this research question via a case study of one student group in a 4th-grade classroom enrolled in an outreach program run by a private university in a Northeastern city. This program sends pairs of university students into local elementary schools to facilitate engineering in the classroom for one hour per week. This is the only engineering instruction the elementary students receive and the engineering curriculum is planned by the university students. For the implementation examined in this study, the curriculum was designed by two researchers to scaffold collaborative groupwork and decision making. The instruction was provided by an undergraduate and one of the researchers, a graduate student. The scaffolds designed for this semester of outreach include a set of groupwork norms and a decision matrix. The groupwork norms were introduced on the first day of instruction; the instructors read them aloud, proposed groupwork scenarios to facilitate a whole class discussion about whether or not the norms were followed and how the students could act to follow the norms, and provided time for students to practice the norms in their engineering design groups for the first project. For the rest of the semester, an anchor chart of the norms was displayed in the classroom and referenced to encourage consensus. The researchers designed the decision matrix scaffold to encourage design decisions between multiple prototypes based on problem criteria and test results. Instructors modeled the use of this decision matrix on the third day of instruction, and students utilized the matrix in both design projects of the semester. Data sources for this descriptive study include students’ written artifacts, photos of their design constructions, and video records of whole-class and team discourse. We employ qualitative case study and microethnographic analysis techniques to explore the influence of the intentional discourse scaffolds on students’ collaborative and decision-making practices. Our analysis allowed us to characterize the linguistic resources (including the decision matrix) that the students used to complete four social acts during decision making: design evaluation, disagreeing with a teammate, arguing for a novel idea, and sympathizing with a design. This research has implications for the design of instructional scaffolds for engineering curricula at the elementary school level, whether taking place in an outreach program or in regular classroom instruction. 

   more » « less
5. Improving Automated Evaluation of Formative Assessments with Text Data Augmentation.

   https://doi.org/10.1007/978-3-031-11644-5_32  

   Cochran, K. ( July 2022 , Artificial Intelligence in Education. AIED 2022. Lecture Notes in Computer Science, vol 13355.)

   Rodrigo, M.M. (Ed.)

   Formative assessments are an important component of instruction and pedagogy, as they provide students and teachers with insights on how students are progressing in their learning and problem-solving tasks. Most formative assessments are now coded and graded manually, impeding timely interventions that help students overcome difficulties. Automated evaluation of these assessments can facilitate more effective and timely interventions by teachers, allowing them to dynamically discern individual and class trends that they may otherwise miss. State-of-the-art BERT-based models dominate the NLP landscape but require large amounts of training data to attain sufficient classification accuracy and robustness. Unfortunately, educational data sets are often small and unbalanced, limiting any benefits that BERT-like approaches might provide. In this paper, we examine methods for balancing and augmenting training data consisting of students’ textual answers from formative assessments, then analyze the impacts in order to improve the accuracy of BERT-based automated evaluations. Our empirical studies show that these techniques consistently outperform models trained on unbalanced and unaugmented data. 

   more » « less