skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Assessing Elementary Students’ Engineering Design Thinking with an “Evaluate-And-Improve” Task (Fundamental)
Although curricular resources for elementary engineering design continue to grow, it remains challenging to identify assessment tools that focus on students’ reasoning within engineering design and that are feasible for classroom use and accessible for emerging writers. In collaboration with third-grade teachers, we developed an open-response task that asks students to evaluate and improve on the first iteration of a design solution. In this paper, we present the assessment task and an exploratory analysis of the pre- and post-unit responses collected from one classroom implementation using the final version of the task. The evaluate-and-improve assessment task presents a diagram of an unbalanced, lopsided cart for transporting classroom plants and asks students to identify problems with the cart design, propose changes to improve it, and justify those proposed changes. Across their pre- and post-unit responses, the 18 students proposed 14 different changes and provided seven different justifications to support those changes. Students included more justifications in their post-unit explanations, especially when they did not include any justifications in their pre-unit responses. Our exploratory study of this evaluate and improve task suggests that it gives third-grade students an opportunity to demonstrate their ability to scope problems, propose design iterations, and justify those changes.  more » « less
Award ID(s):
1657218
PAR ID:
10344598
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
American Society for Engineering Education
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. It is common for students to multi-task and use their mobile devices while in class for studying or other activities. This research aims to leverage this situation by developing a mobile classroom learning software to help students solve interactive problems in their mobile devices in order to improve their class engagement and problem solving skills. This paper presents the design and development of the mobile classroom response software to communicate, collaborate and evaluate inclass interactive problem solving activities using mobile devices. The software facilitates various pedagogical approaches that reported to enhance student learning. The software is designed to be easy-to-use and maintainable. MRS is extensible and can render interactive problems developed by third party developer. Software quality matrices for the developed code and the user interface are presented to justify above stated objectives. 
    more » « less
  2. This research study was designed to evaluate the extent and the ways in which sixth-grade students developed their reasoning about the greenhouse effect and covariation as a result of their engagement with an instructional module that seamlessly integrates environmental science, mathematics, and technology. Quantitative and qualitative data were obtained from a design experiment in two sixth-grade classrooms and were compared to the data from a control group of students in a third sixth-grade classroom. The results from the quantitative analysis indicated that students in the treatment group demonstrated a greater development than the control group. The findings from the qualitative analysis illustrated that students developed sophisticated forms of reasoning about the greenhouse effect and covariation through their engagement with dynamic simulations and careful task design that prompted students to explore the covariational relationships underlying the science of the greenhouse effect. We consider the design of this instructional module to be valuable for future efforts to develop integrated science, technology, engineering, and mathematics (STEM) modules. 
    more » « less
  3. Abstract Recent calls for reform in K‐12 science education and the National Academy of Engineering's Grand Challenges for Engineering in the 21st Century emphasize improving science teaching, students' engagement, and learning. In this study, we designed and implemented a curriculum unit for sixth‐grade students (i = 1305). The curriculum unit integrated science and engineering content and practices to teach ecology, water pollution, and engineering design. We investigated the designed integrated STEM unit's effectiveness in students' science learning outcomes on pre‐, post‐, and delayed post‐assessments. We collected pre‐and post‐assessment data of students' science learning outcomes for both the baseline group (taught via existing district‐adopted curriculum) and an intervention group (taught with integrated life science and engineering curriculum). We used a quasi‐experimental research design and examined differences between baseline and intervention groups. We used ANCOVA to explore differences in students' learning in baseline and intervention groups. Furthermore, for students in the intervention group, we conducted repeated‐measures ANOVA to investigate knowledge retention. Our analyses also accounted for students' gender and People of Color (POC) status. We conducted multiple regression analyses to explore the relationship between students' gender, POC status, and their learning outcomes. The results indicated that the intervention group students performed significantly better than the students in the baseline group. The repeated measures ANOVA showed that students in the intervention group retained science knowledge after 8 weeks of instruction. Finally, the regression analysis for the baseline group showed that gender and POC status were not significant predictors of their post‐assessment scores. However, POC status was a significant predictor of post‐assessment scores and knowledge retention for the intervention group. Overall, this study provides valuable findings on how an integrated STEM curriculum designed with engineering design and practices improves students' science learning outcomes. 
    more » « less
  4. Lindgren, R; Asino, T I; Kyza, E A; Looi, C K; Keifert, D T; Suárez, E (Ed.)
    We designed and implemented a data visualization project in a seventh-grade classroom focusing on the loss of tribal lands in Montana, United States of America. We aim to understand how students engaged with various scaffolds and how those scaffolds supported them in critically engaging with historical data through making hands-on projects. We analyzed data from multiple sources, including classroom implementation transcripts, student-created artifacts, and pre- and post-surveys. We observed that while students enjoyed creating data visualizations, they struggled to interpret them within their historical context despite the provision of multiple forms of scaffolds. We believe it is important to design a system of scaffolds to further support students in critically engaging with historical data and in developing critical data literacy. 
    more » « less
  5. Ferdig, R; Gandolfi, E; Baumgartner, E (Ed.)
    Student engagement, cultural identity and voice in school have been shown to have measurable influence on student learning. While many factors may affect student dispositions, teachers likely have the most direct impact on the dispositions related to classroom engagement and student voice. Measures of student perceptions of their teachers’ cultural engagement, cultural teaching practices and the students’ own engagement and voice in schooling are included in this paper. Data from 822 grade 3 – 12 students of teachers who participated in a simulated teaching environment intended to improve equitable teaching practices revealed significant pre-post changes for measures of voice and engagement. The data also showed significant differences by gender and ethnicity. 
    more » « less