skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Evaluating STEM-Based Sustainability Understanding: A Cognitive Mapping Approach
Management education holds promise for addressing deficiencies in interuniversity science, technology, engineering, and mathematics (STEM), as well as sustainability curricula. Accordingly, we designed, developed, implemented, and longitudinally evaluated interdisciplinary STEM-based curricula in the United States. Students in five sections of business management courses and two sections of STEM courses received a STEM-based sustainability intervention (i.e., an interdisciplinary STEM and sustainability module). To assess student outcomes following the intervention and examine the feasibility of cognitive mapping as a student learning assessment tool, we implemented a pre- and post-course modified cognitive mapping assessment in treatment and comparison courses. To interpret the results, we ran descriptives, correlations, paired sample t tests, and principal component analysis. The t tests suggest that when all coding categories are considered, those participating in curricular interventions listed significantly more sustainability terms. The principal component analysis results demonstrate that treatment courses improved variability explained by 7.23% between pre- and post-tests but declined by 8.22% for comparison courses. Overall, linkages became stronger between parent code categories for treatment courses and weaker for comparison courses. These findings add to existing research related to cognitive mapping and demonstrate the ability of the method to capture changes in student outcomes after exposure to STEM-based sustainability curriculum.  more » « less
Award ID(s):
1951290
PAR ID:
10287776
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Sustainability
Volume:
13
Issue:
14
ISSN:
2071-1050
Page Range / eLocation ID:
8074
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. To address deficiencies in STEM and sustainability in business management and intra-university curricula, we developed and implemented an interdisciplinary STEM-based sustainability curriculum at a university in the Western United States. Six classes participated in curricular efforts including in-person and online sections of a business management course, in-person and online sections of a general elective STEM course, and a matched control course for each ( n = 214). We systematically designed, developed, and implemented curricular interventions—multi-week STEM-based business sustainability modules—using the case teaching method. A comprehensive evaluation with pre- and post-tests was conducted to assess student sustainability cognition and affect. Significant results emerged for sustainability cognition including the environmental, social, and economic dimensions of sustainability. Counterintuitively, student sustainability affect did not improve. However, sustainability cognition and affect were significantly correlated on the post-test for treatment students, an indication that cognitive and affective changes share the same directionality. Discussion, implications, limitations, and future research directions are provided. 
    more » « less
  2. null (Ed.)
    The promotion of global sustainability within environmental science courses requires a paradigm switch from knowledge-based teaching to teaching that stimulates higher-order cognitive skills. Non-major undergraduate science courses, such as environmental science, promote critical thinking in students in order to improve the uptake of scientific information and develop the rational decision making used to make more informed decisions. Science, engineering, technology and mathematics (STEM) courses rely extensively on visuals in lectures, readings and homework to improve knowledge. However, undergraduate students do not automatically acquire visual literacy and a lack of intervention from instructors could be limiting academic success. In this study, a visual literacy intervention was developed and tested in the face-to-face (FTF) and online sections of an undergraduate non-major Introduction to Environmental Science course. The intervention was designed to test and improve visual literacy at three levels: (1) elementary—identifying values; (2) intermediate—identifying trends; and (3) advanced—using the data to make projections or conclusions. Students demonstrated a significant difference in their ability to answer elementary and advanced visual literacy questions in both course sections in the pre-test and post-test. Students in the face-to-face course had significantly higher exam scores and higher median assessment scores compared to sections without a visual literacy intervention. The online section did not show significant improvements in visual literacy or academic success due to a lack of reinforcement of visual literacy following the initial intervention. The visual literacy intervention shows promising results in improving student academic success and should be considered for implementation in other general education STEM courses. 
    more » « less
  3. This project supports the success of undergraduate engineering students through coordinated design of curricula across STEM course sequences. The Analysis, Design, Development, Implementation, Evaluation (ADDIE) framework and backward design are being used to develop guides for instructors to align learning outcomes, assessments, and instructional materials in a physics – engineering mechanics course sequence. The approach relies on the analysis of student learning outcomes in each course, identification of interdependent learning outcomes, and development of skills hierarchies in the form of visual learning maps. The learning maps are used to illustrate the knowledge required and built upon throughout the course sequence. This study will assess the effectiveness of a course redesign intervention, which uses visual learning maps and backward design concepts, to guide instructors within a common course sequence to align learning outcomes and assessments. If successful, the intervention is expected to improve students’ primary learning and knowledge retention, as well as persistence and success in the degree. The study will compare academic performance among Mechanical Engineering B.S., Environmental Engineering B.S., and Civil Engineering B.S. students who begin a Physics for Engineers – Statics – Dynamics course prior to the intervention (control) and after the intervention (treatment). During control and treatment terms, students’ primary learning in individual courses will be assessed using established concept inventories. Retention of knowledge from pre-requisite courses will be tracked using pre-identified problem sets (quizzes, exams) specifically associated with interdependent learning outcomes in the Statics and Dynamics courses. Students’ primary learning and knowledge retention in the sequence will be related to longer term student success outcomes, including retention and graduation. The poster will show the results of the research team’s first year of work, including an analysis of current course materials, learning maps for each course, identification of interdependent learning outcomes, example guiding materials and templates for instructors, and preliminary student performance data from the control cohort. 
    more » « less
  4. Abstract Recent calls for reform in K‐12 science education and the National Academy of Engineering's Grand Challenges for Engineering in the 21st Century emphasize improving science teaching, students' engagement, and learning. In this study, we designed and implemented a curriculum unit for sixth‐grade students (i = 1305). The curriculum unit integrated science and engineering content and practices to teach ecology, water pollution, and engineering design. We investigated the designed integrated STEM unit's effectiveness in students' science learning outcomes on pre‐, post‐, and delayed post‐assessments. We collected pre‐and post‐assessment data of students' science learning outcomes for both the baseline group (taught via existing district‐adopted curriculum) and an intervention group (taught with integrated life science and engineering curriculum). We used a quasi‐experimental research design and examined differences between baseline and intervention groups. We used ANCOVA to explore differences in students' learning in baseline and intervention groups. Furthermore, for students in the intervention group, we conducted repeated‐measures ANOVA to investigate knowledge retention. Our analyses also accounted for students' gender and People of Color (POC) status. We conducted multiple regression analyses to explore the relationship between students' gender, POC status, and their learning outcomes. The results indicated that the intervention group students performed significantly better than the students in the baseline group. The repeated measures ANOVA showed that students in the intervention group retained science knowledge after 8 weeks of instruction. Finally, the regression analysis for the baseline group showed that gender and POC status were not significant predictors of their post‐assessment scores. However, POC status was a significant predictor of post‐assessment scores and knowledge retention for the intervention group. Overall, this study provides valuable findings on how an integrated STEM curriculum designed with engineering design and practices improves students' science learning outcomes. 
    more » « less
  5. This paper describes the implementation of innovative 3D-printed laboratory equipment linked to inquiry-based learning activities designed to improve learning, increase engineering identity and motivation, and foster a growth mindset in students taking undergraduate level mechanical vibrations courses, control theory courses, and associated laboratories. These innovative designs create new opportunities for hands-on learning, are low-cost, portable, and can be adapted for use in multiple science and engineering disciplines. The learning activities are based on the POGIL model, which has been used across a variety of disciplines including engineering. We describe the features of three separate devices (spring-connected sliding carts, compliant parallel arms with fixed-free ends and a slider mass, and a pendulum with variable tip load) implemented using a quasi-experimental approach with 510 duplicated students across three semesters during the COVID-19 pandemic in multiple lecture courses and laboratory sections. We also present an assessment of impact based on descriptive statistical analyses of survey data for student-reported learning gains and pre-post paired comparison tests on validated instruments measuring perceptions of engineering identity, engineering motivation, and growth mindset. Further, we conducted a student focus group and include salient instructor observations. Results show most students participating in the learning activities using these devices report that it supported their learning “a lot” or “a great deal.” In addition, on six of seven surveyed learning outcomes, most students reported feeling confident enough to complete them on their own or even teach them to someone else. Our data did not show a measurable impact on engineering identity, engineering motivation, or growth mindset, though it does suggest further investigation is merited. 
    more » « less