skip to main content


Title: ChemSims: using simulations and screencasts to help students develop particle-level understanding of equilibrium in an online environment before and during COVID
Equilibrium is a challenging concept for many, largely because developing a deep conceptual understanding of equilibrium requires someone to be able to connect the motions and interactions of particles that cannot be physically observed with macroscopic observations. Particle level chemistry animations and simulations can support student connections of particle motion with macroscopic observations, but for topics such as equilibrium additional visuals such as graphs are typically present which add additional complexity. Helping students make sense of such visuals requires careful scaffolding to draw their attention to important features and help them make connections between representations ( e.g. , particle motion and graphical representations). Further, as students enter our classrooms with varying levels of background understanding, they may require more or less time working with such simulations or animations to develop the desired level of conceptual understanding. This paper describes the development and testing of activities that use the PhET simulation “Reactions and Rates” to introduce the concept of equilibrium as a student preclass activity either in the form of directly using the simulation or guided by an instructor through a screencast. The pre-post analysis of the two most recent implementations of these activities indicates that students show improved understanding of the core ideas underlying equilibrium regardless of instructor, institution, or type of instructional environment (face to face or remote). We also observed that students were more readily able to provide particle level explanations of changes in equilibrium systems as they respond to stresses (such as changes to concentration and temperature) if they have had prior course instruction on collision theory. Lastly, we observed that student answers to explain how an equilibrium will respond to an applied stress more often focus on either initial responses or longer-term stability of concentrations, not on both key aspects.  more » « less
Award ID(s):
1705365 1702592
NSF-PAR ID:
10342027
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Chemistry Education Research and Practice
Volume:
23
Issue:
3
ISSN:
1109-4028
Page Range / eLocation ID:
644 to 661
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Background Engagement with particle-level simulations can help students visualize the motion and interactions of gas particles, thus helping them develop a more scientifically accurate mental model. Such engagement outside of class prior to formal instruction can help meet the needs of students from diverse backgrounds and provide instructors with a common experience upon which to build with further instruction. Yet, even with well-designed scaffolds, students may not attend to the most salient aspects of the simulation. In this case, a screencast where an instructor provides narrated use of the simulation and points students towards the important observations may provide additional benefits. This study, which is part of the larger ChemSims project, investigates the use of simulations and screencasts to support students’ developing understanding of gas properties by examining student learning gains. Results This study indicates that both students manipulating the simulation on their own and those observing a screencast exhibited significant learning gains from pre- to post-assessment. However, students who observed the screencast were more than twice as likely to transition from a macroscopic explanation to a particle-level explanation of gas behavior in answering matched pre- and post-test questions. Eye-tracking studies indicated very similar viewing and usage patterns for both groups of students overall, including when using the simulation to answer follow-up questions. Conclusion Significant learning gains by both groups across all learning objectives indicate that either scaffolded screencast or simulation assignments can be used to support student understanding of gas particle behavior and serve as a first experience upon which to build subsequent instruction. There is some indication that the initial use of the screencast may better help students build correct mental models of gas particle behavior. Further, for this simulation, watching the instructor manipulate the simulation in the screencast allowed students to subsequently use the simulation on their own at a level comparable to those students who had manipulated the simulation on their own throughout the assignment, suggesting that the screencast students were not disadvantaged by not initially manipulating the simulation on their own. 
    more » « less
  2. Mechanics instructors frequently employ hands-on learning with goals such as demonstrating physical phenomena, aiding visualization, addressing misconceptions, exposing students to “real-world” problems, and promoting an engaging classroom environment. This paper presents results from a study exploring the importance of the “hands-on” aspect of a hands-on modeling curriculum we have been developing that spans several topics in statics. The curriculum integrates deep conceptual exploration with analysis procedure tutorials and aims to scaffold students’ development of representational competence, the ability to use multiple representations of a concept as appropriate for learning, problem solving, and communication. We conducted this study over two subsequent terms in an online statics course taught in the context of remote learning amidst the COVID-19 pandemic. The intervention section used a take-home adaptation of the original classroom curriculum. This adaptation consisted of eight activity worksheets with a supplied kit of manipulatives and model-building supplies students could use to construct and explore concrete representations of figures and diagrams used in the worksheets. In contrast, the control section used activity worksheets nearly identical to those used in the hands-on curriculum, but without the associated modeling parts kit. We only made minor revisions to the worksheets to remove reference to the models. The control and intervention sections were otherwise identical in how they were taught by the same instructor. We compare learning outcomes between the two sections as measured via pre-post administration of a test of 3D vector concepts and representations called the Test of Representational Competence with Vectors (TRCV). We also compare end of course scores on the Concept Assessment Test in Statics (CATS) and final exam scores. In addition, we analyze student responses on two “multiple choice plus explain” concept questions paired with each of five activities covering the topics of 3D moments, 3D particle equilibrium, rigid body equilibrium (2D and 3D), and frame analysis (2D). The mean pre/post gain across all ten questions was higher for the intervention section, with the largest differences observed on questions relating to 3D rigid body equilibrium. Students in the intervention section also made larger gains on the TRCV and scored better on the final exam compared to the control section, but these results are not statistically significant perhaps due to the small study population. There were no appreciable differences in end-of-course CATS scores. We also present student feedback on the activity worksheets that was slightly more positive for the versions with the models. 
    more » « less
  3. Mechanics instructors frequently employ hands-on learning with goals such as demonstrating physical phenomena, aiding visualization, addressing misconceptions, exposing students to “real-world” problems, and promoting an engaging classroom environment. This paper presents results from a study exploring the importance of the “hands-on” aspect of a hands-on modeling curriculum we have been developing that spans several topics in statics. The curriculum integrates deep conceptual exploration with analysis procedure tutorials and aims to scaffold students’ development of representational competence, the ability to use multiple representations of a concept as appropriate for learning, problem solving, and communication. We conducted this study over two subsequent terms in an online statics course taught in the context of remote learning amidst the COVID-19 pandemic. The intervention section used a take-home adaptation of the original classroom curriculum. This adaptation consisted of eight activity worksheets with a supplied kit of manipulatives and model-building supplies students could use to construct and explore concrete representations of figures and diagrams used in the worksheets. In contrast, the control section used activity worksheets nearly identical to those used in the hands-on curriculum, but without the associated modeling parts kit. We only made minor revisions to the worksheets to remove reference to the models. The control and intervention sections were otherwise identical in how they were taught by the same instructor. We compare learning outcomes between the two sections as measured via pre-post administration of a test of 3D vector concepts and representations called the Test of Representational Competence with Vectors (TRCV). We also compare end of course scores on the Concept Assessment Test in Statics (CATS) and final exam scores. In addition, we analyze student responses on two “multiple choice plus explain” concept questions paired with each of five activities covering the topics of 3D moments, 3D particle equilibrium, rigid body equilibrium (2D and 3D), and frame analysis (2D). The mean pre/post gain across all ten questions was higher for the intervention section, with the largest differences observed on questions relating to 3D rigid body equilibrium. Students in the intervention section also made larger gains on the TRCV and scored better on the final exam compared to the control section, but these results are not statistically significant perhaps due to the small study population. There were no appreciable differences in end-of-course CATS scores. We also present student feedback on the activity worksheets that was slightly more positive for the versions with the models. 
    more » « less
  4. Several consensus reports cite a critical need to dramatically increase the number and diversity of STEM graduates over the next decade. They conclude that a change to evidence-based instructional practices, such as concept-based active learning, is needed. Concept-based active learning involves the use of activity-based pedagogies whose primary objectives are to make students value deep conceptual understanding (instead of only factual knowledge) and then to facilitate their development of that understanding. Concept-based active learning has been shown to increase academic engagement and student achievement, to significantly improve student retention in academic programs, and to reduce the performance gap of underrepresented students. Fostering students' mastery of fundamental concepts is central to real world problem solving, including several elements of engineering practice. Unfortunately, simply proving that these instructional practices are more effective than traditional methods for promoting student learning, for increasing retention in academic programs, and for improving ability in professional practice is not enough to ensure widespread pedagogical change. In fact, the biggest challenge to improving STEM education is not the need to develop more effective instructional practices, but to find ways to get faculty to adopt the evidence-based pedagogies that already exist. In this project we seek to propagate the Concept Warehouse, a technological innovation designed to foster concept-based active learning, into Mechanical Engineering (ME) and to study student learning with this tool in five diverse institutional settings. The Concept Warehouse (CW) is a web-based instructional tool that we developed for Chemical Engineering (ChE) faculty. It houses over 3,500 ConcepTests, which are short questions that can rapidly be deployed to engage students in concept-oriented thinking and/or to assess students’ conceptual knowledge, along with more extensive concept-based active learning tools. The CW has grown rapidly during this project and now has over 1,600 faculty accounts and over 37,000 student users. New ConcepTests were created during the current reporting period; the current numbers of questions for Statics, Dynamics, and Mechanics of Materials are 342, 410, and 41, respectively. A detailed review process is in progress, and will continue through the no-cost extension year, to refine question clarity and to identify types of new questions to fill gaps in content coverage. There have been 497 new faculty accounts created after June 30, 2018, and 3,035 unique students have answered these mechanics questions in the CW. We continue to analyze instructor interviews, focusing on 11 cases, all of whom participated in the CW Community of Practice (CoP). For six participants, we were able to compare use of the CW both before and after participating in professional development activities (workshops and/or a community or practice). Interview results have been coded and are currently being analyzed. To examine student learning, we recruited faculty to participate in deploying four common questions in both statics and dynamics. In statics, each instructor agreed to deploy the same four questions (one each for Rigid Body Equilibrium, Trusses, Frames, and Friction) among their overall deployments of the CW. In addition to answering the question, students were also asked to provide a written explanation to explain their reasoning, to rate the confidence of their answers, and to rate the degree to which the questions were clear and promoted deep thinking. The analysis to date has resulted in a Work-In-Progress paper presented at ASEE 2022, reporting a cross-case comparison of two instructors and a Work-In-Progress paper to be presented at ASEE 2023 analyzing students’ metacognitive reflections of concept questions. 
    more » « less
  5. Instructor-led presentation-based teaching mainly focuses on delivering content. Whereas student active presentations-based teaching approaches require students to take leadership in learning actions. Many teaching and learning strategies were adopted to foster active student participation during in-class learning activities. We developed the student presentation-based effective teaching (SPET) approach in 2014 to make student presentation activity the central element of learning challenging concepts. We have developed several versions to meet the need for teaching small classes (P. Tyagi, "Student Presentation Based Effective Teaching (SPET) Approach for Advanced Courses," in ASME IMECE 2016-66029, V005T06A026), large enrolment classes (P. Tyagi, "Student Presentation Based Teaching (SPET) Approach for Classes With Higher Enrolment," ASME IMECE 2018-88463, V005T07A035), and online teaching during COVID-19. (P. Tyagi, "Second Modified Student Presentation Based Effective Teaching (SPET) Method Tested in COVID-19 Affected Senior Level Mechanical Engineering Course," in ASME IMECE 2020-23615, V009T09A026). The SPET approach has successfully engaged students with varied interests and competence levels in the learning process. SPET approach has also made it possible to cover new topics such as training engineering students about positive intelligence skills to foster lifelong learning aptitude and doing engineering projects in a group setting. However, it was noted that many students who were overwhelmed with parallel academic demands in other courses and different activities were underperforming via SPET-based learning strategies. SPET core functioning depends on the following steps: Step 1: Provide a set of conceptual and topical questions for students to answer individually after self-education from the recommended textbook or course material, Step-2: Group presentations are prepared by the prepared students for in-class discussion, Step-3: Group makes a presentation in class 1-2 weeks after the day of the assignment to seek instructor feedback and to do peer discussion. The instructor noted that students unfamiliar with the new concepts and terminologies in the SPET assignment struggled to respond to questions individually and contribute to the group discussion based on their presentation. Several motivated students who invested time in familiarizing new concepts and terminologies met or exceeded the expectations. However, a significant student population struggled. To alleviate this issue author has implemented a further improvement in SPET approach. This paper reports teaching experiments conducted in MECH 487 Photovoltaic Cells and Solar Thermal Energy System and MECH 462 Design of Energy Systems course. This improvement requires augmenting SPET with instructor-led concept familiarization discussion on the day of issuing the assignment or close to that; for this step instructor utilized exemplary student work from prior SPET-based teaching of the same course. In the survey, many students expressed their views about the improvement and reported introductory discussions were helpful and addressed several reservations and impediments students encountered. This paper will discuss the structure of the new improvement strategy and outcomes-including student feedback and comments. 
    more » « less