Search for: All records

As the use of computers in education increases, adaptive learning platforms are becoming more common. However, these adaptive systems are typically designed to support acquisition of declarative knowledge and/or procedural fluency but rarely address conceptual learning. In this work, we developed the Crystallography Adaptive Learning Module (CALM) for materials science to provide students a tool for individualized conceptual learning. We used a randomized quasi‐experimental design comparing two instructional designs with different levels of computer‐provided direction and student agency. Undergraduate students were randomly assigned to one of two different instructional designs; one design had students complete an individualized, adaptive path using the CALM (N = 80), and the other gave students the freedom to explore CALM's learning resources but with limited guidance (N = 85). Within these two designs, we also investigated students among different cumulative grade point average (GPA) groups. While there was no statistically significant difference in the measure of conceptual understanding between instructional designs or among the groups with the same GPA, there is evidence to suggest the CALM improves conceptual understanding of students in the middle GPA group. Students using CALM also showed increased participation with the interactive learning videos compared to the other design. The number of videos watched in each instructional condition aligns with overall academic performance as the low GPA group received the most assigned supplements but watched the least videos by choice. This study provides insight for technology developers on how to develop educational adaptive technology systems that provide a proper level of student agency to promote conceptual understanding in challenging STEM topics.

 

Professional engineering demands more than the ability to proficiently carry out engineering calculations. Engineers need to approach problems with a holistic view, make decisions based on evidence, collaborate effectively in teams, and learn from setbacks. Laboratory work plays a crucial role in shaping the professional development of university engineering students, as it enables them to cultivate these essential practices. A successful laboratory task design should provide students opportunities to develop these practices but also needs to adhere to the constraints of the educational environment. In this project, we explore how both virtual (simulation-based) and physical (hands-on) laboratories, based on the same real-world engineering process, prepare students for their future careers. Specifically, we seek to determine whether the virtual and physical laboratory modes foster different yet complementary epistemic practices. Epistemic practices refer to the ways in which group members propose, communicate, justify, assess, and validate knowledge claims in a socially organized and interactionally accomplished manner. To accomplish these objectives, we are conducting a microgenetic analysis of student teams engaging in both the virtual and physical versions of the same laboratory exercise, the Jar Test for Drinking Water Treatment. Jar testing is a standard laboratory procedure used by design engineers and water treatment plant operators to optimize the physical and chemical conditions for the effective removal of particulate contaminants from water through coagulation, flocculation, and settling. The central hypothesis guiding this research is that physical laboratories emphasize social and material epistemic practices, while virtual laboratories highlight social and conceptual epistemic practices. The goal is to gain transferable knowledge about how the laboratory format and instructional design influence students' engagement in epistemic practices. To date we have developed physical and virtual versions of the Jar Test laboratory, each built around the affordances of their respective modes. We have completed two rounds of data collection resulting in data from 21 students (7 groups of 3). The primary data sources have included video recordings and researcher observations of the teams during the laboratory work, semi-structured stimulated recall interviews with students and laboratory instructors, and student work products. Using discourse analysis methods within a sociocultural framework, we are addressing the following research questions: 1. In what ways and to what extent does conducting an experiment in a physical mode to develop a process recommendation influence students’ engineering epistemic practices? 2. In what ways and to what extent does conducting an experiment in a virtual mode to develop a process recommendation influence students’ engineering epistemic practices? 3. How do students in each laboratory mode respond to being “stuck”? Do students’ views on the iterative nature of science/engineering and their tolerance for mistakes depend on the instructional design afforded by the laboratory mode? While this study focuses on a process specific to environmental engineering, its findings have the potential to positively impact teaching and learning practices across all engineering and science disciplines that rely on laboratory investigations in their curriculum. 

We use qualitative methods to investigate students’ engagement in an upper-division laboratory. Laboratory activities are recognized as key curricular elements in engineering education. These activities have traditionally been delivered in person, but new laboratory modalities (such as virtual laboratories) have been gaining popularity, boosted by the COVID-19 pandemic. Understanding how laboratory modality influences student learning is important to be able to design and implement effective laboratories. While some educators have investigated if virtual laboratories can replace their analogous physical laboratory counterparts, others have looked at using virtual laboratories in combination with physical laboratories. Taking this latter approach, they argue the two modes have different affordances and therefore could be complementary - meaning that each mode may lend itself to more effectively engaging students in certain productive practices. We have previously reported on the development of two environmental engineering laboratories, one physical and one virtual. Both laboratories address the topic of jar testing, an important process in drinking water treatment, with the design of each mode being based on that mode's affordances. These laboratories were implemented in an upper-level chemical engineering course. Twelve students split into four groups consented to be audio and video recorded during their time in the laboratory and have the work they turn in collected, with most also volunteering to be interviewed about their experiences. A first pass of this data has been completed in which we viewed learning from the lens of participation in disciplinary practice. We applied the theory of engineering epistemic practices, which are the socially organized and interactionally accomplished ways engineers develop, justify, and communicate ideas when completing engineering work. Transcripts of the laboratory observations were coded to identify students’ engagement with specific epistemic practices, which were categorized as either conceptual, material, or social. These codes were then counted and cross-validated with interview responses to draw conclusions about how student's engagement differed in each mode. This prior research has indicated that students engage with each design using different epistemic practices. While the first pass analysis showed differences in counts of epistemic practices between modes, it provided limited insight into how and why the epistemic practices are elicited and coordinated among students. In this paper, we extend the discourse analysis by illustrating our developing methodology for a second pass analysis of the video recordings. We seek to develop a thick description by identifying how particular epistemic practices fit together temporally and serve to promote or hinder students’ progress. Engagement in epistemic practices does not happen in a vacuum and instead happens contextually, influenced by students' previous engagement and the laboratory environment and their social and academic history. This analysis allows a deeper understanding of how students engage in engineering practice while completing laboratories, knowledge that can be applied to enhance engineering physical and virtual laboratory instruction and design. Additionally, this work contributes to the methodological conversation of ways to use interaction analyses to extract understanding from a rich set of qualitative data. 

Laboratory activities are central to undergraduate student learning in science and engineering. With advancements in computer technology, many laboratory activities have shifted from providing students experiments in a physical mode to providing them in a virtual mode. Further, physical and virtual modes can be combined to address a single topic, as the modes have complementary affordances. In this paper, we report on the design and implementation of a physical and virtual laboratory on the topic of jar testing, a common process for drinking water treatment. The assignment for each laboratory mode was designed to leverage the mode’s affordances. Correspondingly, we hypothesized each would elicit a different subset of engineering epistemic practices. In a naturalistic, qualitative study design based on laboratory mode (physical or virtual) and laboratory order (virtual first or physical first), we collected process, product, and reflection data of students’ laboratory activity. Taking an orientation that learning is participation in valued disciplinary practice, data were coded and used to characterize how students engaged with each laboratory mode. Results showed that the virtual laboratory elicited more conceptual epistemic practices and the physical laboratory more material epistemic practices, aligning with the affordances of each mode. When students completed the laboratory in the virtual mode first, students demonstrated greater engagement in epistemic practices and more positive perceptions of their learning experience in the virtual mode than when they completed the physical mode first. In contrast, engagement in the physical mode was mostly unaffected by the laboratory order. 

The shift to remote teaching with the COVID-19 pandemic has made delivery of concept-based active learning more challenging, especially in large-enrollment engineering classes. I report here a modification in the Concept Warehouse to support delivery of concept questions. The new feature allows instructors to make students’ reasoning visible to other students by showing selected written explanations to conceptually challenging multiple-choice questions. Data were collected for two large-enrollment engineering classes where examples are shown to illustrate how displaying written explanations can provide a resource for students to develop multi-variate reasoning skills. 

In engineering design, engineers must be able to think creatively, effectively toggling between divergent thinking (developing multiple novel ideas) and convergent thinking (pursuing an appropriate idea using engineering analyses). However, creative thinking is not emphasized in many undergraduate engineering programs. In this empirical study, we analyze the divergent thinking of teams working on a virtual laboratory project. Fifteen student teams' solution paths–as represented by Model Maps–were analyzed to characterize and compare the various elements of divergent thinking: fluency, flexibility, and originality. The solution paths of these teams were compared in two physical laboratory projects and to experts completing the same virtual laboratory project. We found that students demonstrated more divergent thinking in the virtual laboratory project than in the physical laboratory projects; yet, divergent thinking and quality of solution did not correlate. There was little difference between measured elements of divergent thinking between student teams and experts.