skip to main content


Title: Developing Best Practices for Teaching Scientific Documentation: Toward a Better Understanding of How Lab Notebooks Contribute to Knowledge-building in Engineering Design and Experimentation
Laboratory notebooks perform important roles in the engineering disciplines. They at once record an engineer’s work, serve as an important reference for future reports and/or articles, and perform as a kind of journal that enables questioning presuppositions, considering new approaches, and generating new ideas. Given the importance of notebooks, there is surprisingly little scholarship on how to teach their use. Stanley and Lewandowski (2016) surveyed students in undergraduate laboratory courses and evaluated how their notebooks were being used. They found that “few [students] … thought that their lab classes successfully taught them the benefit of maintaining a lab notebook.” Moreover, the authors’ later survey of the literature and of college faculty led them to conclude that in undergraduate lab courses “little formal attention has been paid to addressing what is considered ‘best practice’ for scientific documentation …[or] how researchers come to learn these practices” (Stanley and Lewandowski, 2018). At XXX University, two courses, Interfacing the Digital Domain with the Analog World (AEP 2640) and Engineering Communications (ENGRC 2640) are taught in conjunction. In AEP 2640, students use a computer to control equipment and acquire measurements in an engineering design and experimentation laboratory. Laboratory activities such as the development of a computer interface for an oscilloscope, a set of motors, and a photodiode culminate in the realization of an automated laser scanning microscope system. In ENGRC 2640, students receive instruction and feedback on their lab notebook entries and, in turn, use those notebooks as a resource for preparing a Progress Report and an Instrument Design Report. The instructors encourage peer review in order to facilitate improvement of students’ skills in the art of notebook use while allowing them to develop these skills and personal style through trial and error during the research. The primary learning objectives are: 1) to enable students to engage in real laboratory research; and 2) to develop proficiency with select genres associated with that research. The educational research objectives are: 1) to study students’ developing proficiency in order to generate best practices for teaching and learning scientific documentation; and 2) to better understand the contribution of scientific documentation to the teaching and learning of authentic research. This study is a work-in-progress. We will present the study design. That design involves, first, developing a self-efficacy scale for both conducting laboratory research and performing those genres associated with that research. Self-efficacy or a “person’s awareness of their ability to accomplish a goal” (Kolar et. al, 2013) has proven to be a powerful predictor of achievement. Our intent is to track learner agency. Second, the design also involves conducting a content analysis of students’ laboratory notebooks and reports. Content analysis is a methodology that encourages inferencing "across distinct domains, from particulars of one kind to particulars of another kind" (Krippendorff,, 2019). Our intent is to learn about students' mastery of the engineering design and experimentation process through analyzing their lab notebooks. We will present the results of a preliminary content analysis of a select sample of those notebooks and genres.  more » « less
Award ID(s):
1944653
NSF-PAR ID:
10211170
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
2020 ASEE Virtual Annual Conference Content Access Proceedings
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Responding to the need to teach remotely due to COVID-19, we used readily available computational approaches (and developed associated tutorials (https://mdh-cures-community.squarespace.com/virtual-cures-and-ures)) to teach virtual Course-Based Undergraduate Research Experience (CURE) laboratories that fulfil generally accepted main components of CUREs or Undergraduate Research Experiences (UREs): Scientific Background, Hypothesis Development, Proposal, Experiments, Teamwork, Data Analysis, Conclusions, and Presentation1. We then developed and taught remotely, in three phases, protein-centric CURE activities that are adaptable to virtually any protein, emphasizing contributions of noncovalent interactions to structure, binding and catalysis (an ASBMB learning framework2 foundational concept). The courses had five learning goals (unchanged in the virtual format),focused on i) use of primary literature and bioinformatics, ii) the roles of non-covalent interactions, iii) keeping accurate laboratory notebooks, iv) hypothesis development and research proposal writing, and, v) presenting the project and drawing evidence based conclusions The first phase, Developing a Research Proposal, contains three modules, and develops hallmarks of a good student-developed hypothesis using available literature (PubMed3) and preliminary observations obtained using bioinformatics, Module 1: Using Primary Literature and Data Bases (Protein Data Base4, Blast5 and Clustal Omega6), Module 2: Molecular Visualization (PyMol7 and Chimera8), culminating in a research proposal (Module 3). Provided rubrics guide student expectations. In the second phase, Preparing the Proteins, students prepared necessary proteins and mutants using Module 4: Creating and Validating Models, which leads users through creating mutants with PyMol, homology modeling with Phyre29 or Missense10, energy minimization using RefineD11 or ModRefiner12, and structure validation using MolProbity13. In the third phase, Computational Experimental Approaches to Explore the Questions developed from the Hypothesis, students selected appropriate tools to perform their experiments, chosen from computational techniques suitable for a CURE laboratory class taught remotely. Questions, paired with computational approaches were selected from Modules 5: Exploring Titratable Groups in a Protein using H++14, 6: Exploring Small Molecule Ligand Binding (with SwissDock15), 7: Exploring Protein-Protein Interaction (with HawkDock16), 8: Detecting and Exploring Potential Binding Sites on a Protein (with POCASA17 and SwissDock), and 9: Structure-Activity Relationships of Ligand Binding & Drug Design (with SwissDock, Open Eye18 or the Molecular Operating Environment (MOE)19). All involve freely available computational approaches on publicly accessible web-based servers around the world (with the exception of MOE). Original literature/Journal club activities on approaches helped students suggest tie-ins to wet lab experiments they could conduct in the future to complement their computational approaches. This approach allowed us to continue using high impact CURE teaching, without changing our course learning goals. Quantitative data (including replicates) was collected and analyzed during regular class periods. Students developed evidence-based conclusions and related them to their research questions and hypotheses. Projects culminated in a presentation where faculty feedback was facilitated with the Virtual Presentation platform from QUBES20 These computational approaches are readily adaptable for topics accessible for first to senior year classes and individual research projects (UREs). We used them in both partial and full semester CUREs in various institutional settings. We believe this format can benefit faculty and students from a wide variety of teaching institutions under conditions where remote teaching is necessary. 
    more » « less
  2. This fundamental research in pre-college education engineering study investigates the ways in which elementary teachers learn about engineering by engaging in the epistemic practices of engineers. Teaching engineering explicitly in elementary settings is a paradigm shift, as most K-6 teachers are not taught about engineering in their preparation programs and did not do classroom engineering as students. However, current STEM education reforms require these teachers to teach engineering in science settings and it will require concerted efforts between professional development providers and educational researchers to better help these teachers learn about and teach engineering to their students. Our study context consisted of 18 2nd and 4th grade teachers participating in one of two two-day workshops. The first day focused on what engineering is, what the epistemic practices of engineering are, and how to manage classroom engineering projects. The second day focused on how to teach a specific engineering unit for their grade level. Taking a sociomaterial view of learning, we asked the following research questions: 1. How do the engineering notebooks scaffold the teachers activities and discourse? 2. How and to what extent does the notebook support their engagement in engineering practices? Our analysis triangulated between three data sources during a two-hour time period where teachers designed, tested, and improved enclosures intended to minimize cost and mass loss of an ice cube in a heat chamber (“Perspiring Penguins” (Schnittka, 2010)). We focused on teacher talk/action collected from video/audio recordings trained on four small groups (10 total teachers). We also collected engineering notebooks they used during this activity. After initial analyses, we followed up with select teachers with targeted interview questions to focus on clarification of questions that arose. Our findings suggest that the teachers use the notebooks in ways that are significantly different from the ways engineers do; however, they are a useful pedagogical tool that supported them in attending to and discussing activities that were necessary to engage in engineering practices and design/re-design their technology. Additionally, our paper will describe specific examples where teachers had rich discussions that were not represented in the notebooks but there were references made in the notebooks that were not explicitly discussed. Implications for the importance of well-designed notebooks and the benefits of ethnographic methods for researching teacher learning will be discussed. 
    more » « less
  3. Problem-solving is a critical skill in the workplace, but recent college graduates are often deficient in problem-solving skills. Introductory STEM courses present engineering students with well-structured problems with single-path solutions that do not prepare students with the problem-solving skills they will need to solve complex problems within authentic engineering contexts. When presented with complex problems in authentic contexts, engineering students find it difficult to transfer the scientific knowledge learned in their STEM courses to solve these integrated and ill structured problems. By integrating physics laboratories with engineering design problems, students are taught to apply physics principles to solve ill-structured and complex engineering problems. The integration of engineering design processes to physics labs is meant to help students transfer physics learning to engineering problems, as well as to transfer the design skills learned in their engineering courses to the physics lab. We hypothesize this integration will help students become better problem solvers when they go out to industry after graduation. The purpose of this study is to examine how students transfer their understanding of physics concepts to solve ill-structured engineering problems by means of an engineering design project in a physics laboratory. We use a case-study methodology to examine two cases and analyze the cases using a lens of co-regulated learning and transfer between physics and engineering contexts. Observations were conducted using transfer lenses. That is, we observed groups during the physics labs for evidence of transfer. The research question for this study was, to what extent do students relate physics concepts with concepts from other materials (classes) through an engineering design project incorporated in a physics laboratory? Teams were observed over the course of 6 weeks as they completed the second design challenge. The cases presented in this study were selected using observations from the lab instructors of the team’s work in the first design project. Two teams, one who performed well, and one that performed poorly, were selected to be observed to provide insight on how students use physics concepts to engage in the design process. The second design challenge asked students to design an eco-friendly way of delivering packages of food to an island located in the middle of the river, which is home to critically endangered species. They are given constraints that the solution cannot disrupt the habitat in any way, nor can the animals come into contact directly with humans or loud noises. Preliminary results indicate that both teams successfully demonstrated transfer between physics and engineering contexts, and integrated physics concepts from multiple labs to complete the design project. Teams that struggle seem to be less connected with the design process at the beginning of the project and are less organized. In contrast, teams that are successful demonstrate greater co-regulated learning (communication, reflection, etc.) and focus on making connections between the physics concepts and principles of engineering design from their engineering course work. 
    more » « less
  4. Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction. 
    more » « less
  5. A solid understanding of electromagnetic (E&M) theory is key to the education of electrical engineering students. However, these concepts are notoriously challenging for students to learn, due to the difficulty in grasping abstract concepts such as the electric force as an invisible force that is acting at a distance, or how electromagnetic radiation is permeating and propagating in space. Building physical intuition to manipulate these abstractions requires means to visualize them in a three-dimensional space. This project involves the development of 3D visualizations of abstract E&M concepts in Virtual Reality (VR), in an immersive, exploratory, and engaging environment. VR provides the means of exploration, to construct visuals and manipulable objects to represent knowledge. This leads to a constructivist way of learning, in the sense that students are allowed to build their own knowledge from meaningful experiences. In addition, the VR labs replace the cost of hands-on labs, by recreating the experiments and experiences on Virtual Reality platforms. The development of the VR labs for E&M courses involves four distinct phases: (I) Lab Design, (II) Experience Design, (III) Software Development, and (IV) User Testing. During phase I, the learning goals and possible outcomes are clearly defined, to provide context for the VR laboratory experience, and to identify possible technical constraints pertaining to the specific laboratory exercise. During stage II, the environment (the world) the player (user) will experience is designed, along with the foundational elements, such as ways of navigation, key actions, and immersion elements. During stage III, the software is generated as part of the course projects for the Virtual Reality course taught in the Computer Science Department at the same university, or as part of independent research projects involving engineering students. This reflects the strong educational impact of this project, as it allows students to contribute to the educational experiences of their peers. During phase IV, the VR experiences are played by different types of audiences that fit the player type. The team collects feedback and if needed, implements changes. The pilot VR Lab, introduced as an additional instructional tool for the E&M course during the Fall 2019, engaged over 100 students in the program, where in addition to the regular lectures, students attended one hour per week in the E&M VR lab. Student competencies around conceptual understanding of electromagnetism topics are measured via formative and summative assessments. To evaluate the effectiveness of VR learning, each lab is followed by a 10-minute multiple-choice test, designed to measure conceptual understanding of the various topics, rather than the ability to simply manipulate equations. This paper discusses the implementation and the pedagogy of the Virtual Reality laboratory experiences to visualize concepts in E&M, with examples for specific labs, as well as challenges, and student feedback with the new approach. We will also discuss the integration of the 3D visualizations into lab exercises, and the design of the student assessment tools used to assess the knowledge gain when the VR technology is employed. 
    more » « less