skip to main content


Title: Investigating the impact of three-dimensional learning interventions on student understanding of structure–property relationships
The ability to predict macroscopic properties using a compound's chemical structure is an essential idea for chemistry as well as other disciplines such as biology. In this study we investigate how different levels of interventions impact the components of students’ explanations (claims, evidence, and reasoning) of structure–property relationships, particularly related to boiling point trends. These interventions, aligned with Three-Dimensional Learning (3DL), were investigated with four different cohorts of students: Cohort 1 – a control group of students enrolled in an active learning general chemistry course; Cohort 2 – students enrolled in the same active learning general chemistry course but given Intervention 1 (a 3DL worksheet administered during class time); Cohort 3 – students enrolled in the same active learning general chemistry course but given Intervention 1 and Intervention 2 (a 3DL course exam question administered after instruction); and Cohort 4 – a reference group of students enrolled in a transformed active learning general chemistry curriculum in which 3DL is an essential feature and includes Intervention 1 and Intervention 2 as part of the curriculum. We found that Cohort 2 students (with the 3DL worksheet intervention) were more likely than the control group (Cohort 1) to correctly predict the compound with a higher boiling point as well as incorporate ideas of strength of intermolecular forces into their explanations of boiling point differences. When a 3DL exam question was given as a follow up to the 3DL worksheet, students in Cohort 3 were more likely than Cohorts 1 and 2 to correctly identify the claim. Further comparison showed that Cohort 4 (transformed general chemistry curriculum) were more likely than Cohorts 1–3 to also include the ideas of energy needed to overcome stronger forces for a more sophisticated explanation (50% of Cohort 4 students compared to 17–33% for Cohorts 1–3). In addition, 80% of Cohort 4 students were able to construct a correct representation of hydrogen bonding as a non-covalent interaction compared to 13–57% for the other three cohorts.  more » « less
Award ID(s):
1725520 1726360 1725609
NSF-PAR ID:
10290156
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Chemistry Education Research and Practice
Volume:
22
Issue:
2
ISSN:
1109-4028
Page Range / eLocation ID:
247 to 262
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. POSTER. Presented at the Symposium (9/12/2019) Abstract: The Academy of Engineering Success (AcES) employs literature-based, best practices to support and retain underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. AcES was established in 2012 and has been supported via NSF S-STEM award number 1644119 since 2016. The 2016, 2017, and 2018 cohorts consist of 12, 20, and 22 students, respectively. Five S-STEM supported scholarships were awarded to the 2016 cohort, seven scholarships were awarded to students from the 2017 cohort, and six scholarships were awarded to students from the 2018 cohort. AcES students participate in a one-week summer bridge experience, a common fall semester course focused on professional development, and a common spring semester course emphasizing the role of engineers in societal development. Starting with the summer bridge experience, and continuing until graduation, students are immersed in curricular and co-curricular activities with the goals of fostering feelings of institutional inclusion and belonging in engineering, providing academic support and student success skills, and professional development. The aforementioned goals are achieved by providing (1) opportunities for faculty-student, student-student, and industry mentor-student interaction, (2) academic support, and student success education in areas such as time management and study skills, and (3) facilitated career and major exploration. Four research questions are being examined, (1) What is the relationship between participation in the AcES program and participants’ academic success?, (2) What aspects of the AcES program most significantly impact participants’ success in engineering, (3) How do AcES students seek to overcome challenges in studying engineering, and (4) What is the longitudinal impact of the AcES program in terms of motivation, perceptions, feelings of inclusion, outcome expectations of the participants and retention? Students enrolled in the AcES program participate in the GRIT, LAESE, and MSLQ surveys, focus groups, and one-on-one interviews at the start and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, general self-efficacy, engineering self-efficacy, test anxiety, math outcome efficacy, intrinsic value of learning, inclusion, career expectations, and coping efficacy. Focus group and interview responses are analyzed in order to answer research questions 2, 3, and 4. Survey responses are analyzed to answer research question 4, and institutional data such as GPA is used to answer research question 1. An analysis of the 2017 AcES cohort survey responses produced a surprising result. When the responses of AcES students who retained were compared to the responses of AcES students who left engineering, those who left engineering had higher baseline values of GRIT, career expectations, engineering self-efficacy, and math outcome efficacy than those students who retained. A preliminary analysis of the 2016, 2017, and 2018 focus group and one-on-one interview responses indicates that the Engineering Learning Center, tutors, organized out of class experiences, first-year seminar, the AcES cohort, the AcES summer bridge, the AcES program, AcES Faculty/Staff, AcES guest lecturers, and FEP faculty/Staff are viewed as valuable by students and cited with contributing to their success in engineering. It is also evident that AcES students seek help from peers, seek help from tutors, use online resources, and attend office hours to overcome their challenges in studying engineering. 
    more » « less
  2. This study is a follow up to two earlier studies characterizing student real-time use of mechanistic arrows. In these previous studies, students were asked to predict a product by drawing a curved arrow mechanism using an interface that allowed recording and replay of student actions. In the present study two different student cohorts responded to the same tasks as the original studies: a cohort who were enrolled in a traditional organic course, and a cohort who were part of a transformed organic course (Organic Chemistry, Life, the Universe and Everything, OCLUE). Both cohorts improved in their ability to predict an appropriate product over the two semesters, and we found little meaningful difference in the ability of students from either cohort to predict the outcome of a familiar reaction. However, students in the OCLUE cohort were more likely to draw mechanistic arrows than the students from the traditional course. In contrast, when the task involved predicting the product of an unfamiliar reaction, OCLUE students were over three times more likely to draw mechanistically reasonable steps and produce a plausible product than students from the traditional cohort. We propose that the differences between the two cohorts emerge from the following: (1) explicit attempts in the OCLUE course to link drawing reactions mechanisms using the electron pushing formalism to the scientific practice of constructing explanations. It is our contention that this approach changes the arrow pushing mechanism from a skill to the construction of a model which students can use to predict and explain outcomes; and (2) the numerous opportunities in the OCLUE course to try out ideas without penalty, leading to a willingness to try to determine outcomes in unfamiliar situations. 
    more » « less
  3. There is a critical need for more students with engineering and computer science majors to enter into, persist in, and graduate from four-year postsecondary institutions. Increasing the diversity of the workforce by inclusive practices in engineering and science is also a profound identified need. According to national statistics, the largest groups of underrepresented minority students in engineering and science attend U.S. public higher education institutions. Most often, a large proportion of these students come to colleges and universities with unique challenges and needs, and are more likely to be first in their family to attend college. In response to these needs, engineering education researchers and practitioners have developed, implemented and assessed interventions to provide support and help students succeed in college, particularly in their first year. These interventions typically target relatively small cohorts of students and can be managed by a small number of faculty and staff. In this paper, we report on “work in progress” research in a large-scale, first-year engineering and computer science intervention program at a public, comprehensive university using multivariate comparative statistical approaches. Large-scale intervention programs are especially relevant to minority serving institutions that prepare growing numbers of students who are first in their family to attend college and who are also under-resourced, financially. These students most often encounter academic difficulties and come to higher education with challenging experiences and backgrounds. Our studied first-year intervention program, first piloted in 2015, is now in its 5th year of implementation. Its intervention components include: (a) first-year block schedules, (b) project-based introductory engineering and computer science courses, (c) an introduction to mechanics course, which provides students with the foundation needed to succeed in a traditional physics sequence, and (d) peer-led supplemental instruction workshops for calculus, physics and chemistry courses. This intervention study responds to three research questions: (1) What role does the first-year intervention’s components play in students’ persistence in engineering and computer science majors across undergraduate program years? (2) What role do particular pedagogical and cocurricular support structures play in students’ successes? And (3) What role do various student socio-demographic and experiential factors play in the effectiveness of first-year interventions? To address these research questions and therefore determine the formative impact of the firstyear engineering and computer science program on which we are conducting research, we have collected diverse student data including grade point averages, concept inventory scores, and data from a multi-dimensional questionnaire that measures students’ use of support practices across their four to five years in their degree program, and diverse background information necessary to determine the impact of such factors on students’ persistence to degree. Background data includes students’ experiences prior to enrolling in college, their socio-demographic characteristics, and their college social capital throughout their higher education experience. For this research, we compared students who were enrolled in the first-year intervention program to those who were not enrolled in the first-year intervention. We have engaged in cross-sectional 2 data collection from students’ freshman through senior years and employed multivariate statistical analytical techniques on the collected student data. Results of these analyses were interesting and diverse. Generally, in terms of backgrounds, our research indicates that students’ parental education is positively related to their success in engineering and computer science across program years. Likewise, longitudinally (across program years), students’ college social capital predicted their academic success and persistence to degree. With regard to the study’s comparative research of the first-year intervention, our results indicate that students who were enrolled in the first-year intervention program as freshmen continued to use more support practices to assist them in academic success across their degree matriculation compared to students who were not in the first-year program. This suggests that the students continued to recognize the value of such supports as a consequence of having supports required as first-year students. In terms of students’ understanding of scientific or engineering-focused concepts, we found significant impact resulting from student support practices that were academically focused. We also found that enrolling in the first-year intervention was a significant predictor of the time that students spent preparing for classes and ultimately their grade point average, especially in STEM subjects across students’ years in college. In summary, we found that the studied first-year intervention program has longitudinal, positive impacts on students’ success as they navigate through their undergraduate experiences toward engineering and computer science degrees. 
    more » « less
  4. When students repeatedly reflect, it can enhance their metacognitive abilities, including self-regulatory skills of planning, monitoring, and evaluating. In a fluid mechanics course for undergraduates at a large southeastern U.S. university, in-class problem solving in a flipped classroom was coupled with intentional metacognitive skills instruction and repeated reflection to enhance metacognition. The weekly reflective responses were coded by two analysts to identify the recurring themes and uncover evidence of the development and/or reinforcement of self-regulating behaviors for academic management. To enable a comparison, a flipped classroom without the metacognitive instruction and repeated reflection was also implemented (i.e., non-intervention group). The two cohorts completed identical final exams. Based on our preliminary analysis with year one data, a statistically and practically-significant difference between the two cohorts was found with the free-response scores on the final exam in favor of the intervention cohort that had received the metacognitive support ( p < 0.0005; Cohen's d = 0.72). Also, the Metacognitive Activities Inventory (MCAI) indicated a significantly-higher positive change in self-regulatory behavior for the intervention cohort ( p = 0.001; d = 0.50). Focus groups were conducted to gather students’ perspectives on the reflective activity, with differences found by demographic group. In addition, a significantly higher proportion of females (versus males) viewed the reflections in a positive manner ( p = 0.05). Significant associations between themes in the weekly reflections and direct knowledge measures were also uncovered. This included a positive relationship between academic self-management (i.e., diligence and carefulness) and exam performance. Overall, our preliminary results point to a desirable impact of metacognitive instruction and repeated reflection on knowledge outcomes, metacognitive skills, and self-regulatory behaviors.

     
    more » « less
  5. Abstract This “work in progress” paper describes a multiyear project to study the development of engineering identity in a chemical and biological engineering program at Montana State University. The project focuses on how engineering identity may be impacted by a series of interventions utilizing subject material in a senior-level capstone design course and has the senior capstone design students serve as peer-mentors to first- and second-year students. A more rapid development of an engineering identity by first- and second-year students is suspected to increase retention and persistence in this engineering program. Through a series of timed interventions scheduled to take place in the first and second year, which includes cohorts that will serve as negative controls (no intervention), we hope to ascertain the following: (1) the extent to which, relative to a control group, exposure to a peer mentor increases a students’ engineering identity development over time compared to those who do not receive peer mentoring and (2) if the quantity and/or timing of the peer interactions impact engineering identity development. While the project includes interventions for both first- and second-year students, this work in progress paper focuses on the experiences of first year freshman as a result of the interventions and their development of an engineering identity over the course of the semester. Early in the fall semester, freshman chemical engineering students enrolled in an introductory chemical engineering course and senior students in a capstone design course were administered a survey which contained a validated instrument to assess engineering identity. The first-year course has 107 students and the senior-level course has 92 students and approximately 50% of the students in both cohorts completed the survey. Mid-semester, after the first-year students were introduced to the concepts of process flow diagrams and material balances in their course, senior design student teams gave presentations about their capstone design projects in the introductory course. The presentations focused on the project goals, design process and highlighted the process flow diagrams. After the presentations, freshman and senior students attended small group dinners as part of a homework assignment wherein the senior students were directed to communicate information about their design projects as well as share their experiences in the chemical engineering program. Dinners occurred overall several days, with up to ten freshman and five seniors attending each event. Freshman students were encouraged to use this time to discover more about the major, inquire about future course work, and learn about ways to enrich their educational experience through extracurricular and co-curricular activities. Several weeks after the dinner experience, senior students returned to give additional presentations to the freshman students to focus on the environmental and societal impacts of their design projects. We report baseline engineering identity in this paper. 
    more » « less