Timely, formative feedback is important for instructors and students. In this project, “embedded students” provided instructors with formative feedback through anonymized reports. Students enrolled in preparatory chemistry course sections in fall 2022 self-selected to submit reports documenting their ongoing experiences in learning chemistry content. Embedded students journaled about (i) hours devoted to the course; (ii) topic-specific content mastery, comfort, and confusion; and (iii) instructor pedagogy. An average of 108 reports per week were anonymized and shared with instructors. Instructor effort was limited to agreeing to receive the weekly reports, look them over, and potentially use them to inform upcoming teaching. Embedded students benefited by thinking about their learning in the class (metacognition) and focusing their learning for the upcoming week. Overall, 300 distinct students submitted 1,513 weekly reports, with overall means of 2.81 hours per week of self-reported time devoted to attending lecture, 4.75 hours per week of self-reported time engaged in additional study, and 7.56 hours per week of self-reported total time devoted to the course. Instructors reported reading over 87% of the reports and using feedback to make an average of 4.6 instructional adjustments ranging from working additional practice problems on difficult concepts, providing answer keys to extra problems, implementing problem-solving/review days, and reviewing difficult material or content from earlier in the course. Instructors indicated that the weekly reports contributed to “instructor beneficence”. Students “felt heard” especially when instructors explicitly and constructively addressed comments from the weekly reports. This work is partially supported by the NSF-funded First2 Network.
more »
« less
This content will become publicly available on April 18, 2025
Metacognitive reporting provides insight on students’ out-of-class study activities geared toward their learning of chemistry
Prompting students to practice metacognition, and encouraging the growth of metacognitive strategies improves student success in chemistry coursework. In this study, students were encouraged to submit weekly metacognitive reports providing (i) their time devoted to the course, including hours devoted to out-of-class additional study, and (ii) detailed summaries of additional study activities. This study was administered to students in two different courses, introductory chemistry and general chemistry I. Introductory chemistry students submitted 1,513 metacognitive reports with self-reported overall means of 2.81 hour per week devoted to attending lecture, 4.75 hours per week engaged in additional study, and 7.56 hours per week devoted to the course overall. Weekly patterns indicate that students’ additional study was focused on days of the week that preceded formal assessments. Our expectation was that general chemistry I students would report more time devoted to additional study outside of class than introductory chemistry students because of the preparatory nature of the course. General chemistry I students submitted 3,551 weekly metacognitive reports with self-reported overall means of 2.83 hours per week devoted to attending lecture, 4.83 hours per week engaged in additional study, and 7.66 hours per week devoted to the course overall. We will discuss the seeming equivalence of time spent on out-of-class additional study for the two populations of students. In addition, we will present qualitative analysis of students’ out-of-class study strategies, including classification of study strategies as deep or surface-level. This work is partially supported by the NSF-funded First2 Network.
more » « less- PAR ID:
- 10534846
- Publisher / Repository:
- PKP Publishing Services Network
- Date Published:
- Journal Name:
- Proceedings of the West Virginia Academy of Science
- Volume:
- 96
- Issue:
- 1
- ISSN:
- 0096-4263
- Subject(s) / Keyword(s):
- Metacognition Scholarship of Teaching and Learning Chemistry Chemistry Education Research
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
With large enrollments (about 200-350) of primarily non-majors, engaging students in the required introductory materials science and engineering course at our university has been a longstanding challenge. In moving to the virtual format in the fall of 2020, we significantly adapted several aspects of the course, many of which have continued to the hybrid format in future semesters, with good results. The primary content was provided through asynchronous videos; this format allowed us to break content into digestible pieces. In particular, multiple mini-lectures and example videos were pre-recorded for each week, with a total viewing time per week somewhat less than the typical total class time. To provide real-time, structured interaction, one live virtual class session per week was held, centered on previously submitted student questions. Smaller teaching-assistant-led recitation sections also met live (virtually or in person), during which “clicker” questions were asked through TopHat. Assignments were also updated to take advantage of the virtual format. Multiple small assignments with lower stakes were due throughout the week: a reading/lecture quiz, a survey to submit questions, and a shortened homework assignment. Finally, we changed some content near the end of the course to allow students to connect the course to their own career aspirations, which we expect can aid in longterm retention. Specifically, students chose among several possible topics to cover in the final weeks, covered via typical pre-recorded lectures and reading, and also guest lectures. They wrote an abstract-length reflection on how they could use what they learned in this course later in their careers. Overall, students remained engaged with the course throughout the semester and provided favorable comments and evaluations of the course, including higher numerical evaluations of the course than in prior semesters.more » « less
-
more » « less
The metacognitive strategies of planning, monitoring, and evaluating can be promoted through systematic reflection to drive self-directed, lifelong learning. This article reports on a three-year study on systematic written reflection within an undergraduate Fluid Mechanics course to promote planning, monitoring, and evaluation. Students were prompted weekly to reflect on their in-class problem-solving, classroom and exam preparation, performance, behaviors, and learning in a flipped classroom at a large southeastern U.S. university. In addition, they received intentional instruction on how to plan, monitor, and evaluate their problem-solving during class. To enable a comparative assessment, a flipped classroom without these interventions was also implemented as a non-experimental cohort. The cohorts were compared using a final exam, concept inventory, and the Metacognitive Activities Inventory (MCAI). The MCAI indicated a significantly higher positive change (pre- to post-course) in self-regulatory behavior for the experimental cohort ( p = 0.037). The weekly reflections were studied using an inductive content analysis to assess students’ self-regulatory behaviors. They were also used to investigate statistical associations between reflection content and course outcomes. This revealed that academic self-discipline via planning, monitoring one's work, or being careful and diligent may be as aligned with course performance in STEM as is practice with the problem-solving itself. The effects for the final exam in the experimental cohort were positive overall as well as statistically or practically significant for various demographic strata. These results provided evidence for the potential enhancement of course performance with metacognition support. A positive shift in students’ perspectives regarding the value of the reflection questions was observed throughout the study. Therefore, as an implementation guide for other educators, the reflection questions and any changes made in posing them to students are discussed chronologically. Overall, the study points to the desirability of providing metacognition support in a STEM course.
-
The instructional practices used in introductory college courses often differ dramatically from those used in high school courses, and dissatisfaction with these practices is cited by students as a prominent reason for leaving science, technology, engineering, and mathematics (STEM) majors. To better characterize the transition to college course work, we investigated the extent to which incoming expectations of course activities differ based on student demographic characteristics, as well as how these expectations align with what students will experience. We surveyed more than 1500 undergraduate students in large introductory STEM courses at three research-intensive institutions during the first week of classes about their expectations regarding how class time would be spent in their courses. We found that first-generation and first-semester students predict less lecture than their peers and that class size had the largest effect on student predictions. We also collected classroom observation data from the courses and found that students generally underpredicted the amount of lecture observed in class. This misalignment between student predictions and experiences, especially for first-generation and first-semester college students and students enrolled in large- and medium-size classes, has implications for instructors and universities as they design curricula for introductory STEM courses with explicit retention goals.more » « less
-
null (Ed.)A well-established literature base identifies a portion of students enrolled in post-secondary General Chemistry as at-risk of failing the course based on incoming metrics. Learning about the experiences and factors that lead to this higher failure rate is essential toward improving retention in this course. This study examines the relationship between study habits and academic performance for at-risk students in General Chemistry. Students who were in the bottom quartile of SAT math scores were identified as at-risk students. The study habits of General Chemistry students, both those identified as at-risk and those not identified were measured by text message inquiries. The text message asked ‘‘Have you studied for General Chemistry I in the past 48 hours? If so, how did you study?” twice a week throughout a semester. Student responses to the messages were used to calculate the frequency of studying throughout the term. The results from a multiple regression analysis showed that high frequency of studying could mitigate the difference between at-risk and non-at-risk students on final exam scores. Additionally, the quality of studying for six at-risk students was analyzed by student interviews in concert with their text message responses. The results indicated that the quality of studying is not necessarily linked to frequency of studying and both quality and frequency can play a role in at-risk students' academic performance. The results presented offer a path for at-risk students to succeed in General Chemistry and the methodology presented offers a potential avenue for evaluating future efforts to improve student success.more » « less
