skip to main content


Title: Metacognition instruction and repeated reflection in a fluid mechanics course: Reflective themes and student outcomes

When students repeatedly reflect, it can enhance their metacognitive abilities, including self-regulatory skills of planning, monitoring, and evaluating. In a fluid mechanics course for undergraduates at a large southeastern U.S. university, in-class problem solving in a flipped classroom was coupled with intentional metacognitive skills instruction and repeated reflection to enhance metacognition. The weekly reflective responses were coded by two analysts to identify the recurring themes and uncover evidence of the development and/or reinforcement of self-regulating behaviors for academic management. To enable a comparison, a flipped classroom without the metacognitive instruction and repeated reflection was also implemented (i.e., non-intervention group). The two cohorts completed identical final exams. Based on our preliminary analysis with year one data, a statistically and practically-significant difference between the two cohorts was found with the free-response scores on the final exam in favor of the intervention cohort that had received the metacognitive support ( p < 0.0005; Cohen's d = 0.72). Also, the Metacognitive Activities Inventory (MCAI) indicated a significantly-higher positive change in self-regulatory behavior for the intervention cohort ( p = 0.001; d = 0.50). Focus groups were conducted to gather students’ perspectives on the reflective activity, with differences found by demographic group. In addition, a significantly higher proportion of females (versus males) viewed the reflections in a positive manner ( p = 0.05). Significant associations between themes in the weekly reflections and direct knowledge measures were also uncovered. This included a positive relationship between academic self-management (i.e., diligence and carefulness) and exam performance. Overall, our preliminary results point to a desirable impact of metacognitive instruction and repeated reflection on knowledge outcomes, metacognitive skills, and self-regulatory behaviors.

 
more » « less
Award ID(s):
2020504 2019664
NSF-PAR ID:
10402126
Author(s) / Creator(s):
 ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
International Journal of Mechanical Engineering Education
Volume:
51
Issue:
4
ISSN:
0306-4190
Page Range / eLocation ID:
p. 243-269
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In this paper, we preliminarily examine the notion of the “surroundings” in an engineering classroom. We posed an open-ended reflection question to engineering undergraduates at a large US university about their classroom surroundings and its impact on their learning and comprehension. The reflection prompt defined surroundings as the “conditions and objects that surround you.” This reflection question was part of an NSF-funded study on the use of weekly reflection in a flipped fluid mechanics course to drive metacognitive development and lifelong learning skills. During class, students were encouraged to collaborate with their peers during problem solving to achieve collective understanding and interact with the instructor. Based on an inductive, emergent content analysis of the reflection data with two analysts, we obtained an unexpected result. Specifically, the most-frequently mentioned positive classroom “surroundings” was “peers” (46% of responses). We had initially expected less-positive responses related to the physical surroundings, such as classroom layout, size, furniture, infrastructure, etc. Although students identified the classroom’s physical attributes as surroundings that had both negative and positive influences on their learning, a second unexpected positive response emerged with the instructor and in-person instruction as part of the “surroundings.” Upon searching the literature to understand these results, we adopted the Community of Inquiry (CoI) framework. This model consists of three interacting components of cognitive presence, social presence, and teaching presence, which enable educational experiences and learning. When combined, the Community of Inquiry elements (i.e., peers, instructor, and in-class instruction) were discussed in 55% of the reflections as positive “surroundings.” Within the classroom ecosystem, feelings about positive CoI “surroundings” balanced 54% of respondents who discussed the physical room attributes as non-supportive to learning. Interestingly, when students identified their CoI as a type of surrounding, they less-frequently identified physical attributes of the classroom as non-supportive. Thus, the presence of a Community of Inquiry may have diminished the perception or impact of physical room features. Overall, our results preliminarily suggest the positive influence that an interactive flipped classroom structure can have on students’ perceptions of their “surroundings.” 
    more » « less
  2. The Improving Student Experiences to Increase Student Engagement (ISE-2) grant was awarded to Texas A&M University by the National Science Foundation, through EEC-Engineering Diversity Activities (Grant No. 1648016) with the goal of increasing student engagement and retention in the College of Engineering. The major component of the intervention was a faculty development program aimed to increase active learning, improve classroom climates, and decrease implicit bias and deficit thinking. Faculty teaching first- and second-year Engineering courses participated in the ISE-2 faculty development program, with the first cohort (n = 10) in Summer 2017 and the second cohort (n = 5) in Summer 2018. This paper describes the content of each of these components of the faculty development program and provides access to a Google drive (still in development at the time of the abstract) with resources for others to use. The faculty development program consisted of three workshops, a series of coffee hour conversations, and two deliverables from the participants (a teaching plan at the conclusion of the summer training and a final reflection a year following the training). Anchoring the program was a framework for teaching in a diverse classroom (Adams & Love, 2009). Workshop 1 (early May) consisted of an overview of the ISE-2 program. During the first workshop, faculty were introduced to social cognitive biases and the behaviors that result from these biases. During this workshop, the ISE-2 team shared findings from a climate study related to the classroom experiences of students at the College of Engineering. Workshop 2 (mid-May) focused on how undergraduate students learn, provided evidence for the effectiveness of active learning strategies, and exposed faculty participants to active learning strategies. Workshop 3 (early August) integrated the material from the first two workshops as faculty participants prepared to apply the material to their own teaching. Prior to each workshop, the faculty participants were provided with pre-workshop readings to familiarize them with some of the content matter. Coffee hour conversations—informal discussions between the participating faculty and the ISE-2 team centered around a teaching topic selected by participants—were conducted on a near-weekly basis between the second and third workshops. Handouts and worksheets were provided at each coffee hour and served to guide the coffee hour discussions. After the last workshop but before the Fall semester, faculty participants created a teaching plan to incorporate what they learned in the ISE-2 program into their own teaching. At the end of the academic year, the faculty participants are tasked with completing a final reflection on how ISE-2 has affected their teaching in the previous academic year. In this paper, we will report the content of each of the three workshops and explain how these workshops are related to the overarching goals of the ISE-2 program. Then, we will discuss how each of the coffee hour conversation topics complement the material covered in the workshops. Lastly, we will explore the role of the teaching plans and final reflections in changing instructional practices for faculty. 
    more » « less
  3. A 2019 report from the National Academies on Minority Serving Institutions (MSIs) concluded that MSIs need to change their culture to successfully serve students with marginalized racial and/or ethnic identities. The report recommends institutional responsiveness to meet students “where they are,” metaphorically, creating supportive campus environments and providing tailored academic and social support structures. In recent years, the faculty, staff, and administrators at California State University, Los Angeles have made significant efforts to enhance student success through multiple initiatives including a summer bridge program, first-year in engineering program, etc. However, it has become clear that more profound changes are needed to create a culture that meets students “where they are.” In 2020, we were awarded NSF support for Eco-STEM, an initiative designed to change a system that demands "college-ready" students into one that is "student-ready." Aimed at shifting the deficit mindset prevailing in engineering education, the Eco-STEM project embraces an asset-based ecosystem model that thinks of education as cultivation, and ideas as seeds we are planting, rather than a system of standards and quality checks. This significant paradigm and culture transformation is accomplished through: 1) The Eco-STEM Faculty Fellows’ Community of Practice (CoP), which employs critically reflective dialogue[ ][ ] to enhance the learning environment using asset-based learner-centered instructional approaches; 2) A Leadership CoP with department chairs and program directors that guides cultural change at the department/program level; 3) A Facilitators’ CoP that prepares facilitators to lead, sustain, update, and expand the Faculty and Leadership CoPs; 4) Reform of the teaching evaluation system to sustain the cultural changes. This paper presents the progress and preliminary findings of the Eco-STEM project. During the first project year, the project team formulated the curriculum for the Faculty CoP with a focus on inclusive pedagogy, community cultural wealth, and community building, developed a classroom peer observation tool to provide formative data for teaching reflection, and designed research inquiry tools. The latter investigates the following research questions: 1) To what extent do the Eco-STEM CoPs effectively shift the mental models of participants from a factory-like model to an ecosystem model of education? 2) To what extent does this shift support an emphasis on the assets of our students, faculty, and staff members and, in turn, allow for enhanced motivation, excellence and success? 3) To what extent do new faculty assessment tools designed to provide feedback that reflects ecosystem-centric principles and values allow for individuals within the system to thrive? In Fall 2021, the first cohort of Eco-STEM Faculty Fellows were recruited, and rich conversations and in-depth reflections in our CoP meetings indicated Fellows’ positive responses to both the CoP curriculum and facilitation practices. This paper offers a work-in-progress introduction to the Eco-STEM project, including the Faculty CoP, the classroom peer observation tool, and the proposed research instruments. We hope this work will cultivate broader conversations within the engineering education research community about cultural change in engineering education and methods towards its implementation. 
    more » « less
  4. The role of cognitive engagement in promoting deep learning is well established. This deep learning fosters attributes of success such as self-efficacy, motivation and persistence. However, the traditional chalk-and-talk teaching and learning environment is not conducive to engage students cognitively. The biggest impediment to implementing an environment for deep learning such as active-learning is the limited duration of a typical class period most of which is consumed by lecturing. In this paper, best practices and strategies for cognitive engagement of students in the classroom are discussed. Several lower level math and aerospace engineering courses were redesigned and offered during the academic year at a historically black university. The learning strategies in these redesigned courses included the “flipped” pedagogical model which allowed the integration of the active-learning strategy in the classroom. The research study is to determine the impact of these redesigned courses on student academic performance and persistence in STEM courses. The efficacy of the design of the flipped approach was also investigated. A between-group quasi-experimental research design was used for comparing student academic performance in traditional classroom (control group) and redesigned classroom (intervention group). A within-subject, repeated measures design was also used to assess the impact on the students’ self-regulated learning. A validated instrument was used to measure the effect of the redesigned learning environment on the motivational beliefs and self-regulated learning. Data on the academic performance of the students were collected. Analyses of these data indicated a significant impact on student academic performance. A positive change in student motivation and self-regulated learning was observed. Data analysis also validated the design of the intervention. This research is supported by NSF Grant# 1712156. 
    more » « less
  5. Engineering education is increasingly looking to the liberal arts to broaden and diversify preparation of students for professional careers. The present study involves an elective graduate environmental engineering course that incorporated the arts and humanities. The goal of the course was to develop engineers and technical professionals who would become both more appreciative of and better equipped to address technical, ethical, social, and cultural challenges in engineering through the development of critical and reflective thinking skills and reflective practice in their professional work. A reflective writing assignment was submitted by students following each of fourteen course topics in response to the following question: Reflect on how you might want to apply what you learned to your development as a professional and/or to your daily life. Student responses were classified by human coders using qualitative text analytic methods and their classifications were attempted to be learned by a simple machine classifier. The goal of this analysis was to identify and quantify students’ reflections on prospective behaviors that emerged through participation in the course. The analysis indicated that the primary focus of students’ responses was self-improvement, with additional themes involving reflection, teamwork, and improving the world. The results provide a glimpse into how broadening and diversifying the curriculum might shape students’ thinking in directions that are more considerate of their contributions to their profession and society. In the discussion, we consider the findings from the human and machine assessments and suggest how incorporating AI machine methods into engineering provides new possibilities for engineering pedagogy. 
    more » « less