skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: The Reflective Modeling Practitioner: Promoting Selfregulation and Self-confidence in Computational Modeling and Simulation Practices
This study investigated the effects of a team-based modeling intervention that implemented reflective practices to support students’ self-regulated learning in the context of modeling assignments. We used a mixed method design to answer the three research questions: (1) What metacognitive strategies do students, organized in teams, implement when solving computational modeling assignments? (2) What are students’ levels of performance in solving computational modeling assignments in teams? (3) What are the relationships between teams’ level of confidence and their implemented metacognitive strategies and level of performance in the computational modeling assignment? The learning intervention was guided by a reflective modeling practitioner model, bringing together modeling practices with elements of selfregulated learning. The results illustrate students’ levels of self-reported confidence in three levels, showing that from the twelve teams studied, seven reported an increase in confidence as the project progressed, three reported a decrease in their confidence, and two reported an initial struggle, but their confidence increased as they completed the assignment. The implications relate to the learning interventions in the team modeling activity that can influence the teams’ reported selfconfidence, which can impact the skills students acquire and the strategies they use when faced with challenges.  more » « less
Award ID(s):
2120200
PAR ID:
10510212
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IJEE
Date Published:
Journal Name:
International Journal of Engineering Education
Volume:
40
Issue:
1
ISSN:
0949-149X/91
Page Range / eLocation ID:
179-195
Subject(s) / Keyword(s):
computational modeling and simulation engineering education self-regulated learning teamwork
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Self-regulation, a skillset involving taking charge of one’s own learning processes, is crucial for workplace success. Learners develop self-regulation skills through reflection where they recognize weaknesses and strengths by employing metacognitive strategies: planning, monitoring, and evaluating. Use of anchors assists learners’ engagement in reflection. The purpose of this work was to gain insight into students’ use of anchors when reflecting on their learning. The two research questions were: (1) To what extent do students link their self-evaluation and learning objective (LO) self-ratings to their reflections? and (2) What dimensions and level of metacognitive strategies do students use in their self-evaluation of and reflections on weekly problem-solving assignments? Data were upper-division engineering students’ anchors (self- evaluations, LO self-ratings) and reflection responses for one assignment. Self-evaluations and reflections were analyzed for the presence of references to LOs. The number of students who linked the anchors to their reflection were tabulated. Additionally, a revised a priori coding scheme was applied to students’ written work to determine type and level of metacognitive strategies employed. Few students linked both anchors to their reflections. Students employed low to medium levels of the metacognitive strategies in their self-evaluations and reflections, even when they linked their anchors and reflections. The evaluating strategy dominated in the self- evaluations, while planning and monitoring dominated in the reflections. Students have limited understanding of the use of anchors to guide their reflection responses. Students overall level of engagement in the metacognitive strategies indicates a need for formal instruction on reflection. 
    more » « less
  2. Abstract BackgroundThis study posits that scaffolded team-based computational modeling and simulation projects can support model-based learning that can result in evidence of representational competence and regulatory skills. The study involved 116 students from a second-year thermodynamics undergraduate course organized into 24 teams, who worked on three two-week-long team-based computational modeling and simulation projects and reflected upon their experience. ResultsResults characterized different levels of engagement with computational model-based learning in the form of problem formulation and model planning, implementation and use of the computational model, evaluation, and interpretation of the outputs of the model, as well as reflection on the process. Results report on students’ levels of representational competence as related to the computational model, meaning-making of the underlying code of the computational model, graphical representations generated by the model, and explanations and interpretations of the output representations. Results also described regulatory skills as challenges and strategies related to programming skills, challenges and strategies related to meaning-making skills for understanding and connecting the science to the code and the results, and challenges and strategies related to process management mainly focused on project management skills. ConclusionCharacterizing dimensions of computational model-based reasoning provides insights that showcase students’ learning, benefits, and challenges when engaging in team-based computational modeling and simulation projects. This study also contributes to evidence-based scaffolding strategies that can support undergraduate students' engagement in the context of computational modeling and simulation. 
    more » « less
  3. When students repeatedly reflect, it can enhance their metacognitive abilities, including self-regulatory skills of planning, monitoring, and evaluating. In a fluid mechanics course for undergraduates at a large southeastern U.S. university, in-class problem solving in a flipped classroom was coupled with intentional metacognitive skills instruction and repeated reflection to enhance metacognition. The weekly reflective responses were coded by two analysts to identify the recurring themes and uncover evidence of the development and/or reinforcement of self-regulating behaviors for academic management. To enable a comparison, a flipped classroom without the metacognitive instruction and repeated reflection was also implemented (i.e., non-intervention group). The two cohorts completed identical final exams. Based on our preliminary analysis with year one data, a statistically and practically-significant difference between the two cohorts was found with the free-response scores on the final exam in favor of the intervention cohort that had received the metacognitive support ( p < 0.0005; Cohen's d = 0.72). Also, the Metacognitive Activities Inventory (MCAI) indicated a significantly-higher positive change in self-regulatory behavior for the intervention cohort ( p = 0.001; d = 0.50). Focus groups were conducted to gather students’ perspectives on the reflective activity, with differences found by demographic group. In addition, a significantly higher proportion of females (versus males) viewed the reflections in a positive manner ( p = 0.05). Significant associations between themes in the weekly reflections and direct knowledge measures were also uncovered. This included a positive relationship between academic self-management (i.e., diligence and carefulness) and exam performance. Overall, our preliminary results point to a desirable impact of metacognitive instruction and repeated reflection on knowledge outcomes, metacognitive skills, and self-regulatory behaviors. 
    more » « less
  4. Laboratory experience is among the key components in engineering education. It is highly instrumental and plays a significant role in students’ knowledge building, application, and distribution. Learning in laboratories is interactive and often collaborative. On the other hand, students, who learn engineering through online mechanisms, may face challenges with labs, which were frequently documented during the recent pandemic. To address such challenges, innovative online lab learning modules were developed, and learning strategies were implemented in five courses in electrical engineering, Circuits I, Electronics I, Electronics II, Signals and Systems, and Embedded System, through which students gain solid foundation before advancing to senior design projects. The two main incorporated strategies were Open-Ended lab design and Teamwork implementation. Open-Ended lab modules using a lab-in-a-box approach allow students solving lab problems with multiple approaches fostering problem solving both independently and collaboratively. This innovative lab design promotes problem solving at various cognitive levels. It is better suited for concept exploration and collaborative lab learning environments as opposed to the traditional lab works with a prescribed approach leading students to follow certain procedures that may lack the problem exploration stage. Additionally, course instructors formed online lab groups, so that students were sharing the problem-solving process – from ideas formation to solutions – with their peers. To evaluate the effectiveness of the implemented lab strategies, students in the participating courses were randomly divided into experimental and control groups. Both assignment grades and students' feedback via surveys were used to evaluate students' learning. Participants in the control group were learning in labs through the materials that were aligned with core concepts by following predetermined procedures. Students in the experimental group learned through inquiry-based lab materials that required them to work in teams by integrating core concepts together to find a solution and while following one of potentially many approaches. To maximize the online lab learning effect and to replicate the contemporary industry, commerce, and research practices, instructor-structured cooperative learning strategies were applied along with pre-lab simulations and instructional videos. This paper showcases the outcomes of our 2nd year implementation of active learning laboratory strategies on the mixed population of online and face-to-face students. We observed that students in the experimental group generally outperformed their counterparts in labs and showed significantly higher results in the assignments addressing more advanced concept understanding and applications (grand average of 88.3% vs. 66.3%). Surveys also indicated that students saw the benefits of collaboration with Open-Ended lab modules not only for learning concepts, but also for improving their communication skills. Students were able to collaborate on lab problems through various communication tools, such as course Learning Management System (LMS) and mobile apps forming online learning communities. We believe that that the implementation of open-ended collaborative laboratory strategies can assist students in cultivating a deeper comprehension, fostering self-confidence, and refining their critical thinking abilities, all while strengthening their sense of inclusion within the field of engineering. 
    more » « less
  5. This paper shares the analysis of our quantitative findings regarding the impact of a virtual informal collaborative experiential learning activity on diverse students' computational thinking, critical thinking, and self-efficacy in STEM activities. Designed as part of an ongoing National Science Foundation sponsored project to provide underrepresented minority (URM) students from underserved economic backgrounds with real-world career preparation and technical education across disciplines through collaborative project activities using cutting-edge technologies, the Hackathon for Social Good was implemented during the COVID-19 shutdowns in a New York City community college in lower Manhattan. Students worked in teams to innovate practical solutions to global problems with mentor support from both academia and the tech industry. This intervention drew 36 students from Computer Science, Business, and Sociology classes, who worked with volunteers and alumni during a full-day event in the Fall of 2021, using AI and data science to design culturally sensitive data-driven solutions for real-world problems. The tracks covered the following topics: Zero Hunger, Clean Water, and Sanitation, Green Consumption, Racial Justice, Quality Education, Good Health, and Well Being. The two main objectives of this project are as follows: (1) Design a remote interdisciplinary one-day experiential collaborative learning environment to engage URM teams of students from a community college in applying computational thinking to develop solutions for social good. (2) Conduct research on our intervention to study its effect on students' self-efficacy, as well as their knowledge of, and comfort with, computational thinking, critical thinking, problem-solving, and STEM. The evidence gathered from qualitative and quantitative data indicates that using these mechanisms to infuse CT into student learning across disciplines has several positive outcomes. Students reported increased leadership skills, comfort with teamwork, problem-solving, and critical thinking. A quantitative study specifically showed a positive impact on student confidence in their ability to do CT and improved their sense of efficacy in impacting the world outside of the hackathon. 
    more » « less