An official website of the United States government
This works seeks to develop and assess a retention intervention that addresses the key drivers of attrition and learns from existing interventions for engineering students. The resulting intervention addresses key competencies for the major and profession, and also addresses a gap in current approaches: the need to synergistically support students’ social-cognitive disposition with respect to attrition by training them in social-cognitive skills and strategies adapted from the theories of Sense of Belonging (SOB) and Self-Regulation of Learning (SRL). Because the degree of skills and strategies around SRL and SOB needed to make the largest impact to retention is unknown, four versions of the intervention are proposed: A base intervention which provokes students to think about their learning and belonging, an intervention augmented with specific training in effective SRL, an intervention augmented with specific training in SOB; and an intervention augmented with training in both effective SRL and SOB. An overarching research design plans the offering and assessment of each version of the intervention, including a numerical longitudinal analysis of retention at the end of the study, with the ultimate goal of identifying which version of the intervention has the largest positive impact to retention and other key metrics. After a general description of the intervention as a while, the focus was reoriented to the base version of the intervention. The detailed design was presented along with the assessment methods for short-term effectiveness and the preliminary results for its first offering in Fall 2022. Overall, students found the topics covered in the intervention to be helpful and used many of the skills and strategies from the intervention in other major courses. The impact of the intervention on performance in major courses taken alongside the intervention and their persistence rate in the major for another semester improved significantly for one major course but were inconclusive for a second major course. Recommendations were made to refine the materials provided to students and several of the activities in the base intervention; and the formative assessment tool.
more »
« less
Components of engagement in saying-is-believing exercises
Abstract The saying-is-believing effect is an important step for changing students’ attitudes and beliefs in a wise intervention. However, most studies have not closely examined the process of the saying-is-believing effect when individuals are engaged in the activity. Using a qualitative approach, the present study uses an engagement framework to investigate (a) components of engagement in the saying-is-believing effect; and (b) how differently students may engage in a saying-is-believing exercise. Semi-structured interviews were conducted with 14 undergraduates in a scholarship program for low-income transfer students from community college. Analysis using inductive and deductive approaches found that students varied on the extent to which they experienced the effectiveness of the saying-is-believing effect through affective, cognitive, and behavioral experiences. The study offers examples of how people can indeed differ in the extent to which they experience the saying-is-believing effect, and the implications for designing more effective interventions. Specifically, students’ positive affective experiences from seeing the larger goal of creating videos may be important components for the saying-is-believing effect to work. Behavioral experiences, such as learning soft skills, academic skills learned indirectly from the intervention, and academic skills learned directly from the intervention were accompanied by both positive affective and cognitive experiences. Findings show the importance of students’ differential engagement in saying-is-believing exercises both for building more effective wise interventions and interpreting heterogeneity in intervention effectiveness.
more »
« less
- Award ID(s):
- 1742627
- PAR ID:
- 10347908
- Date Published:
- Journal Name:
- Current Psychology
- ISSN:
- 1046-1310
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In past work, time management interventions involving prompts, alerts, and planning tools have successfully nudged students in online courses, leading to higher engagement and improved performance. However, few studies have investigated the effectiveness of these interventions over time, understanding if the effectiveness maintains or changes based on dosage (i.e., how often an intervention is provided). In the current study, we conducted a randomized controlled trial to test if the effect of a time management intervention changes over repeated use. Students at an online computer science course were randomly assigned to receive interventions based on two schedules (i.e., high-dosage vs. low-dosage). We ran a two-way mixed ANOVA, comparing students' assignment start time and performance across several weeks. Unexpectedly, we did not find a significant main effect from the use of the intervention, nor was there an interaction effect between the use of the intervention and week of the course.more » « less
-
This paper presents the initial work of a recently funded NSF project on ethical and responsible research and practices in science and engineering. The objective of this research is to improve instructor training, interventions, and student outcomes in high schools and universities to improve awareness and commitment to ethical practices in STEM coursework. The project will generate a robust snapshot of the ethical knowledge, reasoning skills, attitudes, and practices of several thousand undergraduate engineering students. This snapshot will inform the development of a three-week enrichment opportunity for high school STEM teachers. Working with university faculty and graduate students, these teachers will develop learning modules on ethical issues related to their courses. The snapshot will also identify gaps and guide the creation of targeted interventions that will be used in second-, third-, and fourth-year engineering courses. This data-driven project uses a mixed-methods approach to generate a better understanding of the impact of ethics interventions at various points in a student's academic development by developing and using a set of instruments to measure cognitive, affective, and behavioral aspects of ethical competency and self-efficacy. To that end, a second snapshot will be taken by testing and surveying engineering students in their capstone courses to provide a broad overview of the competence and self-confidence that engineering students have in dealing with ethical STEM issues, to determine the efficacy of various interventions, and to improve future interventions. Utilizing repeated measures and possessing a longitudinal dimension, the project will generate extensive data about the development of ethical competency, ethical self-efficacy, and their relationship. The interventions designed for secondary and tertiary classrooms will build on best practices for micro-insertion of ethics content that are practical and help students understand how technical competencies fit within broader social, economic, and environmental contexts. The capstone snapshot will also provide some measure of the impact of other experiences (e.g., undergraduate research, internships, service learning) and courses (e.g., humanities, social science, and business courses) on development of ethical practices. This report marks the start of a five-year project; therefore, the results presented in this paper represent findings from the engineering ethics literature and baseline results from survey of engineering freshmen at Texas A&M University. The findings from the survey are being utilized in developing intervention modules that will be integrated in upper-level engineering courses and training materials for high school teachers.more » « less
-
Online education is rapidly expanding in response to rising demand for higher and continuing education, but many online students struggle to achieve their educational goals. Several behavioral science interventions have shown promise in raising student persistence and completion rates in a handful of courses, but evidence of their effectiveness across diverse educational contexts is limited. In this study, we test a set of established interventions over 2.5 y, with one-quarter million students, from nearly every country, across 247 online courses offered by Harvard, the Massachusetts Institute of Technology, and Stanford. We hypothesized that the interventions would produce medium-to-large effects as in prior studies, but this is not supported by our results. Instead, using an iterative scientific process of cyclically preregistering new hypotheses in between waves of data collection, we identified individual, contextual, and temporal conditions under which the interventions benefit students. Self-regulation interventions raised student engagement in the first few weeks but not final completion rates. Value-relevance interventions raised completion rates in developing countries to close the global achievement gap, but only in courses with a global gap. We found minimal evidence that state-of-the-art machine learning methods can forecast the occurrence of a global gap or learn effective individualized intervention policies. Scaling behavioral science interventions across various online learning contexts can reduce their average effectiveness by an order-of-magnitude. However, iterative scientific investigations can uncover what works where for whom.more » « less
-
An increasingly global environment expects graduating Engineering students to perform, live and work across cultures. Most intercultural competence research and associated global engineering education is focused on developing the global engineering skill set through long-term travel experiences such as study abroad programs. These programs can be expensive from both a time and money standpoint, limiting the participation to more privileged members of a community, and are not scalable to support broader participation. This work-in-progress addresses this research gap by focusing on the development of the students’ global learner mindset without requiring extensive travel. The project will investigate four different global engagement interventions, including the use of engineering case studies, the intentional formation of multi-national student teams, a Collaborative Online International Learning (COIL) research project, and a community engaged project within a short course. These interventions can be used to develop a holistic global learner mindset and global engineering education approach to foster global competence in undergraduate engineering students. The four global engagement interventions will be grounded in the global engineering competency (GEC) theoretical framework and assessed for their ability to foster a global learner mindset in engineering students. A mixed-methods approach will be used to assess students’ global learner mindset and skill set. This research will use the Global Engagement Survey (GES), the Global Engineering Competency Scale (GECS) and specific questions developed by the researchers to evaluate improvements in the participating students’ global engineering skill set and answer specific research questions including: 1) To what extent can global competence be developed in engineering students through the use of the proposed global engagement interventions; and 2) what are the relative strengths of each of the proposed global engagement interventions in developing global engineering competence? Combined, these research measures will provide both an accurate picture of how each global engagement intervention impacts the formation of a global learner mindset in engineering education, and also its associated ability to develop and/or improve global engineering skills. The outcomes of this study will generate valuable knowledge to understand how each global engagement intervention impacts the formation of global engineering competence. In this work-in-progress study, the authors discuss the four global engagement interventions with specific learning objectives that have been mapped to the overall student outcomes for the project. These objectives have also been mapped to the GES and GECS instruments. Finally the faculty members have developed qualitative tools to augment the GES and GECS to identify the global engineering skill sets each intervention is generating. This paper lays the foundation before implementing the interventions and performing their associated assessments over the several subsequent semesters.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1007/s12144-022-02782-z
