Social-psychological interventions have raised the learning and performance of students in rigorous efficacy trials. Yet, after they are distributed “in the wild” for students to self-administer, there has been little research following up on their translational effectiveness. We used cutting-edge educational technology to tailor, scale up, and track a previously-validated Strategic Resource Use intervention among 12,065 college students in 14 STEM and Economics classes. Students who self-administered this “Exam Playbook” benefitted by an average of 2.17 percentage points (i.e., a standardized effect size of 0.18), compared to non-users. This effect size was 1.65 percentage points when controlling for college entrance exam scores and 1.75 [−1.88] for adding [dropping] the Exam Playbook in stratified matching analyses. Average benefits differed in magnitude by the conduciveness of the class climate (including peer norms and incentives), gender, first-generation status, as well as how often and how early they used the intervention. These findings on how, when, and who naturally adopts these resources address a need to improve prediction, translation, and scalability of social-psychological intervention benefits.
more » « less- PAR ID:
- 10370433
- Publisher / Repository:
- Nature Publishing Group
- Date Published:
- Journal Name:
- npj Science of Learning
- Volume:
- 7
- Issue:
- 1
- ISSN:
- 2056-7936
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
In this research-based paper, we explore the relationships among Rice University STEM students’ high school preparation, psychological characteristics, and career aspirations. Although greater high school preparation in STEM coursework predicts higher STEM retention and performance in college [1], objective academic preparation and college performance do not fully explain STEM retention decisions, and the students who leave STEM are often not the lowest performing students [2]. Certain psychosocial experiences may also influence students’ STEM decisions. We explored the predictive validity of 1) a STEM diagnostic exam as an objective measure of high school science and math preparation and 2) self-efficacy as a psychological measure on long-term (three years later) STEM career aspirations and STEM identity of underprepared Rice STEM students. University administrators use diagnostic exam scores (along with other evidence of high school underpreparation) to identify students who might benefit from additional support. Using linear regression to explore the link between diagnostic exam scores and self-efficacy, exam scores predicted self-efficacy a semester after students’ first semester in college; exam scores were also marginally correlated with self-efficacy three years later. Early STEM career aspirations predicted later career aspirations, accounting for 21.3% of the variance of career outcome expectations three years later (β=.462, p=.006). Scores on the math diagnostic exam accounted for an additional 10.1% of the variance in students’ three-year STEM career aspirations (p=.041). Self-efficacy after students’ first semester did not predict future STEM aspirations. Early STEM identity explained 28.8% of the variance in three-year STEM identity (p=.001). Math diagnostic exam scores accounted for only marginal incremental variance after STEM identity, and self-efficacy after students’ first semester did not predict three-year STEM aspirations. Overall, we found that the diagnostic exam provided incremental predictive validity in STEM career aspirations after students’ sixth semester of college, indicating that early STEM preparation has long-lasting ramifications for students’ STEM career intentions. Our next steps include examining whether students’ diagnostic exam scores predict STEM graduation rates and final GPAs for science and math versus engineering majors.more » « less
-
Gender diversity signals inclusivity, but meta-analyses suggest that it does not boost individual or group performance. This research examined whether a social-psychological intervention can unlock the benefits of gender diversity on college physics students’ social and academic outcomes. Analyses of 124 introductory physics classrooms at a large research institution in the eastern United States ( N = 3,605) indicated that in classrooms doing “business as usual,” cross-gender collaboration was infrequent, there was a substantial gender gap in physics classroom belonging, and classroom gender diversity had no effect on performance. The ecological-belonging intervention aimed to establish classroom norms that adversity in the course is normal and surmountable. In classrooms receiving the intervention, cross-gender interaction increased 51%, the gender gap in belonging was reduced by 47%, and higher classroom diversity was associated with higher course grades and 1-year grade point average for both men and women. Addressing contextual belongingness norms may help to unlock the benefits of diversity.
-
Abstract Background Supplemental instruction (SI) is a well-established mode of direct academic support, used in a wide variety of courses. Some reports have indicated that SI and similar peer-led academic support models particularly benefit students identifying with historically underserved racial/ethnic groups in STEM. However, these studies have not explicitly examined the role of prior academic experiences, an important consideration in college success. We report on the impact of a modified SI model, Peer Supplemental Instruction (PSI), on student success in introductory STEM courses at a diverse access institution. This study focuses on PSI’s impact on the academic performance of students identifying with historically underserved racial/ethnic groups, while also considering the effects of prior academic experiences.
Results Data were aggregated for nine courses over five semesters to produce a robust data set (
n = 1789). PSI attendees were representative of the overall student population in terms of previous academic experiences/performance (as determined by high school GPA) and self-identified racial/ethnic demographics. Frequent PSI attendance was correlated with a significant increase in AB rates (average increase of 29.0 percentage points) and reduction in DFW rates (average decrease of 26.1 percentage points) when comparing students who attended 10 + vs. 1–2 PSI sessions. Overall, students identifying as Black/African American received the largest benefit from PSI. These students experienced a significant increase in their final course GPA when attending as few as 3–5 PSI sessions, and exhibited the largest increase in AB rates (from 28.7 to 60.5%) and decrease in DFW rates (from 47.1 to 14.8%) when comparing students who attended 10 + vs. 1–2 sessions. However, students with similar HS GPAs experienced similar benefits from PSI, regardless of self-identified race/ethnicity.Conclusions The data presented here suggest that PSI particularly benefitted underprepared students in their introductory STEM courses. Since students identifying with historically underserved racial/ethnic groups have traditionally had inequitable K–12 educational experiences, they enter college less prepared on average, and thus particularly benefit from PSI. PSI, in conjunction with additional strategies, may be a useful tool to help rectify the results of systemic educational inequities for students identifying with historically underserved racial/ethnic groups.
-
Wright, L Kate (Ed.)
ABSTRACT Students with strong metacognitive skills are positioned to learn and achieve more than peers who are still developing their metacognition. Yet, many students come to college without well-developed metacognitive skills. As part of a longitudinal study on metacognitive development, we asked when, why, and how first-year life science majors use metacognitive skills of planning, monitoring, and evaluating. Guided by the metacognition framework, we collected data from 52 undergraduates at three institutions using semi-structured interviews. We found that first-year students seek study recommendations from instructors, peers, and online resources when they plan their study strategies. First-year students struggle to accurately monitor their understanding and benefit when instructors help them confront what they do not yet know. First-year students evaluate the effectiveness of their study plans at two specific points: immediately after taking an exam and/or after receiving their grade on an exam. While first-year students may be particularly open to suggestions on how to learn, they may need help debunking myths about learning. First-year students acknowledge they are still learning to monitor and welcome formative assessments that help them improve the accuracy of their monitoring. First-year students may be primed to receive guidance on their metacognition at the points when they are most likely to evaluate the effectiveness of their study strategies and plans. Based on our results, we offer suggestions for instructors who want to support first-year students to further develop their metacognition.
-
There is growing evidence on the importance of psychological safety, or how comfortable participants feel in sharing their opinions and ideas in a team, in engineering team performance. However, how to support it in engineering student teams has yet to be explored. The goal of this study was to investigate whether a video intervention with assigned roles could foster psychological safety in student engineering teams. In addition, we sought to explore the impact of the frequency of the videos and the utility of the roles on the self-efficacy of students and the perceived psychological safety of the team. Specifically, this study introduces video interventions and the four lenses of psychological safety (Turn-Taking Equalizer, Point of View Shifter, Affirmation Advocate, and Creativity Promoter), and seeks to determine their effectiveness at increasing psychological safety self-efficacy and individual levels of psychological safety. A pilot study was completed with 54 participants (36 males, 17 females, 1 non-binary/third gender) enrolled in a cornerstone engineering design course. Over 10 weeks, data was collected at 5 time points. The results present four key findings. Most notably, 1) a video educating all students about psychological safety in general was effective in improving psychological safety self-efficacy and students retained this information to the end of the project;2) intervention groups taught to use the four lenses did not have a statistically significant higher level of psychological safety than non- intervention groups; and 3) intervention groups perceived the use of the lenses to increase psychological safety. These results provide a baseline understanding that is needed to support psychological safety including: when to intervene, how to intervene, and how frequently to intervene.more » « less