Four writing-intensive, inquiry-based, three-credit seminars were created to serve as the hub for linked learning communities for first-year students in STEM. Based on United Nations Sustainable Development Goals (UN SDGs), the seminars engaged students in socially-relevant modeling, lab work, and public presentations. The seminars were designed to foster a communal view of science and mathematics, both in terms of the importance of collaboration to STEM success and the application of STEM to real-world problems. Course structures and sample materials will be shared, along with preliminary analyses from a randomized controlled trial comparing students in the seminars to a control group of peers. In fall 2021,students who participated in the seminars reported increased awareness of the UN SDGs, valued team work more highly, and earned more credits and higher grades than control group students. Supported by NSF2020765, these seminars are part of a study of the effectiveness of learning communities.
more »
« less
Linked classroom communities can increase student success: Lessons learned from a randomized controlled trial
Many campuses have utilized linked-course communities, wherein students take two or more courses with the same peers, in an effort to enhance learning and build community among students. Previous research on the effectiveness of linked-course communities have utilized quasi-experimental designs that are subject to selection bias – the communities may be effective due to which students volunteered to join the communities. This research session reports findings from a randomized controlled trial that eliminated selection bias by randomly assigning first-time first-year College of Science and Math students to linked-course communities or a control group. Findings demonstrate that students in the communities earned higher GPAs and more STEM credits in their first semester than students in the control group. Session participants will identify a curricular intervention and consider the feasibility of conducting a randomized controlled trial to assess effectiveness.
more »
« less
- Award ID(s):
- 2020765
- PAR ID:
- 10541429
- Publisher / Repository:
- AAC&U
- Date Published:
- Format(s):
- Medium: X
- Location:
- AAC&U Annua Meeting, Washington, DC
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
BackgroundIncreasingly, college science courses are transitioning from a traditional lecture format to active learning because students learn more and fail less frequently when they engage in their learning through activities and discussions in class. Fear of negative evaluation (FNE), defined as a student’s sense of dread associated with being unfavorably evaluated while participating in a social situation, discourages undergraduates from participating in small group discussions, whole class discussions, and conversing one-on-one with instructors. ObjectiveThis study aims to evaluate the acceptability of a novel digital single-session intervention and to assess the feasibility of implementing it in a large enrollment college science course taught in an active learning way. MethodsTo equip undergraduates with skills to cope with FNE and bolster their confidence, clinical psychologists and biology education researchers developed Project Engage, a digital, self-guided single-session intervention for college students. It teaches students strategies for coping with FNE to bolster their confidence. Project Engage provides biologically informed psychoeducation, uses interactive elements for engagement, and helps generate a personalized action plan. We conducted a 2-armed randomized controlled trial to evaluate the acceptability and the preliminary effectiveness of Project Engage compared with an active control condition that provides information on available resources on the college campus. ResultsIn a study of 282 upper-level physiology students, participants randomized to complete Project Engage reported a greater increase in overall confidence in engaging in small group discussions (P=.01) and whole class discussions (P<.001), but not in one-on-one interactions with instructors (P=.05), from baseline to immediately after intervention outcomes, compared with participants in an active control condition. Project Engage received a good acceptability rating (1.22 on a scale of –2 to +2) and had a high completion rate (>97%). ConclusionsThis study provides a foundation for a freely available, easily accessible intervention to bolster student confidence for contributing in class. Trial RegistrationOSF Registries osf.io/4ca68 http://osf.io/4ca68more » « less
-
In past work, time management interventions involving prompts, alerts, and planning tools have successfully nudged students in online courses, leading to higher engagement and improved performance. However, few studies have investigated the effectiveness of these interventions over time, understanding if the effectiveness maintains or changes based on dosage (i.e., how often an intervention is provided). In the current study, we conducted a randomized controlled trial to test if the effect of a time management intervention changes over repeated use. Students at an online computer science course were randomly assigned to receive interventions based on two schedules (i.e., high-dosage vs. low-dosage). We ran a two-way mixed ANOVA, comparing students' assignment start time and performance across several weeks. Unexpectedly, we did not find a significant main effect from the use of the intervention, nor was there an interaction effect between the use of the intervention and week of the course.more » « less
-
Self-efficacy, or the belief in one's ability to accomplish a task or achieve a goal, can significantly influence the effectiveness of various instructional methods to induce learning gains. The importance of self-efficacy is particularly pronounced in complex subjects like Computer Science, where students with high self-efficacy are more likely to feel confident in their ability to learn and succeed. Conversely, those with low self-efficacy may become discouraged and consider abandoning the field. The work presented here examines the relationship between self-efficacy and students learning computer programming concepts. For this purpose, we conducted a randomized control trial experiment with university-level students who were randomly assigned into two groups: a control group where participants read Java programs accompanied by explanatory texts (a passive strategy) and an experimental group where participants self-explain while interacting through dialogue with an intelligent tutoring system (an interactive strategy). We report here the findings of this experiment with a focus on self-efficacy, its relation to student learning gains (to evaluate the effectiveness, we measure pre/post-test), and other important factors such as prior knowledge or experimental condition/instructional strategies as well as interaction effectsmore » « less
-
Carvalho, Paulo F. (Ed.)We present results from a small-scale randomized controlled trial that evaluates the impact of just-in-time interventions on the academic outcomes of N = 65 undergraduate students in a STEM course. Intervention messaging content was based on machine learning forecasting models of data collected from 537 students in the same course over the preceding 3 years. Trial results show that the intervention produced a statistically significant increase in the proportion of students that achieved a passing grade. The outcomes point to the potential and promise of just-in-time interventions for STEM learning and the need for larger fully-powered randomized controlled trials.more » « less