skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Protocol for Meta-Analyses Examining Personalized Adaptive Learning in Undergraduate Mathematics
This protocol is for a study that examines personalized adaptive learning (PAL) of undergraduate students with a focus on mathematics outcomes. This protocol addresses two meta-analytic studies: 1) Examination of PAL within the population of undergraduate students enrolled in mathematics courses broadly (across all mathematics courses with the type of course as a moderator); and 2) Specifically in college algebra, which is a STEM pipeline mathematics course. Undergraduate mathematics courses can be roadblocks to college degree attainment. PAL offers the opportunity to develop mathematical skills in a personalized way, while enabling instructors to identify students’ struggle areas and take remedial action.Partnering with academic librarians, databases likely to index relevant studies were identified, the search strategy was refined, and keywords and subject indexing terms were identified. Titles and abstracts were independently screened by two reviewers. Full-text review is in progress. Retained studies will have data extracted that will allow the results to be meta-analyzed.The standardized mean difference will be the main effect size computed. Multilevel meta-analysis will be used to address the hierarchical data structure. Robust variance estimation will be used to estimate standard errors and hypothesis tests, addressing dependencies of effect sizes within studies. Prediction intervals for effect sizes, for study-average effect sizes, and heterogeneity statistics will be reported. Subgroup analyses will evaluate the relationship between moderators and the magnitude of the effect size. Cochrane’s criteria for assessing the risk of bias in studies with a separate control group will be applied. Reporting bias will be assessed visually with funnel plots.  more » « less
Award ID(s):
2236074
PAR ID:
10563603
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Nordic Journal of Systematic Reviews in Education
Date Published:
Journal Name:
Nordic Journal of Systematic Reviews in Education
Volume:
2
ISSN:
2704-1883
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The instructional practices used in introductory college courses often differ dramatically from those used in high school courses, and dissatisfaction with these practices is cited by students as a prominent reason for leaving science, technology, engineering, and mathematics (STEM) majors. To better characterize the transition to college course work, we investigated the extent to which incoming expectations of course activities differ based on student demographic characteristics, as well as how these expectations align with what students will experience. We surveyed more than 1500 undergraduate students in large introductory STEM courses at three research-intensive institutions during the first week of classes about their expectations regarding how class time would be spent in their courses. We found that first-generation and first-semester students predict less lecture than their peers and that class size had the largest effect on student predictions. We also collected classroom observation data from the courses and found that students generally underpredicted the amount of lecture observed in class. This misalignment between student predictions and experiences, especially for first-generation and first-semester college students and students enrolled in large- and medium-size classes, has implications for instructors and universities as they design curricula for introductory STEM courses with explicit retention goals. 
    more » « less
  2. When implementing lessons connecting advanced undergraduate mathematics to school mathematics, challenges arise for faculty and for the undergraduate students. The Mathematical Education of Teachers as an Application of Undergraduate Mathematics (META Math) project has created, piloted, and field-tested lessons for undergraduate mathematics and statistics courses typically part of a mathematics major that leads to secondary mathematics teacher certification. Lessons in calculus, discrete mathematics, algebra, and statistics explicitly link topics in college mathematics with high school mathematics topics prospective teachers will eventually teach. The goal of this poster presentation is to discuss our preliminary observations of the challenges faced by faculty and undergraduate students when implementing or using these lessons. We also wish to gather feedback and suggestions on the study design and potential directions for further research. 
    more » « less
  3. The present paper explores the relationship between attitudes towards mathematics (ATM) and achievement in college calculus in active learning (AL) and lecture-based (LB) classrooms. Previous work on this relationship has mainly been limited to LB instruction, neglecting the impact of innovative approaches such as AL. Less attention has been paid to the roles played in this relationship by gender, year in college, and initial ATM. Results from a sample of 535 undergraduate students enrolled in 9 AL and 9 LB sections are presented. Data included ATMI surveys’ responses, final grades, and demographics. Correlation and multiple regression analyses were conducted. The influence of instruction on students with low ATM was also examined. Gender and year in college were the main demographic variables considered. Achievement in AL was found to be less dependent on initial ATM in terms of correlation. AL showed higher gains in grades than LB, when controlling for ATM and demographic variables. Effect sizes of AL instruction on grades of students with low ATM were larger than those of students with higher ATM. Furthermore, AL courses had a large effect size (d = 0.81) on female students with lower ATM, confirming its role as a gender equalizer. 
    more » « less
  4. With college advisory boards and potential employers consistently voicing their desire for engineers and scientists who can communicate well, work effectively in teams, and independently problem-solve, the Colleges of Engineering & Computer Science (ECS) and Natural Sciences and Mathematics (NSM) at Sacramento State University, a large, public, primarily undergraduate institution, have deployed two programs to explicitly address these skills for undergraduate science, technology, engineering, and mathematics (STEM) students. The goals of the NSF-funded Achieving STEM Persistence through Peer-Assisted Learning and Leadership Development (ASPIRE) project are to increase retention and decrease time to graduation for STEM students, as well as increase retention of women and underrepresented minorities (URM) in the STEM workforce by implementing evidence-based practices to promote student success during two critical transitions: 1) from lower-division to upper-division coursework in engineering; and 2) from upper-division coursework to an entry-level STEM career. ASPIRE aims to achieve these goals by: 1) adapting and implementing the NSM Peer Assisted Learning (PAL) program in gateway engineering courses; and 2) developing the Hornet Leadership Program which includes scaffolded opportunities for students to explore their leadership capacity and develop leadership skills. The main research questions for this study include: (1) Will the ECS PAL model and Hornet Leadership Program result in increased persistence and workforce readiness in STEM majors at a large, diverse university? (2) What attitude changes will this project have on students and faculty and the relationships between them? The first question is addressed through pre- and post-implementation student surveys and student course/GPA data. The second question is addressed through faculty surveys, faculty focus groups/interviews, and pre- and post-data from a faculty professional development workshop. In general, preliminary results from this study indicate the new ECS PAL program successfully attracts URM students and thus has the potential to support their persistence and STEM workforce readiness. Additionally, undergraduate students across both Colleges who participated in the inaugural Hornet Leadership Program gained non-technical skills and experiences directly linked to competitiveness and preparation for workforce entry and graduate programs. Finally, faculty surveys and the faculty professional development workshop indicate that faculty value student leadership development, but identify barriers to accomplishing this work. 
    more » « less
  5. Abstract This study indicates the most effective combinations of scaffolding features within computer science and technology education settings. It addresses the research question, “What combinations of scaffolding characteristics, contexts of use, and assessment levels lead to medium and large effect sizes among college‐ and graduate‐level engineering and technology learners?” To do so, studies in which scaffolding led to a medium or large effect size within the context of technology and engineering education were identified within a scaffolding meta‐analysis data set. Next, two‐step cluster analysis in SPSS 24 was used to identify distinct groups of scaffolding attributes tailored to learning computer science at the undergraduate and graduate levels. Input variables included different scaffolding characteristics, the context of use, education level, and effect size. There was an eight‐cluster solution: five clusters were associated with large effect size, two with medium effect size, and one with both medium and large effect size. The three most important predictors were the context in which scaffolding was used, if and how scaffolding is customized over time and the decision rules that govern scaffolding change. Notably, highly effective scaffolding clusters are associated with most levels of each predictor. 
    more » « less