skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Demographic Mediation of the Relationship Between Engagement and Performance in a Blended Dynamics Engineering Course
ABSTRACT CONTEXT This paper examines an engineering dynamics course at Purdue University that was specifically designed to create an active, blended, and collaborative environment. In addition to in-person classes and support, students have access to blended content such as solution videos, mechanics visualizations, a course discussion forum, and interactive simulations. PURPOSE Many studies have shown that students’ engagement in an online discussion forum enhances their learning performance (Davies & Graff, 2005; Hrastinski, 2008). However, our previous research showed that students’ engagement in the online forum of our dynamics course differed significantly across students’ demographics. We showed that women, white, or Asian American students were more likely to be involved in online discussions than men, international, or Hispanic students (Duan et al., 2018). In this paper, we take the previous analysis further by examining whether the observed differences in online student engagement mediate or moderate student performance. APPROACH To answer our research question, we will first investigate the mediation effect by creating two models. A first model with race/international status as the mediating variable and gender identity as a control variable, and a second model with gender identity as the mediating variable and race/international status as a control. Second, we will investigate the moderation effect of demographic factors by creating a regression model including interaction terms to show the relationship of each demographic’s discussion forum engagement to overall performance. The goal of investigating these interaction terms is to determine if a moderating relationship exists where demographic factors impact online engagement, which in turn impact course performance. CONCLUSIONS We find that gender identity is the only significant demographic factor that moderates the effect of a student’s engagement on their performance. Based on the findings of our previous work, students of various racial and ethnic identities do engage differently in the discussion forum. However, this analysis was unable to detect any significant difference in student engagement based on demographics. Our paper contributes to understanding the mechanisms through which students’ engagement can translate into academic performance by focusing on their demographic background. The moderating role of students’ demographic background calls for a more targeted design of instructional tools in blended and collaborative environments to better support students from various demographic backgrounds.  more » « less
Award ID(s):
1915574
PAR ID:
10355868
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Proceedings of REES AAEE 2021
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Students belonging to marginalized groups experience positive impacts when taught by a teacher of the same race, ethnicity, and gender. The unique nature of standardized, asynchronous online course taking allows for greater separation of any possible educational benefits of student versus teacher-driven mechanisms contributing to these improved outcomes. Using a student-by-course fixed effect strategy on data from a large urban school district, I examined associations between whether students experienced racial/ethnic or gender congruence with their remote instructor and both engagement and learning outcomes. Students who identified as Black demonstrated higher rates of engagement, although no difference in achievement, within lessons taught by a same-race remote instructor. I find that representation is associated with engagement even when instructors follow closely scripted lessons, representation occurs in only small doses, and instruction occurs in an impersonal setting. 
    more » « less
  2. This study investigated patterns in the development of computational thinking practices in the context of the Exploring Computer Science (ECS) program, a high school introductory CS course and professional development program designed to foster deep engagement through equitable inquiry around CS concepts. Past research indicates that the personal relevance of the ECS experience influences students' expectancy-value towards computer science. Expectancy-value is a construct that is predictive of career choices. We extended our research to examine whether expectancy-value influences the development of computational thinking practices. This study took place in the context of two ECS implementation projects across two states. Twenty teachers, who implemented ECS in 2016–17, participated in the research. There were 906 students who completed beginning and end of year surveys and assessments. The surveys included demographic questions, a validated expectancy-value scale, and questions about students' course experiences. The assessments were developed and validated by SRI International as a companion to the ECS course. Overall, student performance statistically increased from pretest to posttest with effect size of 0.74. There were no statistically significant differences in performance by gender or race/ethnicity. These results are consistent with earlier findings that a personally relevant course experience positively influences students' expectancy for success. These results expanded on prior research by indicating that students' expectancy-value for computer science positively influenced student learning. 
    more » « less
  3. This research paper investigates the relationship between race/ ethnicity, gender, first-generation college student status, and engineering identity using cross-sectional data from early-career engineering majors. Measures of engineering identity are increasingly used in models of engineering education to evaluate how identity contributes to success and persistence of engineering students. Engineering identity is generally assumed to contribute to educational success, with stronger engineering identity leading to persistence. At the same time, data clearly shows that persistence of engineering students varies by race/ethnicity and gender. Given these previous findings, we would expect to find that engineering identity will vary by race/ ethnicity, gender, and first generation status. Yet, relatively little work has quantitatively compared how engineering identity differs across racial/ ethnic groups and gender. While researchers are increasingly trying to gain a better understanding of engineering identity among Latina students, for example, the literature has not yet adequately accounted for how Latina students differ from their non-Hispanic white peers. This works seeks to address that gap in the literature with an exploration of the ways that race/ethnicity, gender, and first generation status work together to impact engineering identity among early-career engineering students at four public Hispanic-Serving Institutions (HSIs) in the Southwestern United States. We conducted surveys as part of a longitudinal study on STEM education. Data discussed here comes from baseline surveys of three cohorts of engineering students (N=475). Approximately two-thirds of the respondents were attending a traditional 4-year university while the remainder (N=159) were attending community college at the time of the survey. Approximately two-thirds of the respondents identified as Latinx, 27% identified as female, and 26.5% reported that they were first-generation college students. While expectations were that engineering identity would vary by race/ethnicity and gender, preliminary analyses of our data unexpectedly reveal no significant differences between Latinx and White students in terms of their engineering identity and no significant differences in engineering identity between male and female students. Interactions between race/ethnicity and gender were also tested and yielded no significant differences between early-career Latinx and White students in terms of their engineering identity. Finally, students who reported that they will be the first in their family to get a college degree had significantly lower engineering identity scores (=-.422; p=.001). These results lead us to conclude that first generation status at HSIs may be more important than gender and race/ ethnicity in the development of engineering identity for early career students. 
    more » « less
  4. Previous research has established that peer relationships are important for student success, yet little research has examined connections made in the classroom, as opposed to residence life or extracurricular activities. This project utilized social network analysis in two cohorts of science and mathematics majors to investigate the degree to which students take multiple courses with the same peers. Results showed (1) wide variability in student networks, (2) course selection by students included more repeated connections than random course selection, (3) networks did not vary much by demographic variables (gender, race, first-generation status, and income), and (4) student networks significantly predicted graduation and grades. This correlational research provides a foundation for future experimental research testing the causal impact of classroom-based student networks. This research also serves as a model for how other institutions may analyze institutional data to understand patterns of peer connections and course enrollment at their institution. 
    more » « less
  5. Abstract BackgroundEngineering requires new solutions to improve undergraduate performance outcomes, including course grades and continued enrollment in engineering pathways. Belonging and engineering role identity have long been associated with successful outcomes in engineering, including academic success, retention, and well‐being. PurposeWe measure the relationships between belonging and role identity at the beginning of a first‐year engineering course with course grade and continued enrollment in engineering courses. We test the effect of an ecological belonging intervention on student belonging, course grade, and persistence. MethodStudents (n = 834) reported their sense of belonging in engineering, cross‐racial experiences, engineering performance/competence, interest in engineering, and engineering recognition before and after an in‐class intervention to improve classroom belonging ecology. Through a series of longitudinal multigroup path analyses, a form of structural equation modeling, we tested the predictive relationships of the measured constructs with engineering identity and investigated differences in these relationships by student gender and race/ethnicity. FindingsThe proposed model predicts course grades and continued enrollment, providing insight into the potential for interventions to support first‐year engineering students. Group analysis results demonstrate the difference in the function of these psychosocial measures for women and Black, Latino/a/x, and Indigenous (BLI) students, providing insights into the potential importance of sociocultural interventions within engineering classrooms to improve the engineering climate, engagement, and retention of students. ImplicationsThe results highlight the need for more specific, nuanced theoretical investigations of how marginalized students experience the engineering environment and develop social belonging and engineering role identity. 
    more » « less