An official website of the United States government
This work falls under the evidence-based practice type of paper. Online undergraduate engineering education is rapidly increasing in use. The online format not only provides greater flexibility and ease of access for students, but also has lower costs for universities when compared to face-to-face courses. Even with these generally positive attributes, online courses face challenges with respect to student attrition. Numerous studies have shown that the dropout rate in online courses is higher than that for in-person courses, and topics related to online student persistence remain of interest. Data describing student interactions with their Learning Management System (LMS) provide an important lens through which online student engagement and corresponding persistence decisions can be studied, but many engineering education researchers may lack experience in working with LMS interaction data. The purpose of this paper is to provide a concrete example for other engineering education researchers of how LMS interaction data from online undergraduate engineering courses can be prepared for analysis. The work presented here is part of a larger National Science Foundation-funded study dedicated to developing a theoretical model for online undergraduate engineering student persistence based on student LMS interaction activities and patterns. Our sample dataset includes six courses, two from electrical engineering and four from engineering management, offered during the fall 2018 semester at a large, public southwestern university. The LMS interaction data provides details about students’ navigations to and submissions of different course elements including quizzes, assignments, discussion forums, wiki pages, attachments, modules, the syllabus, the gradebook, and course announcements. Relatedly, the features created from the data in this study can be classified into three categories: 1) learning page views, which capture student interactions with course content, 2) procedural page views, which capture student navigation to course management activities, and 3) social page views, which capture learner-to-learner and learner-to-instructor interactions. The full paper will provide the rationale and details involved in choices related to data cleaning, manipulation, and feature creation. A complete list of features will also be included. These features will ultimately be combined with associative classification to discover relationships between student-LMS interactions and persistence decisions.
more »
« less
How do students perceive their own and their peers' progress in e-learning?
Purpose Interest is currently growing in open social learner modeling (OSLM), which means making peer models and a learner's own model visible to encourage users in e-learning. The purpose of this study is to examine students' views about the OSLM in an e-learning system. Design/methodology/approach This case study was conducted with 40 undergraduate students enrolled in advanced programming and database management system courses. A Likert-type questionnaire and open-ended questions were used to obtain the students' views. System usage data were also analyzed to ensure the richness and diversity of the overall data set. Findings The quantitative data of the students' views were analyzed with descriptive statistics; the results are presented as graphics. The qualitative data of the students' views were examined by content analysis to derive themes. These themes are organized into four subtopics: the students' positive views, their negative views, their improvement suggestions and their preferences about using similar OSLM visualizations in other e-learning systems. The students' subjective views are discussed in the context of their recorded interactions with the system. Research limitations/implications Competition due to seeing peer models was considered by participants both as positive and negative features of the learning system. So, this study revealed that, the ways to combine peer learner models to e-learning systems that promote positive competition without resulting social pressure, still need to be explored. Practical implications By combining open learner models with open peer models, OSLM enhances the learning process in three different ways: it supports self-regulation, encourages competition and empowers self-evaluation. To take advantage of these positive contributions, practitioners should consider enhancing e-learning systems with both own learner and peer model features. Originality/value Despite increasing interest in OSLM studies, several limitations and problems must be addressed such as sparsity of data and lack of study of different contexts and cultures. To date, no published study in this area exists in Turkey. The purpose of this study is to fill this gap by examining OSLM features in an e-learning system from the perspectives of Turkish students by using both their system interaction data and their subjective views.
more »
« less
- Award ID(s):
- 1822752
- PAR ID:
- 10301171
- Date Published:
- Journal Name:
- The International Journal of Information and Learning Technology
- Volume:
- 38
- Issue:
- 1
- ISSN:
- 2056-4880
- Page Range / eLocation ID:
- 49 to 74
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Hilliger, Isabel; Muñoz-Merino, Pedro J.; De Laet, Tinne; Ortega-Arranz, Alejandro; Farrell, Tracie (Ed.)Studies of technology-enhanced learning (TEL) environments indicated that learner behavior could be affected (positively or negatively) by presenting information about their peer groups, such as peer in-system performance or course grades. Researchers explained these findings by the social comparison theory, competition, or by categorizing them as an impact of gamification features. Although the choice of individual peers is explored considerably in recent TEL research, the effect of learner control on peer-group selection received little attention. This paper attempts to extend prior work on learner-controlled social comparison by studying a novel fine-grained peer group selection interface in a TEL environment for learning Python programming. To achieve this goal, we analyzed system usage logs and questionnaire responses collected from multiple rounds of classroom studies. By observing student actions in selecting and refining their peer comparison cohort, we understand better whom the student perceives as their peers and how this perception changes during the course. We also explored the connection between their peer group choices and their engagement with learning content. Finally, we attempted to associate student choices in peer selection with several dimensions of individual differences.more » « less
-
null (Ed.)The purpose the present study is to explore African American undergraduate students' perceptions of their experiences and academic motivation within a Historically Black College or University (HBCU) learning environment. As part of a larger study, we collected 212 open-ended survey responses from first year students in STEM majors about how the HBCU context shapes their academic motivation. We used semantic thematic data analysis and found three major themes and corresponding sub themes that were salient in the development of students' academic motivation: place (institutional climate, HBCU mission and tradition, and absence of marginalization); pedagogy (culturally relevant pedagogy, positive faculty-student relationships, African American curriculum and instruction, racial socialization); and people (people “like me”; student, faculty and alumni models of high achieving African Americans). We discovered that HBCU institutional factors engendered academic motivation that is rooted in students' racial identity and suggest the construct of racial identity-rooted academic motivation. Given the important and unique realities of African American students that impact their educational experiences, engagement, identity development, and achievement in various types of school contexts, self and sociocultural variables must be included in research and theory on the motivational psychology of African American students. Implications for higher education practice and future research are discussed.more » « less
-
null (Ed.)Abstract Research has demonstrated that people generally think both their knowledge and performance levels are greater than they are. Although several studies have suggested that knowledge and progress visualization offered by open learner modeling (OLM) technology might influence students’ self-awareness in a positive way, insufficient evidence exists to show that this is the case. This paper examines the effects of open learner modeling and its extension with social comparison features, known as open social learner modeling (OSLM), on students’ knowledge monitoring abilities. We report the results of two semester-long classroom studies, using subjects who were undergraduate and graduate students in Java Programming and Database Management courses at the University of Pittsburgh. During their studies, the students were able to use different versions of an online practice system equipped with both OLM and OSLM. The students’ knowledge monitoring abilities were examined in two ways: through absolute and relative assessments. According to the results, although in both OLM and OSLM groups the students’ absolute knowledge monitoring ability increased during the semester-long study, relative self-assessment ability (i.e., their ability to compare their own knowledge levels with the knowledge levels of their peers) only increased in the OSLM group. The authors also traced relationships between the students’ academic achievement and their absolute and relative knowledge monitoring abilities.more » « less
-
Assessing team software development projects is notoriously difficult and typically based on subjective metrics. To help make assessments more rigorous, we conducted an empirical study to explore relationships between subjective metrics based on peer and instructor assessments, and objective metrics based on GitHub and chat data. We studied 23 undergraduate software teams (n= 117 students) from two undergraduate computing courses at two North American research universities. We collected data on teams’ (a) commits and issues from their GitHub code repositories, (b) chat messages from their Slack and Microsoft Teams channels, (c) peer evaluation ratings from the CATME peer evaluation system, and (d) individual assignment grades from the courses. We derived metrics from (a) and (b) to measure both individual team members’contributionsto the team, and theequalityof team members’ contributions. We then performed Pearson analyses to identify correlations among the metrics, peer evaluation ratings, and individual grades. We found significant positive correlations between team members’ GitHub contributions, chat contributions, and peer evaluation ratings. In addition, the equality of teams’ GitHub contributions was positively correlated with teams’ average peer evaluation ratings and negatively correlated with the variance in those ratings. However, no such positive correlations were detected between the equality of teams’ chat contributions and their peer evaluation ratings. Our study extends previous research results by providing evidence that (a) team members’ chat contributions, like their GitHub contributions, are positively correlated with their peer evaluation ratings; (b) team members’ chat contributions are positively correlated with their GitHub contributions; and (c) the equality of team’ GitHub contributions is positively correlated with their peer evaluation ratings. These results lend further support to the idea that combining objective and subjective metrics can make the assessment of team software projects more comprehensive and rigorous.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1108/IJILT-05-2020-0073
