We present and evaluate a machine learning based system that automatically grades audios of students speaking a foreign language. The use of automated systems to aid the assessment of student performance holds great promise in augmenting the teacher’s ability to provide meaningful feedback and instruction to students. Teachers spend a significant amount of time grading student work and the use of these tools can save teachers a significant amount of time on their grading. This additional time could be used to give personalized attention to each student. Significant prior research has focused on the grading of closed-form problems, open-ended essays and textual content. However, little research has focused on audio content that is much more prevalent in the language-study education. In this paper, we explore the development of automated assessment tools for audio responses in a college-level Chinese language-learning course. We analyze several challenges faced while working with data of this type as well as the generation and extraction of features for the purpose of building machine learning models to aid in the assessment of student language learning.
more »
« less
ime-series Insights into the Process of Passing or Failing Online University Courses using Neural-Induced Interpretable Student States
This paper addresses a key challenge in Educational Data Mining, namely to model student behavioral trajectories in order to provide a means for identifying students most at risk, with the goal of providing supportive interventions. While many forms of data including click stream data or data from sensors have been used extensively in time series models for such purposes, in this paper we explore the use of textual data, which is sometimes available in the records of students at large, online universities. We propose a time series model that constructs an evolving student state representation using both click stream data and a signal extracted from the textual notes recorded by human mentors assigned to each student. We explore how the addition of this textual data improves both the predictive power of student states for the purpose of identifying students at risk for course failure as well as for providing interpretable insights about student course engagement processes.
more »
« less
- Award ID(s):
- 1822831
- PAR ID:
- 10100851
- Date Published:
- Journal Name:
- Proceedings of the 12th International Conference on Educational Data Mining
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
We present and evaluate a machine learning based system that automatically grades audios of students speaking a foreign language. The use of automated systems to aid the assessment of student performance holds great promise in augmenting the teacher’s ability to provide meaningful feedback and instruction to students. Teachers spend a significant amount of time grading student work and the use of these tools can save teachers a significant amount of time on their grading. This additional time could be used to give personalized attention to each student. Significant prior research has focused on the grading of closed-form problems, open-ended essays and textual content. However, little research has focused on audio content that is much more prevalent in language study education. In this paper, we explore the development of automated assessment tools for audio responses in a college-level Chinese language-learning course. We analyze several challenges faced while working with data of this type as well as the generation and extraction of features for the purpose of building machine learning models to aid in the assessment of student language learning.more » « less
-
Random forests are presented as an analytics foundation for educational data mining tasks. The focus is on course- and program-level analytics including evaluating pedagogical approaches and interventions and identifying and characterizing at-risk students. As part of this development, the concept of individualized treatment effects (ITE) is introduced as a method to provide personalized feedback to students. The ITE quantifies the effectiveness of intervention and/or instructional regimes for a particular student based on institutional student information and performance data. The proposed random forest framework and methods are illustrated on a study of the efficacy of a supplemental, weekly, one-unit problem-solving session in a large enrollment, bottleneck introductory statistics course. The analytics tools are used to identify factors for student success, characterize students benefitting from the supplemental instruction section, develop an objective criterion to, at the beginning of the semester, identify and advise these students into that section, and suggest intervention initiatives for at-risk groups in the course.more » « less
-
null (Ed.)Concern about graduation rates in higher education has led universities to offer courses that help students develop success skills. Scientist Life Skills, a new course for freshman at Florida A&M University, focuses on helping students matriculate into majors via development of growth mindset, grit, and critical thinking. Here, we assessed the outcomes of this course and explored the associations between building life skills and student success. A series of mindset, grit, and critical-thinking assessment measures were used to collect data before and after the course. Our results showed that the new course achieved its intended goals of providing STEM students with a set of tools that help them seamlessly transition into the university and successfully matriculate through their majors. Specifically, the course design significantly moved students toward a growth-mindset, increased their critical thinking, and their second-semester grade point averages (GPAs). This model life skills course can be adopted in non-STEM areas as well.more » « less
-
null (Ed.)A well-established literature base identifies a portion of students enrolled in post-secondary General Chemistry as at-risk of failing the course based on incoming metrics. Learning about the experiences and factors that lead to this higher failure rate is essential toward improving retention in this course. This study examines the relationship between study habits and academic performance for at-risk students in General Chemistry. Students who were in the bottom quartile of SAT math scores were identified as at-risk students. The study habits of General Chemistry students, both those identified as at-risk and those not identified were measured by text message inquiries. The text message asked ‘‘Have you studied for General Chemistry I in the past 48 hours? If so, how did you study?” twice a week throughout a semester. Student responses to the messages were used to calculate the frequency of studying throughout the term. The results from a multiple regression analysis showed that high frequency of studying could mitigate the difference between at-risk and non-at-risk students on final exam scores. Additionally, the quality of studying for six at-risk students was analyzed by student interviews in concert with their text message responses. The results indicated that the quality of studying is not necessarily linked to frequency of studying and both quality and frequency can play a role in at-risk students' academic performance. The results presented offer a path for at-risk students to succeed in General Chemistry and the methodology presented offers a potential avenue for evaluating future efforts to improve student success.more » « less
An official website of the United States government

