skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: NeTra: A Neuro-Symbolic System to Discover Strategies in Math Learning
Understanding how students with varying capabilities think about problem solving can greatly help in improving personalized education which can have significantly better learning outcomes. Here, we present the details of a system we call NeTra that we developed for discovering strategies that students follow in the context of Math learning. Specifically, we developed this system from large-scale data from MATHia that contains millions of student-tutor interactions. The goal of this system is to provide a visual interface for educators to understand the likely strategy the student will follow for problems that students are yet to attempt. This predictive interface can help educators/tutors to develop interventions that are personalized for students. Underlying the system is a powerful AI model based on Neuro-Symbolic learning that has shown promising results in predicting both strategies and the mastery over concepts used in the strategy.  more » « less
Award ID(s):
1934745
PAR ID:
10353238
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Proceedings of The Third Workshop of the Learner Data Institute , The 15th International Conference on Educational Data Mining (EDM 2022)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Technological tools, like virtual assistants (aka chatbots), have been ubiquitous in people’s day to day. The challenge becomes how educators leverage digital omnipresence to benefit the learning environment. Using a curated chatbot allows educators to reach more students with instructor-approved information, particularly in large classrooms. Students can receive direct responses and guidance towards course materials, and educators may have less to manage by automating routine queries to a chatbot. Data from the 293 collected logs from 232 unique student users provide insight into the information students are interested in when tasked to complete an essay assignment contextualizing chemistry through a sustainability lens. Using process mining to show how students seek information, the extracted 5185 events from the logs created 204 unique pathways from students’ actions in the curated chatbot. Additional text mining was done on the 116 freeform queries students typed into the curated chatbot. Results from both analyses showed that students were primarily sought information on the sustainability context of the writing assignment in their queries and that the curated chatbot can provide personalized assistance, responding to students’ unique pathways of seeking help. A selection of subsets of student users’ chatbot interactions, limitations of the study, and extension of the curated chatbot use in other classroom tasks and settings were discussed. 
    more » « less
  2. This Innovate Practice full paper presents a cloud-based personalized learning lab platform. Personalized learning is gaining popularity in online computer science education due to its characteristics of pacing the learning progress and adapting the instructional approach to each individual learner from a diverse background. Among various instructional methods in computer science education, hands-on labs have unique requirements of understanding learner's behavior and assessing learner's performance for personalization. However, it is rarely addressed in existing research. In this paper, we propose a personalized learning platform called ThoTh Lab specifically designed for computer science hands-on labs in a cloud environment. ThoTh Lab can identify the learning style from student activities and adapt learning material accordingly. With the awareness of student learning styles, instructors are able to use techniques more suitable for the specific student, and hence, improve the speed and quality of the learning process. With that in mind, ThoTh Lab also provides student performance prediction, which allows the instructors to change the learning progress and take other measurements to help the students timely. For example, instructors may provide more detailed instructions to help slow starters, while assigning more challenging labs to those quick learners in the same class. To evaluate ThoTh Lab, we conducted an experiment and collected data from an upper-division cybersecurity class for undergraduate students at Arizona State University in the US. The results show that ThoTh Lab can identify learning style with reasonable accuracy. By leveraging the personalized lab platform for a senior level cybersecurity course, our lab-use study also shows that the presented solution improves students engagement with better understanding of lab assignments, spending more effort on hands-on projects, and thus greatly enhancing learning outcomes. 
    more » « less
  3. Personalized recommendation of learning content is one of the most frequently cited benefits of personalized online learning. It is expected that with personalized content recommendation students will be able to build their own unique and optimal learning paths and to achieve course goals in the most optimal way. However, in many practical cases students search for learning content not to expand their knowledge, but to address problems encountered in the learning process, such as failures to solve a problem. In these cases, students could be better assisted by remedial recommendations focused on content that could help in resolving current problems. This paper presents a transparent and explainable interface for remedial recommendations in an online programming practice system. The interface was implemented to support SQL programming practice and evaluated in the context of a large database course. The paper summarizes the insights obtained from the study and discusses future work on remedial recommendations. 
    more » « less
  4. Introductory engineering courses at large universities often number over a hundred students, while online classes can have even larger enrollments, significantly constraining instructors’ ability to provide feedback on homework, including the free-body diagrams (FBDs). Most online homework systems do not provide feedback on FBDs if the systems even allow the submission, and instructors often lack time or resources to provide this. A few systems have been developed that use a menu-based system allowing students to creative FBDs. There is a growing concern amongst engineering educators that student lacks critical sketching skills and the ability to idealize a real-world system as a free body diagram (FBD). A sketch-recognition based tutoring system, Mechanix, allows learners to hand-draw solutions just as they would with pencil and paper, while also providing iterative real-time personalized feedback. Sketch recognition algorithms use artificial intelligence to identify the shapes, their relationships, and other features of the sketched student drawing. Other AI algorithms then determine if and why a student’s work is incorrect, enabling the tutoring system to return immediate and iterative personalized feedback facilitating student learning that is otherwise not possible in large classes. Preliminary results using Mechanix, a sketch-based statics tutoring system built at Texas A&M University suggest that a sketch-based tutoring system increases homework motivation in struggling students and is as effective as paper-and-pencil-based homework for teaching method of joints truss analysis. The current project implements Mechanix at five different universities obtaining Pre/Post Concept Inventory, homework, and exam scores. It is compared against either the university's current online system or paper-based homework. Focus groups provide further insight into the students’ perceptions about the impact of Mechanix on their learning. 
    more » « less
  5. Despite calls over the past two decades to develop and deploy graduate STEM education models that prepare students for a variety of careers outside of academia, few innovations have emerged to meet students at their current skill and preparation levels when entering their graduate studies while also considering students’ individual desired career paths. The U.S.’s current approach to graduate STEM education does not emphasize preparing students with the professional skills and experience outside the lab. Further, students from differing socioeconomic and underserved backgrounds are often not adequately supported. Through a National Science Foundation Innovations in Graduate Education (IGE) award, the University of Pittsburgh Swanson School of Engineering is creating and validating a personalized learning model (PLM) for graduate education within the Department of Chemical and Petroleum Engineering. The goal of this model is to transform and modernize graduate STEM education through a personalized, inclusive, and student-centered approach, which will, in turn, advance existing knowledge on the relationship between personalized learning and student outcomes. The principles of personalized learning guide the PLM. The PLM is comprised of five components. The first three components provide an intentional approach to learning: Instructional Goals developed for each student based on a learner profile and individual development plans (IDP), a purposeful Task Environment that breaks the traditional three-credit coursework into modules and co-curricular professional development streams, and a resolute approach to Scaffolding Instruction that leads to mastery in the student’s area of focus. The last two components provide feedback and reflection: Assessment of Performance Learning quantifies students’ progress, and Reflection and Evaluation, where improvement opportunities help the student to develop further. Incorporating personalization at every touchpoint of a graduate student’s academic journey creates an authentic, customized, student-centered approach to graduate education. This paper describes in detail the model and the literature behind its development, along with assessments used to guide students. 
    more » « less