skip to main content


Title: NeTra: A Neuro-Symbolic System to Discover Strategies in Math Learning
Understanding how students with varying capabilities think about problem solving can greatly help in improving personalized education which can have significantly better learning outcomes. Here, we present the details of a system we call NeTra that we developed for discovering strategies that students follow in the context of Math learning. Specifically, we developed this system from large-scale data from MATHia that contains millions of student-tutor interactions. The goal of this system is to provide a visual interface for educators to understand the likely strategy the student will follow for problems that students are yet to attempt. This predictive interface can help educators/tutors to develop interventions that are personalized for students. Underlying the system is a powerful AI model based on Neuro-Symbolic learning that has shown promising results in predicting both strategies and the mastery over concepts used in the strategy.  more » « less
Award ID(s):
1934745
NSF-PAR ID:
10353238
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Proceedings of The Third Workshop of the Learner Data Institute , The 15th International Conference on Educational Data Mining (EDM 2022)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Previous studies have convincingly shown that traditional, content-centered, and didactic teaching methods are not effective for developing a deep understanding and knowledge transfer. Nor does it adequately address the development of critical problem-solving skills. Active and collaborative instruction, coupled with effective means to encourage student engagement, invariably leads to better student learning outcomes irrespective of academic discipline. Despite these findings, the existing construction engineering programs, for the most part, consist of a series of fragmented courses that mainly focus on procedural skills rather than on the fundamental and conceptual knowledge that helps students become innovative problem-solvers. In addition, these courses are heavily dependent on traditional lecture-based teaching methods focused on well-structured and closed-ended problems that prepare students to plug variables into equations to get the answer. Existing programs rarely offer a systematic approach to allow students to develop a deep understanding of the engineering core concepts and discover systematic solutions for fundamental problems. Without properly understanding these core concepts, contextualized in domain-specific settings, students are not able to develop a holistic view that will help them to recognize the big picture and think outside the box to come up with creative solutions for arising problems. The long history of empirical learning in the field of construction engineering shows the significant potential of cognitive development through direct experience and reflection on what works in particular situations. Of course, the complex nature of the construction industry in the twenty-first century cannot afford an education through trial and error in the real environment. However, recent advances in computer science can help educators develop virtual environments and gamification platforms that allow students to explore various scenarios and learn from their experiences. This study aims to address this need by assessing the effectiveness of guided active exploration in a digital game environment on students’ ability to discover systematic solutions for fundamental problems in construction engineering. To address this objective, through a research project funded by the NSF Division of Engineering Education and Centers (EEC), we designed and developed a scenario-based interactive digital game, called Zebel, to guide students solve fundamental problems in construction scheduling. The proposed gamified pedagogical approach was designed based on the Constructivism learning theory and a framework that consists of six essential elements: (1) modeling; (2) reflection; (3) strategy formation; (4) scaffolded exploration; (5) debriefing; and (6) articulation. We also designed a series of pre- and post-assessment instruments for empirical data collection to assess the effectiveness of the proposed approach. The proposed gamified method was implemented in a graduate-level construction planning and scheduling course. The outcomes indicated that students with no prior knowledge of construction scheduling methods were able to discover systematic solutions for fundamental scheduling problems through their experience with the proposed gamified learning method. 
    more » « less
  2. Introductory engineering courses at large universities often number over a hundred students, while online classes can have even larger enrollments, significantly constraining instructors’ ability to provide feedback on homework, including the free-body diagrams (FBDs). Most online homework systems do not provide feedback on FBDs if the systems even allow the submission, and instructors often lack time or resources to provide this. A few systems have been developed that use a menu-based system allowing students to creative FBDs. There is a growing concern amongst engineering educators that student lacks critical sketching skills and the ability to idealize a real-world system as a free body diagram (FBD). A sketch-recognition based tutoring system, Mechanix, allows learners to hand-draw solutions just as they would with pencil and paper, while also providing iterative real-time personalized feedback. Sketch recognition algorithms use artificial intelligence to identify the shapes, their relationships, and other features of the sketched student drawing. Other AI algorithms then determine if and why a student’s work is incorrect, enabling the tutoring system to return immediate and iterative personalized feedback facilitating student learning that is otherwise not possible in large classes. Preliminary results using Mechanix, a sketch-based statics tutoring system built at Texas A&M University suggest that a sketch-based tutoring system increases homework motivation in struggling students and is as effective as paper-and-pencil-based homework for teaching method of joints truss analysis. The current project implements Mechanix at five different universities obtaining Pre/Post Concept Inventory, homework, and exam scores. It is compared against either the university's current online system or paper-based homework. Focus groups provide further insight into the students’ perceptions about the impact of Mechanix on their learning. 
    more » « less
  3. null (Ed.)
    Establishing and sustaining a sense of belonging is a necessary human motivation with particular implications for student learning, including in engineering. Students who experience a sense of belonging are more likely to display intrinsic motivation and establish a stronger sense of identity and persistence. It is important, however, to distinguish different domains of belonging, such as belonging to one’s university, belonging to a major, and belonging in the classroom setting. Our study examines if and how faculty support efforts contribute to diverse students’ sense of belonging in the classroom setting. Specifically, we sought to answer the following research questions: Which faculty support efforts promote a sense of classroom belongingness? Do faculty support efforts differentially promote a sense of classroom belongingness for students based on their demographic characteristics? Data for this study was collected in the Fall of 2018, across ten institutions, n = 819. We used the Faculty Support items from the STEM Student Perspectives of Support Instrument developed from Lee’s model of co-curricular support to answer our research questions. Demographic categories were created to understand if and how faculty support efforts differentially promote a sense of belonging for minoritized students compared to their counterparts. Multiple regression analysis was conducted to examine the faculty support efforts that fostered a sense of belonging in the classroom. Interaction effects were included to understand how faculty support efforts affected classroom belongingness for the students in the demographic groups we identified. Minoritized women were less likely to feel a sense of belonging in the classroom when compared to majoritized men. Neither groups of women believed that their instructors wanted them to succeed, thus negatively impacting their classroom belongingness. There were, however, faculty support efforts that positively contributed to a sense of belonging in the classroom for minoritized women, including instructors’ availability, knowing that they could ask instructors for help in course-related material, and when instructors fostered an atmosphere of mutual respect. Additionally, minoritized women felt a sense of classroom belonging when they could capitalize on their previous experiences to scaffold their learning. Our findings highlight classroom practices and strategies faculty can use in the classroom to support minoritized women’s sense of belonging. These practices and strategies will be a crucial resource for engineering educators and administrators who seek to improve the field’s retention of minoritized and women students. Whereas efforts have been made to recruit minoritized students into engineering, our study points to a clear and crucial role for faculty to play: they can support minoritized students by fostering a sense of belonging in engineering classrooms. 
    more » « less
  4. Background and Situation Analysis

    The importance of Water Sanitation and Hygiene (WASH) projects for the protection of health is embedded in the sustainable development goals. However, within the development and humanitarian fields sustainability of WASH projects is still a challenge with 30–50% of projects failing within two to five years of implementation. Though failure is not linked to any one source, a common theme speaks to a greater need for community engagement and integration of the wants and needs of the end-user in the design process. Social marketing, with its focus on the consumer and use of commercial marketing strategies to achieve behavior change is a promising approach that can be integrated into ongoing WASH initiatives to meet program outcomes and to achieve long-term sustainability.

    Priority audience

    Primary audience includes technicians who manufacture and repair pitcher pumps. Secondary audience includes community members in Toamasina, Madagascar, who will experience a decrease in exposure to lead through their water supply.

    Behavioral objectives

    Decrease exposure to lead (Pb) introduced through the use of a decentralized, self-supply water system, the pitcher pump. Specifically, decrease use of leaded components in the manufacturing and repair of pitcher-pumps

    Strategy/Intervention

    Development of the intervention followed the social marketing process including conducting a situational analysis, identification and selection of a behavioral focus and priority population, formative research, development of an integrated marketing strategy, pretesting the strategy, followed by campaign implementation, and monitoring and evaluation. An intervention focused on building a sense of community and introducing the element of professionalism for the pump manufacturers was developed, consisting of personalized one-on-one outreach to raise awareness of the health topic, followed by skill building trainings on how to make the switch to non-leaded components. This was coupled with tangible products that created a new professional network, documentation of work, and backing of work by trusted government entities.

    Evaluation Methods and Results

    Using the theory of planned behavior, a pre/post-test summative evaluation was developed. Preliminary results indicate that pump technicians no longer use lead in pumps unless specifically requested by the pump owners. These results indicate a positive shift towards the use of lead-free components with project follow-up and analysis ongoing.

    Recommendations for Social Marketing Practice

    Use of social marketing within the WASH sector is lacking. This paper demonstrates the integration of social marketing in an ongoing WASH project. Through a description of each step of the process, our experiences in implementing it and the lessons learned, we hope to guide future integration. Additionally, this paper demonstrates the convergence of engineers and social marketers working collaboratively on an interdisciplinary team and how this served to enhance project understanding, aid in building local partnerships and help with long-term sustainability.

     
    more » « less
  5. We STEM educators often hear that so many of our students fail because they are not college ready. But interventions at various levels, despite the hard work of implementation, have not resulted in dramatic improvements. What if, instead, the problem is that the institutional system – including instructional approaches and policies – is not student ready? The goal of our NSF supported project, called “Eco-STEM,” is to establish a healthy STEM educational ecosystem that allows all individuals within the ecosystem to thrive. The context for our work on STEM educational ecosystems is a Very High Hispanic Enrolling Hispanic-Serving Institution (HSI) at California State University, Los Angeles, where the majority of our students are also low-income and first-generation college students. Guided by an ecosystem paradigm, the project aims to: 1) create a supportive and culturally responsive learning/working environment for both students and faculty; 2) make teaching and learning rewarding and fulfilling experiences; and 3) emphasize the assets of our community to enhance motivation, excellence, and success. Currently, many STEM educators have a mental model of the education system as a pipeline or pathway, and this factory-like model requires standard inputs, expecting students to come prepared with certain knowledge and skills [4]. When the educational system is viewed as a factory assembly line (as shown in Figure 1), interventions are focused on fixing the inputs by trying to increase students’ preparedness, which contributes to a prevailing deficit-focused mindset. This not only hinders student growth but also makes educational institutions less inclusive and teaching less rewarding for faculty. Increasingly, equity-minded educators and researchers employing the framework of community cultural wealth suggest that we need an asset-based mindset if we are to help all students achieve success in STEM. Research on ecosystem models offers a new way of thinking. In contrast to pipelines or pathways, which focus on student outcomes, an ecosystem model is centered on the learning environment, communities, and the experiences that diverse students, faculty, and staff have in the system as active agents. The Eco-STEM project proposes to: 1) shift the mental models of STEM faculty from factory- based to ecosystem-based so that they will intentionally establish healthy classroom ecosystems that facilitate learning for all students regardless of their backgrounds; 2) change the mental models and develop the capacity of department chairs and program coordinators so they can lead the cultural changes needed to create a healthy ecosystem at the department level; and 3) revise the teaching evaluation system to promote faculty development and enhance the student experience, which will help to create a healthy ecosystem at the institution. One fundamental aspect of this project is the Eco-STEM Faculty Fellows Community of Practice (CoP), which is designed to help foster these changes. As a work-in-progress paper, this paper presents the design and structure of the Eco-STEM Faculty Fellows CoP and seeks input from the faculty development community on our approach to fostering a healthy educational ecosystem for the majority marginalized student population we serve. 
    more » « less