skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Step-Based Tutoring System to Teach Underachieving Students How to Construct Algebraic Models
An algebraic model uses a set of algebraic equations to describe a situation. Constructing such models is a fundamental skill, but many students still lack the skill, even after taking several algebra courses in high school and college. For such students, we developed instruction that taught students to decompose the to-be-modelled situation into schema applications, where a schema represents a simple relationship such as distance-rate-time or part-whole. However, when a model consists of multiple schema applications, it needs some connection among them, usually representedby letting the same variable appear in the slots of two or more schemas. Students in our studies seemed to have more trouble identifying connections among schema applications than identifying the schema applications themselves. We developed several tutoring systems and evaluated them in university classes. One of them, a step-based tutoring system called OMRaaT (One Mathematical Relationship at a Time), was both reliably superior (p = 0.02, d = 0.67) to baseline and markedly superior (p < 0.001, d = 0.84) to an answer-based tutoring system using only commercially available software (MATLAB Grader).  more » « less
Award ID(s):
1840051
PAR ID:
10429908
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
International Journal of Artificial Intelligence in Education
ISSN:
1560-4292
Page Range / eLocation ID:
1-33
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. An algebraic model uses a set of algebraic equations to describe a situation. Constructing such models is a fundamental skill, but many students still lack the skill, even after taking several algebra courses in high school and college. For underachieving college students, we developed a tutoring system that taught students to decompose the to-be-modelled situation into schema applications, where a schema represents a simple relationship such as distance-rate-time or part-whole. However, when a model consists of multiple schema applications, it needs some connection among them, usually represented by letting the same variable appear in the slots of two or more schemas. Students in our studies seemed to have more trouble identifying connections among schemas than identifying the schema applications themselves. This paper describes a newly designed tutoring system that emphasizes such connections. An evaluation was conducted using a regression discontinuity design. It produced a marginally reliable positive effect of moderate size (d = 0.4). 
    more » « less
  2. Perspective sketching is a skill that is required for a variety of jobs including, but not limited to, architectural design, graphic design, and engineering. Sketching however, is a difficult skill to grasp for people early and can take a while to learn. Recently, there have been many intelligent tutoring systems (ITSs) designed to help improve people’s drawing skills. The feedback system for the perspective drawing lessons in SketchTivity, one such ITS, is currently limited to smoothness, speed, and accuracy of the lines. Our team plans to improve upon this feedback system so that the feedback provided to a user is now more nuanced as well as more actionable to reaffirm future learning. To evaluate our system we will conduct a user study with 40 students that involves going through several sketching lessons and then sketching a street corner in 2-D perspective. We plan to run a between-subjects user study with our participants to determine if our adjustment has any effect on the improvement of sketching skills and the usability of the application. We hope to determine that providing the user with data for their smoothness, speed, and accuracy after four sketching prompts can cause an overall improvement in the students’ scores in comparison to at the end of their sketching session. The algorithm that we created to identify a student’s potential issue we hope will be able to provide accurate, actionable feedback in most situations. The visual alterations we made to SketchTivity we expect to have a positive impact on the perspective feedback system and alter the students sketching performance. In future iterations the algorithm should be further refined and the data collected from the students sketches should be further developed to provide more data to create more actionable recommendations for improved sketching performance and retention. 
    more » « less
  3. This Research Work In Progress Paper examines empirical evidence on the impacts of feedback from an intelligent tutoring software on sketching skill development. Sketching is a vital skill for engineering design, but sketching is only taught limitedly in engineering education. Teaching sketching usually involves one-on-one feedback which limits its application in large classrooms. To meet the demands of feedback for sketching instruction, SketchTivity was developed as an intelligent tutoring software. SketchTivity provides immediate personalized feedback on sketching freehand practice. The current study examines the effectiveness of the feedback of SketchTivity by comparing students practicing with the feedback and without. Students were evaluated on their motivation for practicing sketching, the development of their skills, and their perceptions of the software. This work in progress paper examines preliminary analysis in all three of these areas. 
    more » « less
  4. Introductory engineering courses within large universities often have annual enrollments exceeding several hundreds of students, while online classes have even larger enrollments. It is challenging to achieve differentiated instruction in classrooms with class sizes and student diversity of such great magnitude. In such classes, professors assess whether students have mastered a concept through multiple-choice questions, marking answers as right or wrong with little feedback, or using online text-only systems. However, in these scenarios the feedback is of a mostly binary nature (right or wrong) with limited constructive feedback to scaffold learning. A growing concern among engineering educators is that students are losing both the critical skill of sketched diagrams and the ability to take a real system and reduce it to an accurate but simplified free-body diagram (FBD). A sketch-recognition based tutoring system, called Mechanix, allows students to hand-draw solutions just as they would with pencil and paper, while also providing iterative real-time personalized feedback. Sketch recognition algorithms use artificial intelligence to identify the shapes, their relationships, and other features of the sketched student drawing. Other AI algorithms then determine if and why a student’s work is incorrect, enabling the tutoring system to return immediate and iterative personalized feedback facilitating student learning that is otherwise not possible in large classes. To observe the effectiveness of this system, it has been implemented into various courses at three universities, with two additional universities planning to use the system within the next year. Student knowledge is measured using Concept Inventories based in both Physics and Statics, common exam questions, and assignments turned in for class. Preliminary results using Mechanix, a sketch-based statics tutoring system built at Texas A&M University, suggest that a sketch-based tutoring system increases homework motivation in struggling students and is as effective as paper-and-pencil-based homework for teaching method of joints truss analysis. In focus groups, students believed the system enhanced their learning and increased engagement. Keywords: sketch recognition; intelligent user interfaces; physics education; engineering education 
    more » « less
  5. Abstract This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions. 
    more » « less