skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: UpGrade: Sourcing Student Open-Ended Solutions to Create Scalable Learning Opportunities
In schools and colleges around the world, open-ended home-work assignments are commonly used. However, such assignments require substantial instructor effort for grading, and tend not to support opportunities for repeated practice. We propose UpGrade, a novel learnersourcing approach that generates scalable learning opportunities using prior student solutions to open-ended problems. UpGrade creates interactive questions that offer automated and real-time feedback, while enabling repeated practice. In a two-week experiment in a college-level HCI course, students answering UpGrade-created questions instead of traditional open-ended assignments achieved indistinguishable learning outcomes in ~30% less time. Further, no manual grading effort is required. To enhance quality control, UpGrade incorporates a psychometric approach using crowd workers' answers to automatically prune out low quality questions, resulting in a question bank that exceeds reliability standards for classroom use.  more » « less
Award ID(s):
1740775
PAR ID:
10191772
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the Sixth (2019) ACM Conference on Learning at Scale
Page Range / eLocation ID:
1 to 10
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Technology Innovations in Statistics Education)
    Open-ended assignments - such as lab reports and semester-long projects - provide data science and statistics students with opportunities for developing communication, critical thinking, and creativity skills. However, providing grades and qualitative feedback to open-ended assignments can be very time consuming and difficult to do consistently across students. In this paper, we discuss the steps of a typical grading workflow and highlight which steps can be automated in an approach that we define as an automated grading workflow. We illustrate how gradetools, a new R package, implements this approach within RStudio to facilitate efficient and consistent grading while providing individualized feedback. We hope that this work will help the community of data science and statistics educators use gradetools as their grading workflow assistant or develop their own tools for assisting their grading workflow. 
    more » « less
  2. ; ; ; ; ; ; (, ASEE Annual Conference proceedings)
    It is challenging to effectively educate in large classes with students from a multitude of backgrounds. Many introductory engineering courses in universities have hundreds of students, and some online classes are even larger. Instructors in these circumstances often turn to online homework systems, which help greatly reduce the grading burden; however, they come at the cost of reducing the quality of feedback that students receive. Since online systems typically can only automatically grade multiple choice or numeric answer questions, students predominately do not receive feedback on the critical skill of sketching free-body diagrams (FBD). An online, sketch-recognition based tutoring system called Mechanix requires students to draw free-body diagrams for introductory statics courses in addition to grading their final answers. Students receive feedback about their diagrams that would otherwise be difficult for instructors to provide in large classes. Additionally, Mechanix can grade open-ended truss design problems with an indeterminate number of solutions. Mechanix has been in use for over six semesters at five different universities by over 1000 students to study its effectiveness. Students used Mechanix for one to three homework assignments covering free-body diagrams, static truss analysis, and truss design for an open-ended problem. Preliminary results suggest the system increases homework engagement and effort for students who are struggling and is as effective as other homework systems for teaching statics. Focus groups showed students enjoyed using Mechanix and that it helped their learning process. 
    more » « less
  3. ; ; ; ; ; ; (, ASEE 2022 Annual Conference)
    It is challenging to effectively educate in large classes with students from a multitude of backgrounds. Many introductory engineering courses in universities have hundreds of students, and some online classes are even larger. Instructors in these circumstances often turn to online homework systems, which help greatly reduce the grading burden; however, they come at the cost of reducing the quality of feedback that students receive. Since online systems typically can only automatically grade multiple choice or numeric answer questions, students predominately do not receive feedback on the critical skill of sketching free-body diagrams (FBD). An online, sketch-recognition based tutoring system called Mechanix requires students to draw free-body diagrams for introductory statics courses in addition to grading their final answers. Students receive feedback about their diagrams that would otherwise be difficult for instructors to provide in large classes. Additionally, Mechanix can grade open-ended truss design problems with an indeterminate number of solutions. Mechanix has been in use for over six semesters at five different universities by over 1000 students to study its effectiveness. Students used Mechanix for one to three homework assignments covering free-body diagrams, static truss analysis, and truss design for an open-ended problem. Preliminary results suggest the system increases homework engagement and effort for students who are struggling and is as effective as other homework systems for teaching statics. Focus groups showed students enjoyed using Mechanix and that it helped their learning process. 
    more » « less
  4. (, ASEE annual conference exposition proceedings)
    It is challenging to effectively educate in large classes with students from a multitude of backgrounds. Many introductory engineering courses in universities have hundreds of students, and some online classes are even larger. Instructors in these circumstances often turn to online homework systems, which help greatly reduce the grading burden; however, they come at the cost of reducing the quality of feedback that students receive. Since online systems typically can only automatically grade multiple choice or numeric answer questions, students predominately do not receive feedback on the critical skill of sketching free-body diagrams (FBD). An online, sketch-recognition based tutoring system called Mechanix requires students to draw free-body diagrams for introductory statics courses in addition to grading their final answers. Students receive feedback about their diagrams that would otherwise be difficult for instructors to provide in large classes. Additionally, Mechanix can grade open-ended truss design problems with an indeterminate number of solutions. Mechanix has been in use for over six semesters at five different universities by over 1000 students to study its effectiveness. Students used Mechanix for one to three homework assignments covering free-body diagrams, static truss analysis, and truss design for an open-ended problem. Preliminary results suggest the system increases homework engagement and effort for students who are struggling and is as effective as other homework systems for teaching statics. Focus groups showed students enjoyed using Mechanix and that it helped their learning process. 
    more » « less
  5. ; ; ; ; ; ; (, American Society for Engineering Education Annual Conference)
    It is challenging to effectively educate in large classes with students from a multitude of backgrounds. Many introductory engineering courses in universities have hundreds of students, and some online classes are even larger. Instructors in these circumstances often turn to online homework systems, which help greatly reduce the grading burden; however, they come at the cost of reducing the quality of feedback that students receive. Since online systems typically can only automatically grade multiple choice or numeric answer questions, students predominately do not receive feedback on the critical skill of sketching free-body diagrams (FBD). An online, sketch-recognition based tutoring system called Mechanix requires students to draw free-body diagrams for introductory statics courses in addition to grading their final answers. Students receive feedback about their diagrams that would otherwise be difficult for instructors to provide in large classes. Additionally, Mechanix can grade open-ended truss design problems with an indeterminate number of solutions. Mechanix has been in use for over six semesters at five different universities by over 1000 students to study its effectiveness. Students used Mechanix for one to three homework assignments covering free-body diagrams, static truss analysis, and truss design for an open-ended problem. Preliminary results suggest the system increases homework engagement and effort for students who are struggling and is as effective as other homework systems for teaching statics. Focus groups showed students enjoyed using Mechanix and that it helped their learning process. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email