skip to main content


Title: Interactive Editing of Circuits in a Step-Based Tutoring System
Step-based tutoring systems are known to be more effective than traditional answer-based systems. They however require that each step in a student’s work be accepted and evaluated automatically to provide effective feedback. In the domain of linear circuit analysis, it is frequently necessary to allow students to draw or edit circuits on their screen to simplify or otherwise transform them. Here, the interface developed to accept such input and provide immediate feedback in the Circuit Tutor system is described, along with systematic assessment data. Advanced simplification methods such as removing circuit sections that are removably hinged, voltage-splittable, or current-splittable are taught to students in an interactive tutorial and then supported in the circuit editor itself. To address the learning curve associated with such an interface, ~70 video tutorials were created to demonstrate exactly how to work the randomly generated problems at each level of each of the tutorials in the system. A complete written record or “transcript” of student’s work in the system is being made available, showing both incorrect and correct steps. Introductory interactive (multiple choice) tutorials are now included on most topics. Assessment of exercises using the interactive editor was carried out by professional evaluators for several institutions, including three that heavily serve underrepresented minorities. Both quantitative and qualitative methods were used, including focus groups, surveys, and interviews. Controlled, randomized, blind evaluations were carried out in three different course sections in Spring and Fall 2019 to evaluate three tutorials using the interactive editor, comparing use of Circuit Tutor to both a commercial answer-based system and to conventional textbook-based paper homework. In Fall 2019, students rated the software a mean of 4.14/5 for being helpful to learn the material vs. 3.05/5 for paper homework (HW), p < 0.001 and effect size d = 1.11σ. On relevant exam questions that semester, students scored significantly (p = 0.014) higher with an effect size of d = 0.64σ when using Circuit Tutor compared to paper HW in one class section, with no significant difference in the other section.  more » « less
Award ID(s):
1821628
NSF-PAR ID:
10179925
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
American Society for Engineering Education Annual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Step-based tutoring consists in breaking down complicated problem-solving procedures into individual steps whose inputs can be immediately evaluated to promote effective student learning. Here, recent progress on the extension of a step-based tutoring for linear circuit analysis to cover new topics requiring complex, multi-step solution procedures is described. These topics include first and second-order transient problems solved using classical differential equation approaches. Students use an interactive circuit editor to modify the circuit appropriately for each step of the analysis, followed by writing and solving equations using methods of their choice as appropriate. Initial work on Laplace transform-based circuit analysis is also discussed. Detailed feedback is supplied at each step along with fully worked examples, supporting introductory multiple-choice tutorials and YouTube videos, and a full record of the student's work is created in a PDF document for later study and review. Further, results of a comprehensive independent evaluation involving both quantitative and qualitative analysis and users across four participating institutions are discussed. Overall, students had very favorable experiences using the step-based system across Fall 2020 and Spring 2021. At least 48% of students in the Fall 2020 semester and 60% of students in the Spring 2021 semester agreed or strongly agreed with all survey questions about positive features of the system. Those who had used the step-based system and the commercial MasteringEngineering system preferred the former by 69% to 12% margins in surveys. Instructors were further surveyed and 86% would recommend the system to others. 
    more » « less
  2. Step-based tutoring consists in breaking down complicated problem-solving procedures into individual steps whose inputs can be immediately evaluated to promote effective student learning. Here, recent progress on the extension of a step-based tutoring for linear circuit analysis to cover new topics requiring complex, multi-step solution procedures is described. These topics include first and second-order transient problems solved using classical differential equation approaches. Students use an interactive circuit editor to modify the circuit appropriately for each step of the analysis, followed by writing and solving equations using methods of their choice as appropriate. Initial work on Laplace transform-based circuit analysis is also discussed. Detailed feedback is supplied at each step along with fully worked examples, supporting introductory multiple-choice tutorials and YouTube videos, and a full record of the student's work is created in a PDF document for later study and review. Further, results of a comprehensive independent evaluation involving both quantitative and qualitative analysis and users across four participating institutions are discussed. Overall, students had very favorable experiences using the step-based system across Fall 2020 and Spring 2021. At least 48% of students in the Fall 2020 semester and 60% of students in the Spring 2021 semester agreed or strongly agreed with all survey questions about positive features of the system. Those who had used the step-based system and the commercial MasteringEngineering system preferred the former by 69% to 12% margins in surveys. Instructors were further surveyed and 86% would recommend the system to others. 
    more » « less
  3. Computing theory is often perceived as challenging by students, and verifying the correctness of a student’s automaton or grammar is time-consuming for instructors. Aiming to provide benefits to both students and instructors, we designed an automated feedback tool for assignments where students construct automata or grammars. Our tool, built as an extension to the widely popular JFLAP software, determines if a submission is correct, and for incorrect submissions it provides a “witness” string demonstrating the incorrectness. We studied the usage and benefits of our tool in two terms, Fall 2019 and Spring 2021. Each term, students in one section of the Introduction to Computer Science Theory course were required to use our tool for sample homework questions targeting DFAs, NFAs, RegExs, CFGs, and PDAs. In Fall 2019, this was a regular section of the course.We also collected comparison data from another section that did not use our tool but had the same instructor and homework assignments. In Spring 2021, a smaller honors section provided the perspective from this demographic. Overall, students who used the tool reported that it helped them to not only solve the homework questions (and they performed better than the comparison group) but also to better understand the underlying theory concept. They were engaged with the tool: almost all persisted with their attempts until their submission was correct despite not being able to random walk to a solution. This indicates that witness feedback, a succinct explanation of incorrectness, is effective. Additionally, it assisted instructors with assignment grading. 
    more » « less
  4. ABET lists the ability to communicate in writing to both technical and non-technical audiences as a required outcome for baccalaureate engineering students [1]. From emails and memos to formal reports, the ability to communicate is vital to the engineering profession. This Work in Progress paper describes research being done as part of an NSF-funded project, Writing Assignment Tutor Training in STEM (WATTS). The method is designed to improve feedback writing tutors without technical backgrounds give to engineering students on technical reports. Students in engineering programs have few opportunities to develop their writing skills. Usually, composition courses are part of the general education curriculum. Students often see these courses as unrelated to their majors and careers [2]. Ideally, writing support should be integrated throughout a program. Since WATTs capitalizes on existing resources and requires only a modest amount of faculty time, it could enable engineering programs to provide additional writing support to students in multiple courses and provide a bridge for them to see the connection between writing concepts learned in composition courses and their technical reports. WATTS was developed in a junior-level circuit analysis course, where students were completing the same lab and writing individual reports. This paper focuses on a senior capstone course that utilizes concepts taught in previous courses to prepare students to complete an independent team research or design project. Projects are unique, usually based on the needs of an industrial sponsor, and are completed over three consecutive semesters. Each semester, teams write a report based on their activities during that semester, with a comprehensive report in the final semester. The multi-semester nature of the senior design project provides an opportunity for the researchers to chart longitudinal changes from the first to the students’ third semester interactions with the writing tutors, assessing the value of an integrated approach. The program’s impact on students’ attitudes toward revision and the value of tutoring, as well as the impact on tutors, are part of the assessment plan. The program hopes to change the students’ focus from simply presenting their results to communicating them. The goals of the project are to demonstrate to students that revision is essential to the writing process and that feedback can improve their written communication abilities. The expectation is that after graduation they will continue to seek critical feedback as part of their career growth. Surveys given to both students and tutors revealed that the sessions were taken seriously by the students and that meaningful collaboration was achieved between them. An evaluation of the writing in pre-tutored to final submitted report shows statistically significant improvement. Preliminary and current results will be included within the paper. [1] Criteria for Accrediting Engineering Technology Programs, ABET, Baltimore, MD., 2020, p.5, ETAC Criteria (abet.org) [2] Bergmann, L. S. and Zepernick, J., “Disciplinarity and Transfer: Students’ Perceptions of Learning to Write,” Writing Program Administration, 31, Fall/Winter 2007. 
    more » « less
  5. null (Ed.)
    Spatial reasoning skills contribute to performance in many STEM fields. For example, drawing sectional views of three-dimensional objects is an essential skill for engineering students. There is considerable variation in the spatial reasoning skills of prospective engineering students, putting some at risk for compromised performance in their classes. This study takes place in a first-year engineering Spatial Visualization course to integrate recent practices in engineering design education with cognitive psychology research on the nature of spatial learning. We employed three main pedagogical strategies in the course - 1) in class instruction on sketching; 2) spatial visualization training; and 3) manipulation of physical objects (CAD/3D print creations). This course endeavors to use current technology, online accessibility, and implementation of the three pedagogical strategies to bring about student growth in spatial reasoning. This study is designed to determine the effect of adding two different spatial reasoning training apps to this environment. Over 230 students (three sections) participated in our study. In two of the three sections, students received interactive spatial visualization training using either a spatial visualization mobile touchscreen app in one section or an Augmented Reality (AR) app in the other section. Research suggests that there are benefits to using the Spatial Vis Classroom mobile app for college students.The app has been shown to increase student persistence resulting in large learning gains as measured by the Purdue assessment of spatial visualization (PSVT-R), especially for students starting with poor spatial visualization skills. The Spatial Vis Classroom app can be used in the classroom or assigned as homework. The AR app is designed to help users develop their mental rotation abilities. It is designed to support a holistic understanding of 3-dimensional objects, and research has shown that, in combination with a traditional curriculum, it increases students’ abilities also measured by the PSVT-R. Of particular interest, the data suggest that the app overcomes the advantage found by males over females in a traditional class alone focused on spatial reasoning. Both of the course sections were required to use the apps for approximately the same time in class and outside of class. Students in the control section were required to do hand sketching activities in class and outside of class, with roughly the same completion time as for the sections with the apps. Students grades were not affected by using the three different approaches as grading was based on completion only. Based on current literature, we hypothesize that overall benefits (PSVT-R gains) will be comparable across the 3 treatments but there will be different effects on attitude and engagement (confidence,enjoyment, and self-efficacy). Lastly, we hypothesize that the treatments will have different effects on male/female and ethnic categories of the study participants. The final paper will include an analysis of results and a report of the findings. 
    more » « less