skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: AWeb-Based Writing Exercise Employing Directed Line of Reasoning Feedback for a Course on Electric Circuit Analysis
The use of writing-based exercises in a circuit analysis course has shown promise in aiding students likely to struggle in the course by enhancing their conceptual understanding of topics related to DC circuit analysis [1]. As grading of writing samples and providing personalized feedback can be time-intensive, automating the evaluation and feedback processes through use of emerging techniques in natural language processing (NLP) could open the door for more widespread use of such writing exercises across STEM courses, thus benefiting students in most need of assistance. In this paper, the development and initial testing of two web-based writing activities that leverage a basic NLP technique to probe student writing related to DC circuits are described. The first writing exercise has students describe what happens to the power of various elements in a resistive circuit as the value of one of the resistors decreases. The second exercise has students consider situations in which the ideal independent voltage and current source models might fail. Both writing exercises are built from a template that includes several metacognitive prompts to spur self-reflection on the part of the user. A rule-based approach was taken to detect evidence of common misconceptions [2] and errors in student responses, as well as to identify sentences that revealed the student was correctly addressing the problems. Based on identified misconceptions or correct concepts in a student’s writing, the web-based application selects appropriate directed line of reasoning (DLR) feedback paths to attempt to lead the writer to an accurate understanding of the behavior of the circuits in question. Key features of the web-based application template as well as details regarding misconception detection and personalized feedback are described. Student impressions of the value of the DLR feedback is assessed using comments provided by the student within the applications. Planned modifications of the web-based writing exercise template based on this formative assessment will be given and address a broader goal of this work – to develop a web-based template that instructors across STEM disciplines, even those without a background in coding, could use to implement their own conceptual writing exercises.  more » « less
Award ID(s):
2120466
PAR ID:
10463080
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
ASEE annual conference exposition
ISSN:
2153-5965
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, IEEE transactions on education)
    John E. Mitchell (Ed.)
    Contribution: This article describes the implementation, assessment, and evaluation of conceptual-based writing exercises in an introductory course on electric circuit analysis. Background: Students' struggles in gateway courses such as circuit analysis are often traced to inadequate metacognitive skills on the part of the student as well their misconceptions regarding fundamental phenomena related to the course. Writing is known to be a powerful tool for insight into a student's thought process and to foster metacognitive activity. Research Questions: What effect does the use of short writing exercises have on students' understanding of fundamental concepts related to the behavior of electric circuits operating at dc? What effect does the use of the conceptually based writing exercises have on students' ability to justify their responses when answering conceptual questions related to basic electric circuit concepts? Methodology: In the first semester of the study, a single writing exercise was given and in the second semester, a total of five such exercises were administered. In each semester, students were separated into ``at-risk'' and ``not at-risk'' groups based on their responses to the first writing exercise. A 2 x 2 x (2) mixed analysis of variance (ANOVA) was conducted, with at-risk/not at-risk and semester/semester between-subjects factors and pre-test/post-test on a multiple-choice conceptual-based exam a within-subjects factor. Findings: Results suggest that only the at-risk group may have benefited in terms of deepened conceptual understanding and the ability to justify their responses from the use of multiple conceptual-based writing exercises. 
    more » « less
  2. (, Annual Proceeding of the American Society for Engineering Education)
    Students come to learning in engineering classrooms with misconceptions about the concepts covered in engineering course contents. However, instructional efforts often do not effectively address misconceptions in students’ prior knowledge. Concept inventories (CIs) are often relied upon to identify misconceptions in students’ prior knowledge. However, many instructors never benefit much from using CIs because they lack either the know-how, time commitment, or statistical skills required to use them efficiently and effectively. Furthermore, there sometimes are ambiguities about how to interpret students’ CI scores. The Electric Circuit Concepts Diagnostic (ECCD) project team will address these limitations of CIs by creating a web-based electric circuit concept inventory that: (i.) provides an immediate and multipurpose feedback system for reporting about students’ circuits and electricity prior knowledge; (ii.) differentiates, with a high probability, between a lack of prior knowledge and misconceptions; and (iii.) uses a scheme of multidimensional knowledge profiles to report on students’ prior knowledge and misconceptions. The project will integrate the affordances of cognitive diagnostic modeling (CDM), multitier testing frameworks, and computer-assisted testing to realize these project objectives. This work-in-progress report introduces the objectives of ECCD inventory to the ECE research and teaching community. 
    more » « less
  3. ; ; (, Quality of Information and Communications Technology (QUATIC) 2021)
    Paiva, A.C.R.; Cavalli, A.R.; Ventura, Martins P.; Perez-Castillo, R. (Ed.)
    The ubiquitous use of software in critical systems necessitates integrating cybersecurity concepts into the software engineering curriculum so that students studying software engineering have adequate knowledge to securely develop software projects, which could potentially secure critical systems. An experience report of developing and conducting a course can help educators to gain an understanding of student preferences on topics related to secure software development. We provide an experience report related to the ‘Secure Software Development’ course conducted at Tennessee Technological University. We discuss student motivations, as well as positive and negative perceptions of students towards exercises. Based on our findings, we recommend educators to integrate real-world exercises into a secure software development course with careful consideration of tool documentation, balance in exercise diversity, and student background. 
    more » « less
  4. ; ; (, Technology, Knowledge and Learning)
    Abstract Most STEM classrooms overlook the intrinsic conceptual structure of domain content, strategies for improving students’ conceptual structure have promise for improving STEM learning outcomes. This experimental investigation continues the development of the web-based toolGraphical Interface of Knowledge Structure (GIKS)that provides immediate formative feedback as a network of concepts in the student’s essays alongside an expert referent network for comparison and reflection. What should this feedback network look like, especially, should it be more inclusive or small and focused? And is preexisting domain knowledge important for type of network feedback effectiveness? Undergraduate students in a second year Architecture Engineering course, after completing a 2-weeks long lesson on Building with Wood, were randomly assigned to a summary writing task with either Full feedback (a network with 14 central and 12 peripheral terms) or Focused feedback (a network with only the 14 central terms), and then immediately completed a knowledge structure survey. Two weeks later, they completed an End-of-Unit posttest that consisted of a Central-items and a Peripheral-items subtests. A significant interaction of feedback and domain knowledge was observed for post knowledge structure, the low domain knowledge students in the Focus feedback group had the most central link-agreement with the expert and the least peripheral links agreement. On the End-of-Unit declarative knowledge posttest, there was no difference for the Full or Focused feedback interventions, but the high domain knowledge students in both interventions performed significantly better than the low domain knowledge students on the central-items subtest butnoton the peripheral-items subtest. This investigation shows the need for further research on the role of domain-normative central concepts and pragmatically contributes to the design of essay prompts for STEM classroom use. 
    more » « less
  5. ; ; ; ; ; ; (, Proceedings of the 22nd Annual Conference on Research in Undergraduate Mathematics Education)
    In this study we use latent class analysis, distractor analysis, and qualitative analysis of cognitive interviews of student responses to questions on an algebra concept inventory, in order to generate theories about how students’ selections of specific answer choices may reflect different stages or types of algebraic conceptual understanding. Our analysis reveals three groups of students in elementary algebra courses, which we label as “mostly random guessing”, “some procedural fluency with key misconceptions”, and “procedural fluency with emergent conceptual understanding”. Student responses also revealed high rates of misconceptions that stem from misuse or misunderstanding of procedures, and whose prevalence often correlates with higher levels of procedural fluency. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email