skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Investigating Patterns of Tone and Sentiment in Teacher Written Feedback Messages
Feedback is a crucial factor in mathematics learning and instruction. Whether expressed as indicators of correctness or textual comments, feedback can help guide students’ understanding of content. Beyond this, however, teacher-written messages and comments can provide motivational and affective benefits for students. The question emerges as to what constitutes effective feedback to promote not only student learning but also motivation and engagement. Teachers may have different perceptions of what constitutes effective feedback utilizing different tones in their writing to communicate their sentiment while assessing student work. This study aims to investigate trends in teacher sentiment and tone when providing feedback to students in a middle school mathematics class context. Toward this, we examine the applicability of state-of-the-art sentiment analysis methods in a mathematics context and explore the use of punctuation marks in teacher feedback messages as a measure of tone.  more » « less
Award ID(s):
1903304
PAR ID:
10469250
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
AIED 2023
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. (, AIED 2023)
    Feedback is a crucial factor in mathematics learning and in- struction. Whether expressed as indicators of correctness or textual com- ments, feedback can help guide students’ understanding of content. Be- yond this, however, teacher-written messages and comments can provide motivational and affective benefits for students. The question emerges as to what constitutes effective feedback to promote not only student learning but also motivation and engagement. Teachers may have differ- ent perceptions of what constitutes effective feedback utilizing different tones in their writing to communicate their sentiment while assessing student work. This study aims to investigate trends in teacher senti- ment and tone when providing feedback to students in a middle school mathematics class context. Toward this, we examine the applicability of state-of-the-art sentiment analysis methods in a mathematics context and explore the use of punctuation marks in teacher feedback messages as a measure of tone. 
    more » « less
  2. ; ; ; ; (, Journal of Computer Assisted Learning)
    Abstract BackgroundTeachers often rely on the use of open‐ended questions to assess students' conceptual understanding of assigned content. Particularly in the context of mathematics; teachers use these types of questions to gain insight into the processes and strategies adopted by students in solving mathematical problems beyond what is possible through more close‐ended problem types. While these types of problems are valuable to teachers, the variation in student responses to these questions makes it difficult, and time‐consuming, to evaluate and provide directed feedback. It is a well‐studied concept that feedback, both in terms of a numeric score but more importantly in the form of teacher‐authored comments, can help guide students as to how to improve, leading to increased learning. It is for this reason that teachers need better support not only for assessing students' work but also in providing meaningful and directed feedback to students. ObjectivesIn this paper, we seek to develop, evaluate, and examine machine learning models that support automated open response assessment and feedback. MethodsWe build upon the prior research in the automatic assessment of student responses to open‐ended problems and introduce a novel approach that leverages student log data combined with machine learning and natural language processing methods. Utilizing sentence‐level semantic representations of student responses to open‐ended questions, we propose a collaborative filtering‐based approach to both predict student scores as well as recommend appropriate feedback messages for teachers to send to their students. Results and ConclusionWe find that our method outperforms previously published benchmarks across three different metrics for the task of predicting student performance. Through an error analysis, we identify several areas where future works may be able to improve upon our approach. 
    more » « less
  3. ; ; ; ; ; (, Educational Data Mining)
    We analyze teachers’ written feedback to students in an online learning environment, specifically a setting in which high school students in Uruguay are learning English as a foreign language. How complex should teachers’ feedback be? Should it be adapted to each student’s English profi- ciency level? How does teacher feedback affect the probability of engaging the student in a conversation? To explore these questions, we conducted both parametric (multilevel modeling) and non-parametric (bootstrapping) analyses of 27,627 messages exchanged between 35 teachers and 1074 students in 2017 and 2018. Our results suggest: (1) Teach- ers should adapt their feedback complexity to their students’ English proficiency level. Students who receive feedback that is too complex or too basic for their level post 13- 15% fewer comments than those who receive adapted feed- back. (2) Feedback that includes a question is associated with higher odds-ratio (17.5-19) of engaging the student in conversation. (3) For students with low English proficiency, slow turnaround (feedback after 1 week) reduces this odds ratio by 0.7. These results have potential implications for online platforms offering foreign language learning services, in which it is crucial to give the best possible learning expe- rience while judiciously allocating teachers’ time. 
    more » « less
  4. ; ; ; ; (, Tenth International Conference on Learning Analytics & Knowledge)
    The use of computer-based systems in classrooms has provided teachers with new opportunities in delivering content to students, supplementing instruction, and assessing student knowledge and comprehension. Among the largest benefits of these systems is their ability to provide students with feedback on their work and also report student performance and progress to their teacher. While computer-based systems can automatically assess student answers to a range of question types, a limitation faced by many systems is in regard to open-ended problems. Many systems are either unable to provide support for open-ended problems, relying on the teacher to grade them manually, or avoid such question types entirely. Due to recent advancements in natural language processing methods, the automation of essay grading has made notable strides. However, much of this research has pertained to domains outside of mathematics, where the use of open-ended problems can be used by teachers to assess students' understanding of mathematical concepts beyond what is possible on other types of problems. This research explores the viability and challenges of developing automated graders of open-ended student responses in mathematics. We further explore how the scale of available data impacts model performance. Focusing on content delivered through the ASSISTments online learning platform, we present a set of analyses pertaining to the development and evaluation of models to predict teacher-assigned grades for student open responses. 
    more » « less
  5. ; ; ; ; (, Proceedings of the 10th International Conference on Learning Analytics & Knowledge)
    The use of computer-based systems in classrooms has provided teachers with new opportunities in delivering content to students, supplementing instruction, and assessing student knowledge and comprehension. Among the largest benefits of these systems is their ability to provide students with feedback on their work and also report student performance and progress to their teacher. While computer-based systems can automatically assess student answers to a range of question types, a limitation faced by many systems is in regard to open-ended problems. Many systems are either unable to provide support for open-ended problems, relying on the teacher to grade them manually, or avoid such question types entirely. Due to recent advancements in natural language processing methods, the automation of essay grading has made notable strides. However, much of this research has pertained to domains outside of mathematics, where the use of open-ended problems can be used by teachers to assess students’ understanding of mathematical concepts beyond what is possible on other types of problems. This research explores the viability and challenges of developing automated graders of open-ended student responses in mathematics. We further explore how the scale of available data impacts model performance. Focusing on content delivered through the ASSISTments online learning platform, we present a set of analyses pertaining to the development and evaluation of models to predict teacher-assigned grades for student open responses. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email