Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher.
Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?
Some links on this page may take you to non-federal websites. Their policies may differ from this site.
-
The paper explores the performance of LLMs in the context of multi-dimensional analytic writing assessments, i.e. their ability to provide both scores and comments based on multiple assessment criteria. Using a corpus of literature reviews written by L2 graduate students and assessed by human experts against 9 analytic criteria, we prompt several popular LLMs to perform the same task under various conditions. To evaluate the quality of feedback comments, we apply a novel feedback comment quality evaluation framework. This framework is interpretable, cost-efficient, scalable, and reproducible, compared to existing methods that rely on manual judgments. We find that LLMs can generate reasonably good and generally reliable multi-dimensional analytic assessments. We release our corpus and code\footnote{\url{https://github.com/jaaack-wang/multi-dimensional-analytic-writing-assessments}.} for reproducibility.more » « lessFree, publicly-accessible full text available August 1, 2026
-
Free, publicly-accessible full text available May 15, 2026
-
Free, publicly-accessible full text available June 13, 2026
-
Free, publicly-accessible full text available April 15, 2026
-
Free, publicly-accessible full text available February 24, 2026
-
Free, publicly-accessible full text available February 27, 2026
-
Free, publicly-accessible full text available January 1, 2026
-
Free, publicly-accessible full text available September 25, 2025
-
Free, publicly-accessible full text available September 25, 2025
-
Free, publicly-accessible full text available July 27, 2025