skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • Home
  • Search Results
  • Page 1 of 1

Search for: All records

Award ID contains: 1815529

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

  1. ; (, Proceedings of the Annual Conference of the Cognitive Science Society)
    null (Ed.)
    Accepted Manuscript Full Text Available
  2. ; ; ; (, Proceedings of the Conference on Natural Language Learning)
    null (Ed.)
    Accepted Manuscript Full Text Available
  3. ; ; (, Proceedings of the Annual Meeting of the Association for Computational Linguistics)
    null (Ed.)
    Full Text Available 
  4. ; ; (, Proceedings of the 24th Conference on Computational Natural Language Learning)
    Contemporary autoregressive language models (LMs) trained purely on corpus data have been shown to capture numerous features of human incremental processing. However, past work has also suggested dissociations between corpus probabilities and human next-word predictions. Here we evaluate several state-of-the-art language models for their match to human next-word predictions and to reading time behavior from eye movements. We then propose a novel method for distilling the linguistic information implicit in human linguistic predictions into pre-trained LMs: Cloze Distillation. We apply this method to a baseline neural LM and show potential improvement in reading time prediction and generalization to held-out human cloze data. 
    more » « less
    Full Text Available 
  5. ; ; (, Proceedings of the Conference on Natural Language Learning)
    null (Ed.)
    Accepted Manuscript Full Text Available