More Like this

1. Drivers of US East Coast sea-level variability from years to decades in a changing ocean—What do we know and what do we need to know?

   https://doi.org/doi:10.5065/fp9y-ae42  

   Piecuch, C. G. ( July 2020 , CLIVAR Variations)

   Domingues, R. (Ed.)

   This paper is a review of our understanding of United States East Coast sea level
2. How Can We Know What Language Models Know?

   https://doi.org/10.1162/tacl_a_00324  

   Jiang, Zhengbao ; Xu, Frank F. ; Araki, Jun ; Neubig, Graham ( July 2020 , Transactions of the Association for Computational Linguistics)

   Recent work has presented intriguing results examining the knowledge contained in language models (LMs) by having the LM fill in the blanks of prompts such as “ Obama is a __ by profession”. These prompts are usually manually created, and quite possibly sub-optimal; another prompt such as “ Obama worked as a __ ” may result in more accurately predicting the correct profession. Because of this, given an inappropriate prompt, we might fail to retrieve facts that the LM does know, and thus any given prompt only provides a lower bound estimate of the knowledge contained in an LM. In this paper, we attempt to more accurately estimate the knowledge contained in LMs by automatically discovering better prompts to use in this querying process. Specifically, we propose mining-based and paraphrasing-based methods to automatically generate high-quality and diverse prompts, as well as ensemble methods to combine answers from different prompts. Extensive experiments on the LAMA benchmark for extracting relational knowledge from LMs demonstrate that our methods can improve accuracy from 31.1% to 39.6%, providing a tighter lower bound on what LMs know. We have released the code and the resulting LM Prompt And Query Archive (LPAQA) at https://github.com/jzbjyb/LPAQA .
3. Learning to Reason with Data: How Did We Get Here and What Do We Know?

   https://doi.org/10.1080/10508406.2019.1705665  

   Rubin, Andee ( January 2020 , Journal of the Learning Sciences)
4. How Well Do We Know the Neutron-Matter Equation of State at the Densities Inside Neutron Stars? A Bayesian Approach with Correlated Uncertainties

   https://doi.org/10.1103/PhysRevLett.125.202702  

   Drischler, C. ; Furnstahl, R. J. ; Melendez, J. A. ; Phillips, D. R. ( November 2020 , Physical Review Letters)
5. What we (don't) know about global plant diversity

   https://doi.org/10.1111/ecog.04481  

   Cornwell, William K. ; Pearse, William D. ; Dalrymple, Rhiannon L. ; Zanne, Amy E. ( September 2019 , Ecography)