skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: The Reference Class Problem for Credit Valuation in Science
Scholars belong to multiple communities of credit simultaneously. When these communities disagree about a scholarly achievement’s credit assignment, this raises a puzzle for decision and game theoretic models of credit seeking in science. The reference class problem for credit valuation in science is the problem of determining to which of an agent’s communities—which reference class—credit determinations should be indexed for an act under some state of nature. Solving this problem requires developing rich, mutually informed theories of community and credit that are sensitive to the structure and status systems of complex, heterogeneous scholarly networks.  more » « less
Award ID(s):
1759825
PAR ID:
10254033
Author(s) / Creator(s):
Date Published:
Journal Name:
Philosophy of science
Volume:
87
Issue:
5
ISSN:
0031-8248
Page Range / eLocation ID:
1026–1036
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Linked-course learning communities are a widely used strategy to promote connections between students and support student retention. This grant project created linked-course learning communities at Bridgewater State University, a public University in southeastern Massachusetts. The communities paired a central 3-credit seminar focused on one or more United Nations Sustainable Development Goal (UN SDG) with the student’s first science class and appropriate mathematics class. This choice was inspired by social psychology research literature showing that students traditionally underrepresented in STEM often value, and look for, the social relevance of science and benefit from structures that provide a more communal, as opposed to individualistic, orientation in their studies. 
    more » « less
  2. Software is a critical part of modern research, and yet there are insufficient mechanisms in the scholarly ecosystem to acknowledge, cite, and measure the impact of research software. The majority of academic fields rely on a one-dimensional credit model whereby academic articles (and their associated citations) are the dominant factor in the success of a researcher's career. In the petabyte era of astronomical science, citing software and measuring its impact enables academia to retain and reward researchers that make significant software contributions. These highly skilled researchers must be retained to maximize the scientific return from petabyte-scale datasets. Evolving beyond the one-dimensional credit model requires overcoming several key challenges, including the current scholarly ecosystem and scientific culture issues. This white paper will present these challenges and suggest practical solutions for elevating the role of software as a product of the research enterprise. 
    more » « less
  3. Automatically extracted metadata from scholarly documents in PDF formats is usually noisy and heterogeneous, often containing incomplete fields and erroneous values. One common way of cleaning metadata is to use a bibliographic reference dataset. The challenge is to match records between corpora with high precision. The existing solution which is based on information retrieval and string similarity on titles works well only if the titles are cleaned. We introduce a system designed to match scholarly document entities with noisy metadata against a reference dataset. The blocking function uses the classic BM25 algorithm to find the matching candidates from the reference data that has been indexed by ElasticSearch. The core components use supervised methods which combine features extracted from all available metadata fields. The system also leverages available citation information to match entities. The combination of metadata and citation achieves high accuracy that significantly outperforms the baseline method on the same test dataset. We apply this system to match the database of CiteSeerX against Web of Science, PubMed, and DBLP. This method will be deployed in the CiteSeerX system to clean metadata and link records to other scholarly big datasets. 
    more » « less
  4. This Innovative Practice Work-In-Progress paper elucidates [redacted name of the alliance] approach for creating change by highlighting an effort across six institutions to support the delivery of one- and two-credit hour courses for three levels of problem solving: problem solving, computational thinking in problem solving, and algorithmic thinking in problem solving. The courses were developed to address feedback from industry partners regarding the need for improved problem-solving skills. The first of its kind for [name of Alliance], the problem-solving courses are fewer credit hours than typical courses designed to fit within traditional curriculum. The intent is to instill the complementary computational thinking skills and logical reasoning needed to succeed in computer science, and make this content available across different student populations at various stages in their academic pathways. The paper describes the process for designing the courses; the efforts to refine and improve course delivery, and the assessment and evaluation of the courses.  
    more » « less
  5. We develop a quantitative framework for understanding the class of wicked problems that emerge at the intersections of natural, social, and technological complex systems. Wicked problems reflect our incomplete understanding of interdependent global systems and the systemic risk they pose; such problems escape solutions because they are often ill-defined, and thus mis-identified and under-appreciated by communities of problem-solvers. While there are well-documented benefits to tackling boundary-crossing problems from various viewpoints, the integration of diverse approaches can nevertheless contribute confusion around the collective understanding of the core concepts and feasible solutions. We explore this paradox by analyzing the development of both scholarly (social) and topical (cognitive) communities — two facets of knowledge production studies here that contribute towards the evolution of knowledge in and around a problem, termed a knowledge trajectory — associated with three wicked problems: deforestation, invasive species, and wildlife trade. We posit that saturation in the dynamics of social and cognitive diversity growth is an indicator of reduced uncertainty in the evolution of the comprehensive knowledge trajectory emerging around each wicked problem. Informed by comprehensive bibliometric data capturing both social and cognitive dimensions of each problem domain, we thereby develop a framework that assesses the stability of knowledge trajectory dynamics as an indicator of wickedness associated with conceptual and solution uncertainty. As such, our results identify wildlife trade as a wicked problem that may be difficult to address given recent instability in its knowledge trajectory. 
    more » « less