skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 10:00 PM ET on Friday, February 6 until 10:00 AM ET on Saturday, February 7 due to maintenance. We apologize for the inconvenience.


Title: "Procurement As Policy: Administrative Process for Machine Learning."
At every level of government, officials contract for technical systems that employ machine learning-systems that perform tasks without using explicit instructions, relying on patterns and inference instead. These systems frequently displace discretion previously exercised by policymakers or individual front-end government employees with an opaque logic that bears no resemblance to the reasoning processes of agency personnel. However, because agencies acquire these systems through government procurement processes, they and the public have little input into-or even knowledge about-their design or how well that design aligns with public goals and values. This Article explains the ways that the decisions about goals, values, risk, and certainty, along with the elimination of case-by-case discretion, inherent in machine-learning system design create policies-not just once when they are designed, but over time as they adapt and change. When the adoption of these systems is governed by procurement, the policies they embed receive little or no agency or outside expertise beyond that provided by the vendor. Design decisions are left to private third-party developers. There is no public participation, no reasoned deliberation, and no factual record, which abdicates Government responsibility for policymaking. This Article then argues for a move from a procurement mindset to policymaking mindset. When policy decisions are made through system design, processes suitable for substantive administrative determinations should be used: processes that foster deliberation reflecting both technocratic demands for reason and rationality informed by expertise, and democratic demands for public participation and political accountability. Specifically, the Article proposes administrative law as the framework to guide the adoption of machine learning governance, describing specific ways that the policy choices embedded in machine learning system design fail the prohibition against arbitrary and capricious agency actions absent a reasoned decision-making process that both enlists the expertise necessary for reasoned deliberation about, and justification for, such choices, and makes visible the political choices being made. Finally, this Article sketches models for machine-learning adoption processes that satisfy the prohibition against arbitrary and capricious agency actions. It explores processes by which agencies might garner technical expertise and overcome problems of system opacity, satisfying administrative law's technocratic demand for reasoned expert deliberation. It further proposes both institutional and engineering design solutions to the challenge of policymaking opacity, offering process paradigms to ensure the "political visibility" required for public input and political oversight. In doing so, it also proposes the importance of using "contestable design"-design that exposes value-laden features and parameters and provides for iterative human involvement in system evolution and deployment. Together, these institutional and design approaches further both administrative law's technocratic and democratic mandates.  more » « less
Award ID(s):
1650589
PAR ID:
10214677
Author(s) / Creator(s):
Date Published:
Journal Name:
Berkeley technology law journal
Volume:
34
Issue:
3
ISSN:
1086-3818
Page Range / eLocation ID:
773-852
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The 2024–25 judicial reform in Mexico represents one of the most sweeping overhauls of a national judiciary in recent history. The reform replaced nearly all federal and state judges through direct popular elections, restructured the country’s highest court, and created new administrative and disciplinary bodies that expanded political influence over judicial decision-making. Here, in a conversation with Judicature International, AMANDA DRISCOLL, the Dr. J. Elizabeth Garraway Professor of Political Science at Florida State University, MICHAEL J. NELSON, Professor and Head of the Department of Political Science at Penn State, and JULIO RÍOS-FIGUEROA, Professor of Law at the Instituto Tecnológico Autónomo de México (ITAM) in Mexico City, bring their expertise on comparative judicial politics and the Mexican legal system. They analyze the design, implementation, and consequences of these reforms, assessing what they reveal about judicial independence, democratic legitimacy, and the potential risks of politicizing the judiciary. 
    more » « less
  2. The 2024–25 judicial reform in Mexico represents one of the most sweeping overhauls of a national judiciary in recent history. The reform replaced nearly all federal and state judges through direct popular elections, restructured the country’s highest court, and created new administrative and disciplinary bodies that expanded political influence over judicial decision-making. Here, in a conversation with Judicature International, AMANDA DRISCOLL, the Dr. J. Elizabeth Garraway Professor of Political Science at Florida State University, MICHAEL J.NELSON, Professor and Head of the Department of Political Science at Penn State, and JULIO RÍOS-FIGUEROA, Professor of Law at the Instituto Tecnológico Autónomo de M(ITAM) in Mexico City, bring their expertise on comparative judicial politics and the Mexican legal system. They analyze the design, implementation, and consequences of these reforms, assessing what they reveal about judicial independence, democratic legitimacy, and the potential risks of politicizing the judiciary. 
    more » « less
  3. In crucial sectors like healthcare, education, and housing, policymakers are turning to the tools ofmarket designto incentivize public and private actors to more efficiently and effectively produce the public good. Although market design has been a key policymaking tool for decades, datafication is increasingly central to this technocratic tinkering. This article explores a project of datafied market redesign in the U.S. healthcare industry, demonstrating that emerging federal health data regulations are designed to enable the state to more precisely quantify, and thereby incentivize, the production of “valuable” care. This case study demonstrates how both the public good and crucial data infrastructures are constrained through their enactment within market-based modes of governance. As this data-solutionism for extractive markets becomes a more prevalent mode of governance—particularly in areas like climate change—we must find alternative mechanisms for collectively defining the public good, and for achieving corporate accountability beyond financial incentive structures. 
    more » « less
  4. Political trust is essential for effective policy implementation, yet declining levels of trust create a vicious cycle where diminished public confidence undermines policy responsiveness, leading to further erosion of trust. This dissertation explores how specific public policies can foster political trust and examines how trust itself influences the relationship between governance structures and political attitudes, particularly concerning support for climate policies. In Chapter 2, I examine the impact of self-targeting public policies, where citizens can choose to opt into benefits, on political trust. My empirical analysis reveals that self-targeting enhances confidence in local government compared to pre-targeting approaches, which do not yield significant results. The findings suggest that policy design, particularly the targeting mechanism, plays a critical role in shaping political attitudes. Chapter 3 argues that bottom-up policies that are participatory in nature, like the Mahatma Gandhi National Rural Employment Guarantee Act (MGNREGA), can help mitigate the negative effect of inequalities on political trust. Using a quasi-experimental framework, I find strong evidence in support of this argument, reinforcing the importance of inclusive policy design in enhancing democratic processes. The final chapter shifts focus to governance structures, exploring how exposure to non-state climate actions influences climate policy support in less polarized contexts. My results indicate that while exposure does not directly affect policy support, citizens with higher political trust are less likely to hold governments accountable for climate inaction. This underscores the critical need to understand the nuanced role of political trust as a mediator for climate policy support. 
    more » « less
  5. Gender politics scholars conclude that conservatives and religious actors curtail women's rights and political participation during a democratic transition, except in post-conflict contexts. Yet, this was not the case in Tunisia. This article documents how Islamist women activists remained active throughout the democratic transition in Tunisia. I argue that Islamist women within Tounissiet remained politically active by making two strategic choices: (1) not challenging conservatives and (2) aligning with liberal feminists when it was in their interest. This article builds on the emerging scholarship on women's roles in a democratic transition, especially conservative women, by providing original empirical work on an Islamist women's rights organization in a democratizing Tunisia. I suggest that more needs to be understood about conservative women and new actors that democratic transitions empower and embolden. 
    more » « less