The past decade has seen a rapid rise in the number of policy innovation labs (PILs). PILs that are found both inside and outside of government address a wide range of social issues. Many PILs share a few distinct common characteristics: a commitment to the design-thinking methodology, a focus on applying experimental approaches to testing and measuring the efficacy of comprehensive public policy and intervention program prototypes, and the use of user-centric techniques to stakeholders in the design process. In this introduction to the special issue on PILs, we begin by taking stock of the policy lab literature published to date by providing an overview of 70 related publications (peer review articles,book chapters, theses, reports, and catalogs) and the extent that they engage the policy literature. This review demonstrates the underexplored practitioner perspective, which serves as the theme for this special issue. Next, the six articles that comprise this special issue are introduced. They are written from a practitioner perspective and include contributions from Brazil, Canada, Finland, and the United Kingdom. Finally, suggestions for future research are highlighted, including the role of PILs in policy work, PILs as street-level policy entrepreneurship settings, and the need for more rigorous inferential methods.
more »
« less
Policy capacity and rise of data‐based policy innovation labs
In scarcely a decade, a “labification” phenomenon has taken hold globally. The search for innovative policy solutions for social problems is embedded within scientific experimental-like structures often referred to as policy innovation labs (PILs). With the rapid technological changes (e.g., big data, artificial intelligence), data-based PILs have emerged. Despite the growing importance of these PILs in the policy process, very little is known about them and how they contribute to policy outcomes. This study analyzes 133 data-based PILs and examines their contribution to policy capacity. We adopt a policy capacity framework to investigate how data-based PILs contribute to enhancing analytical, organization, and political policy capacity. Many data-based PILs are located in Western Europe and North America, initiated by governments, and employ multi-domain administrative data with advanced technologies. Our analysis finds that data-based PILs enhance analytical and operational policy capacity at the individual, organizational and systemic levels but do little to enhance political capacity. It is this deficit that we suggest possible strategies for data-based PILs.
more »
« less
- Award ID(s):
- 1911453
- PAR ID:
- 10343941
- Date Published:
- Journal Name:
- Review of Policy Research
- ISSN:
- 1541-132X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Bauer, Lujo; Pellegrino, Giancarlo (Ed.)Ensuring the proper use of sensitive data in analytics under complex privacy policies is an increasingly critical challenge. Many existing approaches lack portability, verifiability, and scalability across diverse data processing frameworks. We introduce PICACHV, a novel security monitor that automatically enforces data use policies. It works on relational algebra as an abstraction for program semantics, enabling policy enforcement on query plans generated by programs during execution. This approach simplifies analysis across diverse analytical operations and supports various front-end query languages. By formalizing both data use policies and relational algebra semantics in Coq, we prove that PICACHV correctly enforces policies. PICACHV also leverages Trusted Execution Environments (TEEs) to enhance trust in runtime, providing provable policy compliance to stakeholders that the analytical tasks comply with their data use policies. We integrated PICACHV into Polars, a state-of-the-art data analytics framework, and evaluate its performance using the TPC-H benchmark. We also apply our approach to real-world use cases. Our work demonstrates the practical application of formal methods in securing data analytics, addressing key challenges.more » « less
-
For a growing class of prediction problems, big data and machine learning analyses can greatly enhance our understanding of the effectiveness of public investments and public policy. However, the outputs of many machine learning models are often abstract and inaccessible to policy communities or the general public. In this article, we describe a hands-on teaching case that is suitable for use in a graduate or advanced undergraduate public policy, public affairs or environmental studies classroom. Students will engage on the use of increasingly popular machine learning classification algorithms and cloud-based data visualization tools to support policy and planning on the theme of electric vehicle mobility and connected infrastructure. By using these tools, students will critically evaluate and convert large and complex datasets into human understandable visualization for communication and decision-making. The tools also enable user flexibility to engage with streaming data sources in a new creative design with little technical background.more » « less
-
null (Ed.)At every level of government, officials contract for technical systems that employ machine learning-systems that perform tasks without using explicit instructions, relying on patterns and inference instead. These systems frequently displace discretion previously exercised by policymakers or individual front-end government employees with an opaque logic that bears no resemblance to the reasoning processes of agency personnel. However, because agencies acquire these systems through government procurement processes, they and the public have little input into-or even knowledge about-their design or how well that design aligns with public goals and values. This Article explains the ways that the decisions about goals, values, risk, and certainty, along with the elimination of case-by-case discretion, inherent in machine-learning system design create policies-not just once when they are designed, but over time as they adapt and change. When the adoption of these systems is governed by procurement, the policies they embed receive little or no agency or outside expertise beyond that provided by the vendor. Design decisions are left to private third-party developers. There is no public participation, no reasoned deliberation, and no factual record, which abdicates Government responsibility for policymaking. This Article then argues for a move from a procurement mindset to policymaking mindset. When policy decisions are made through system design, processes suitable for substantive administrative determinations should be used: processes that foster deliberation reflecting both technocratic demands for reason and rationality informed by expertise, and democratic demands for public participation and political accountability. Specifically, the Article proposes administrative law as the framework to guide the adoption of machine learning governance, describing specific ways that the policy choices embedded in machine learning system design fail the prohibition against arbitrary and capricious agency actions absent a reasoned decision-making process that both enlists the expertise necessary for reasoned deliberation about, and justification for, such choices, and makes visible the political choices being made. Finally, this Article sketches models for machine-learning adoption processes that satisfy the prohibition against arbitrary and capricious agency actions. It explores processes by which agencies might garner technical expertise and overcome problems of system opacity, satisfying administrative law's technocratic demand for reasoned expert deliberation. It further proposes both institutional and engineering design solutions to the challenge of policymaking opacity, offering process paradigms to ensure the "political visibility" required for public input and political oversight. In doing so, it also proposes the importance of using "contestable design"-design that exposes value-laden features and parameters and provides for iterative human involvement in system evolution and deployment. Together, these institutional and design approaches further both administrative law's technocratic and democratic mandates.more » « less
-
Abstract Scholarship is growing on societal transitions, describing radical societal change involving multiple sectors and scales, and transformative governance, describing how public, private, and civil society actors use tools of policy to pursue this fundamental change, aiming to build resiliency and sustainability. Much of this literature has a systems‐level focus and does not closely examine how governance participants, working individually or collectively, can steer a jurisdiction toward or away from transformativeness. This paper offers a corrective, integrating policy entrepreneurship scholarship with transformative governance research to advance understanding of how human agency underpins societal change. Drawing on accounts from 50 interviewees across eight case studies of US cities grappling with flooding hazards, we show how policy entrepreneurship can boost the political and economic resources that city officials rely upon to help propel radical shifts towards greater social, economic, and environmental equity.more » « less
An official website of the United States government

