skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Evaluating Pre-trial Programs Using Interpretable Machine Learning Matching Algorithms for Causal Inference
After a person is arrested and charged with a crime, they may be released on bail and required to participate in a community supervision program while awaiting trial. These 'pre-trial programs' are common throughout the United States, but very little research has demonstrated their effectiveness. Researchers have emphasized the need for more rigorous program evaluation methods, which we introduce in this article. We describe a program evaluation pipeline that uses recent interpretable machine learning techniques for observational causal inference, and demonstrate these techniques in a study of a pre-trial program in Durham, North Carolina. Our findings show no evidence that the program either significantly increased or decreased the probability of new criminal charges. If these findings replicate, the criminal-legal system needs to either improve pre-trial programs or consider alternatives to them. The simplest option is to release low-risk individuals back into the community without subjecting them to any restrictions or conditions. Another option is to assign individuals to pre-trial programs that incentivize pro-social behavior. We believe that the techniques introduced here can provide researchers the rigorous tools they need to evaluate these programs.  more » « less
Award ID(s):
2147061
PAR ID:
10497968
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Publisher / Repository:
Proceedings of the AAAI Conference on Artificial Intelligence
Date Published:
Journal Name:
Proceedings of the AAAI Conference on Artificial Intelligence
Volume:
38
Issue:
20
ISSN:
2159-5399
Page Range / eLocation ID:
22331 to 22340
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Novel research ideas require strong evaluations. Modern software engineering research evaluation typically requires a set of benchmark programs. Open source software repositories have provided a great opportunity for researchers to find such programs for use in their evaluations. Many tools/techniques have been developed to help automate the curation of open source software. There has also been encouragement for researchers to provide their research artifacts so that other researchers can easily reproduce the results. We argue that these two trends (i.e., curating open source software for research evaluation and the providing of research artifacts) drive the need for Software Engineer Collaboratories (SEClabs). We envision research communities coming together to create SEClab instances, where research artifacts can be made publicly available to other researchers. The community can then vet such artifacts and make them available as a service, thus turning the collaboratory into a Collaboratory as a Service (CaaS). If our vision is realized, the speed and transparency of research will drastically increase. 
    more » « less
  2. Researchers describe a need for increased access to and transitional support into STEM graduate education for low-income, academically talented, first-generation and/or underrepresented and minority (LIATFirstGenURM) students [1]. In October 2019, we were awarded an NSF scholarship grant to build infrastructure and provide support to low-income, academically talented, firs-generation, underrepresented, and minority (LIATFirstGenURM) graduate engineering students. As part of the internal evaluation of the program, we interviewed seven enrolled and funded graduate student beneficiaries to determine if they encountered any barriers during their recruitment and first semester of graduate study. Additionally, we asked them what support they valued most. We found that these students valued the organizational program support system, and as a result, we also found several opportunities to improve the system. In this paper, we share our findings and discuss implications for program updates 
    more » « less
  3. Feature-rich software programs typically provide many configuration options for users to enable and disable features, or tune feature behaviors. Given the values of configuration options, certain code blocks in a program will become redundant code and never be used. However, the redundant code is still present in the program and thus unnecessarily increases a program's attack surface by allowing attackers to use it as return-oriented programming (ROP) gadgets. Existing code debloating techniques have several limitations: not targeting this type of redundant code, requiring access to program source code or user-provided test inputs. In this paper, we propose a practical code debloating approach, called BinDebloat, to address these limitations. BinDebloat identifies and removes redundant code caused by configuration option values. It does not require user-provided test inputs, or support from program developers, and is designed to work on closed-source programs. It uses static program analysis to identify code blocks that are control-dependent on configuration option values. Given a set of configuration option values, it automatically determines which of such code blocks become redundant and uses static binary rewriting to neutralize these code blocks so that they are removed from the attack surface. We evaluated BinDebloat on closed-source Windows programs and the results show that BinDebloat can effectively reduce a program's attack surface. 
    more » « less
  4. Freitag, Nancy E. (Ed.)
    The National Summer Undergraduate Research Program (NSURP) is a mentored summer research program in biosciences for undergraduate students from underrepresented backgrounds in science, technology, engineering, and mathematics (STEM). Conducted virtually over 8 weeks every summer starting in 2020, NSURP provides accessible and flexible research experiences to meet the needs of geographically diverse and schedule-constrained students. Drawing from mentee reporting and surveys conducted within the NSURP framework involving over 350 underrepresented minority undergraduate students over three cohorts (2020–2022), matched with mentors, this paper highlights the potential benefits of students participating in virtual mentored research experiences. In addition to increased access to quality research experiences for students who face travel or academic setting constraints, we found that virtual mentoring fosters cross-cultural collaborations, generates novel research questions, and expands professional networks. Moreover, this study emphasizes the role of virtual mentorship opportunities in fostering inclusivity and support for individuals from underrepresented groups in STEM fields. By overcoming barriers to full participation in the scientific community, virtual mentorship programs can create a more equitable and inclusive environment for aspiring researchers. This research contributes to the growing body of literature on the effectiveness and the potential of virtual research programs and mentorship opportunities in broadening participation and breaking down barriers in STEM education and careers. IMPORTANCESummer Research Experiences for Undergraduates (REUs) are established to provide platforms for interest in scientific research and as tools for eventual matriculation to scientific graduate programs. Unfortunately, the COVID-19 pandemic forced the cancellation of in-person programs for 2020 and 2021, creating the need for alternative programming. The National Summer Undergraduate Research Project (NSURP) was created to provide a virtual option to REUs in microbiology to compensate for the pandemic-initiated loss of research opportunities. Although in-person REUs have since been restored, NSURP currently remains an option for those unable to travel to in-person programs in the first place due to familial, community, and/or monetary obligations. This study examines the effects of the program's first 3 years, documenting the students’ experiences, and suggests future directions and areas of study related to the impact of virtual research experiences on expanding and diversifying science, technology, engineering, and mathematics. 
    more » « less
  5. There is a rapidly growing demand for individuals in cybersecurity and a deficit of persons able to fill those roles. To help meet this need, students not majoring in computing can be utilized to fulfill this demand by exposing them to date mining, cybersecurity practices, and applications of these concepts in the field. This paper presents findings from a twenty-one-week program in which minority undergraduate college students all members of the Reserve Officer Training Coprs (ROTC), were taught computer programming, natural language processing, data visualization, and computer vision fundamentals. Midshipmen and cadets used their newly gained knowledge, teamwork, planning, and communication skills to develop a threat dectection prototype using publicly available social media data. Resuls from pre and post python assessments and post-program interviews that recorded participant attitudes and sefl-efficacy are reported to highlight the programs' effectiveness. 
    more » « less