More Like this

1. Reproducible Hydrological Modeling with CyberGIS-Jupyter: A Case Study on SUMMA

   https://doi.org/10.1145/3332186.3333052  

   Lyu, Fangzheng; Yin, Dandong; Padmanabhan, Anand; Choi, Youngdon; Goodall, Jonathan L.; Castronova, Anthony; Tarboton, David; Wang, Shaowen (July 2019, Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning))
2. Navigating the Landscape of Reproducible Research: A Predictive Modeling Approach

   https://doi.org/10.1145/3627673.3679831  

   Akella, Akhil Pandey; Choudhury, Sagnik Ray; Koop, David; Alhoori, Hamed (October 2024, ACM CIKM)

   The reproducibility of scientific articles is central to the advancement of science. Despite this importance, evaluating reproducibility remains challenging due to the scarcity of ground truth data. Predictive models can address this limitation by streamlining the tedious evaluation process. Typically, a paper’s reproducibility is inferred based on the availability of artifacts such as code, data, or supplemental information, often without extensive empirical investigation. To address these issues, we utilized artifacts of papers as fundamental units to develop a novel, dual-spectrum framework that focuses on author-centric and external-agent perspectives. We used the author-centric spectrum, followed by the external-agent spectrum, to guide a structured, model-based approach to quantify and assess reproducibility. We explored the interdependencies between different factors influencing reproducibility and found that linguistic features such as readability and lexical diversity are strongly correlated with papers achieving the highest statuses on both spectrums. Our work provides a model-driven pathway for evaluating the reproducibility of scientific research. 

   more » « less
3. Reproducible image-based profiling with Pycytominer

   https://doi.org/10.1038/s41592-025-02611-8  

   Serrano, Erik; Chandrasekaran, Srinivas Niranj; Bunten, Dave; Brewer, Kenneth I; Tomkinson, Jenna; Kern, Roshan; Bornholdt, Michael; Fleming, Stephen J; Pei, Ruifan; Arevalo, John; et al (April 2025, Nature Methods)
4. Comparing containerization-based approaches for reproducible computational modeling of environmental systems

   https://doi.org/10.1016/j.envsoft.2023.105760  

   Choi, Young-Don; Roy, Binata; Nguyen, Jared; Ahmad, Raza; Maghami, Iman; Nassar, Ayman; Li, Zhiyu; Castronova, Anthony M.; Malik, Tanu; Wang, Shaowen; et al (September 2023, Environmental Modelling & Software)
5. Reproducible Containers

   https://doi.org/10.1145/3373376.3378519  

   Navarro Leija, Omar S.; Shiptoski, Kelly; Scott, Ryan G.; Wang, Baojun; Renner, Nicholas; Newton, Ryan R.; Devietti, Joseph (March 2020, Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems)

   We describe the design and implementation of DetTrace, a reproducible container abstraction for Linux implemented in user space. All computation that occurs inside a DetTrace container is a pure function of the initial filesystem state of the container. Reproducible containers can be used for a variety of purposes, including replication for fault-tolerance, reproducible software builds and reproducible data analytics. We use DetTrace to achieve, in an automatic fashion, reproducibility for 12,130 Debian package builds, containing over 800 million lines of code, as well as bioinformatics and machine learning workflows. We show that, while software in each of these domains is initially irreproducible, DetTrace brings reproducibility without requiring any hardware, OS or application changes. DetTrace's performance is dictated by the frequency of system calls: IO-intensive software builds have an average overhead of 3.49x, while a compute-bound bioinformatics workflow is under 2%. 

   more » « less