skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Co-producing software for complex environmental data visualization
Environmental scientists, land managers, and policy actors are increasingly presented with high-stakes high-uncertainty problems stemming from human-ecosystem interactions. These interactions exacerbate already challenging issues associated with environmental policy and natural resource management. To address these problems, scientists and managers frequently use models that produce enormous geospatial and temporal datasets that are constantly modified. To help make sense of this complex and changing data, we are immersed in a co-production effort where software engineers and environmental scientists collaborate on the development of visualization software. We report on this on-going research, and find that visualization is critical not only for communicating science, but integral to many aspects of the science production pipeline and evolving data science field. We also find evidence among our collaborators that this software co-production process helps build legitimacy for the information it produces, with potential implications for generating actionable science for policy and governance.  more » « less
Award ID(s):
1637320
PAR ID:
10128981
Author(s) / Creator(s):
Date Published:
Journal Name:
Proceedings of 19th Annual International Conference on Digital Government Research (dg.o’18), Anneke Zuiderwijk and Charles C. Hinnant (Eds.). ACM
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Addressing the challenges of wildland fire requires that fire science be relevant to management and integrated into management decisions. Co-production is often touted as a process that can increase the utility of science for management, by involving scientists and managers in knowledge creation and problem solving. Despite the documented benefits of co-production, these efforts face a number of institutional barriers. Further research is needed on how to institutionalise support and incentivise co-production. To better understand how research organisations enable and constrain co-production, this study examined seven co-produced wildland fire projects associated with the US Department of Agriculture Forest Service Rocky Mountain Research Station (RMRS), through in-depth interviews with scientists, managers and community members. Results provide insights into how organisational structures and cultures influence the co-production of fire science. Research organisations like RMRS may be able to institutionalise co-production by adjusting the way they incentivise and evaluate researchers, increasing investment in science delivery and scientific personnel overall, and supplying long-term funding to support time-intensive collaborations. These sorts of structural changes could help transform the culture of fire science so that co-production is valued alongside more conventional scientific activities and products. 
    more » « less
  2. Abstract Earth system models synthesize the science of interactions amongst multiple biophysical and, increasingly, human processes across a wide range of scales. Ecohydrologic models are a subset of earth system models that focus particularly on the complex interactions between ecosystem processes and the storage and flux of water. Ecohydrologic models often focus at scales where direct observations occur: plots, hillslopes, streams, and watersheds, as well as where land and resource management decisions are implemented. These models complement field‐based and data‐driven science by combining theory, empirical relationships derived from observation and new data to create virtual laboratories. Ecohydrologic models are tools that managers can use to ask “what if” questions and domain scientists can use to explore the implications of new theory or measurements. Recent decades have seen substantial advances in ecohydrologic models, building on both new domain science and advances in software engineering and data availability. The increasing sophistication of ecohydrologic models however, presents a barrier to their widespread use and credibility. Their complexity, often encoding 100s of relationships, means that they are effectively “black boxes,” at least for most users, sometimes even to the teams of researchers that contribute to their design. This opacity complicates the interpretation of model results. For models to effectively advance our understanding of how plants and water interact, we must improve how we visualize not only model outputs, but also the underlying theories that are encoded within the models. In this paper, we outline a framework for increasing the usefulness of ecohydrologic models through better visualization. We outline four complementary approaches, ranging from simple best practices that leverage existing technologies, to ideas that would engage novel software engineering and cutting edge human–computer interface design. Our goal is to open the ecohydrologic model black box in ways that will engage multiple audiences, from novices to model developers, and support learning, new discovery, and environmental problem solving. 
    more » « less
  3. Abstract Co‐production is becoming an increasingly important approach to facilitating integrated climate, environmental, social and earth systems research to achieve societal impact. Across the research and science‐policy ecosystem, there are multiple indicators of its growing prominence as means to engage the public and generate research that is more likely to address real‐world problems and community priorities. Power plays a key role in co‐production, as power imbalances can affect participation, decision‐making, and the distribution of benefits. Addressing power imbalances, through a focus on equity in co‐production, helps to ensure past harms are addressed and participants have the resources and opportunities to contribute effectively. This special issue includes articles that explore equity in co‐production. Articles describe the results of projects that used co‐production approaches, social scientific findings that can inform equitable co‐production, and some that do both. Across the submissions, inclusive decision‐making, strengthening capacity at multiple levels, and fostering trust and respect were key themes. The collection provides practical lessons and future directions to advance equity in co‐production processes, meeting the urgent demand for more inclusive and impactful environmental science practices. 
    more » « less
  4. Science policy makers are looking for approaches to increase the extent of collaboration in the production of scientific software, looking to open collaborations in open source software for inspiration. We examine the software ecosystem surrounding BLAST, a key bioinformatics tool, identifying outside improvements and interviewing their authors. We find that academic credit is a powerful motivator for the production and revealing of improvements. Yet surprisingly, we also find that improvements motivated by academic credit are less likely to be integrated than those with other motivations, including financial gain. We argue that this is because integration makes it harder to see who has contributed what and thereby undermines the ability of reputation to function as a reward for collaboration. We consider how open source avoids these issues and conclude with policy approaches to promoting wider collaboration by addressing incentives for integration. 
    more » « less
  5. Practicing reproducible scientific research requires access to appropriate reproducibility methodology and software, as well as open data. Strict reproducibility in complex scientific domains such as environmental science, ecology and medicine, however, is difficult if not impossible. Here, we consider replication as a relaxed but bona fide substitution for strict reproducibility and propose using 3D terrain visualization for replication in environmental science studies that propose causal relationships between one or more driver variables and one or more response variables across complex ecosystem landscapes. We base our contention of the usefulness of visualization for replication on more than ten years observing environmental science modelers who use our 3D terrain visualization software to develop, calibrate, validate, and integrate predictive models. To establish the link between replication and model validation and corroboration, we consider replication as proposed by Munafò, i.e., triangulation. We enumerate features of visualization systems that would enable such triangulation and argue that such systems would render feasible domain-specific, open visualization software for use in replicating environmental science studies. 
    more » « less