More Like this

1. Measuring success for a future vision: Defining impact in science gateways/virtual research environments

   https://doi.org/10.1002/cpe.6099  

   Calyam, Prasad; Wilkins‐Diehr, Nancy; Miller, Mark; Brookes, Emre H.; Arora, Ritu; Chourasia, Amit; Jennewein, Douglas M.; Nandigam, Viswanath; Drew LaMar, M.; Cleveland, Sean B.; et al (December 2020, Concurrency and Computation: Practice and Experience)

   Walker, D.; Stankovski, V.; Kalyanam, R. (Ed.)

   Scholars worldwide leverage science gateways/virtual research environments (VREs) for a wide variety of research and education endeavors spanning diverse scientific fields. Evaluating the value of a given science gateway/VRE to its constituent community is critical in obtaining the financial and human resources necessary to sustain operations and increase adoption in the user community. In this article, we feature a variety of exemplar science gateways/VREs and detail how they define impact in terms of, for example, their purpose, operation principles, and size of user base. Further, the exemplars recognize that their science gateways/VREs will continuously evolve with technological advancements and standards in cloud computing platforms, web service architectures, data management tools and cybersecurity. Correspondingly, we present a number of technology advances that could be incorporated in next‐generation science gateways/VREs to enhance their scope and scale of their operations for greater success/impact. The exemplars are selected from owners of science gateways in the Science Gateways Community Institute (SGCI) clientele in the United States, and from the owners of VREs in the International Virtual Research Environment Interest Group (VRE‐IG) of the Research Data Alliance. Thus, community‐driven best practices and technology advances are compiled from diverse expert groups with an international perspective to envisage futuristic science gateway/VRE innovations. 

   more » « less
2. Measuring Success: How Science Gateways Define Impact

   Wilkins-Diehr, Nancy; Miller, Mark; Brookes, Emre H; Arora, Ritu; Chourasia, Amit; Calyam, Prasad; Jennewein, Douglas M; Nandigam, Viswanath; LaMar, M Drew; Cleveland, Sean B; et al (September 2019, Proceedings of Gateways 2019)

   Science gateways, also known as advanced web portals, virtual research environments, and more, have changed the face of research and scholarship over the last two decades. Scholars world-wide leverage science gateways for a wide variety of individual research endeavors spanning diverse scientific fields. Evaluating the value of a given gateway to its constituent community is critical in obtaining the financial and human resources to sustain gateway operations. Accordingly, those who run gateways must routinely measure and communicate impact. Just as gateways are varied, their success metrics vary as well. In this survey paper, a variety of different gateways briefly share their approaches. 

   more » « less
3. Measuring Success: How Science Gateways Define Impact

   Wilkins-Diehr, Nancy; Miller, Mark; Brookes, Emre H; Arora, Ritu; Chourasia, Amit; Calyam, Prasad; Jennewein, Douglas M; Nandigam, Viswanath; LaMar, M Drew; Cleveland, Sean B; et al (September 2019, Proceedings of Gateways 2019)

   Science gateways, also known as advanced web portals, virtual research environments, and more, have changed the face of research and scholarship over the last two decades. Scholars world-wide leverage science gateways for a wide variety of individual research endeavors spanning diverse scientific fields. Evaluating the value of a given gateway to its constituent community is critical in obtaining the financial and human resources to sustain gateway operations. Accordingly, those who run gateways must routinely measure and communicate impact. Just as gateways are varied, their success metrics vary as well. In this survey paper, a variety of different gateways briefly share their approaches. 

   more » « less
4. Measuring Success: How Science Gateways Define Impact

   Wilkins-Diehr, Nancy; Miller, Mark; Brookes, Emre H; Arora, Ritu; Chourasia, Amit; Calyam, Prasad; Jennewein, Douglas M; Nandigam, Viswanath; LaMar, M Drew; Cleveland, Sean B; et al (September 2019, Gateways 2019)

   Science gateways, also known as advanced web portals, virtual research environments, and more, have changed the face of research and scholarship over the last two decades. Scholars world-wide leverage science gateways for a wide variety of individual research endeavors spanning diverse scientific fields. Evaluating the value of a given gateway to its constituent community is critical in obtaining the financial and human resources to sustain gateway operations. Accordingly, those who run gateways must routinely measure and communicate impact. Just as gateways are varied, their success metrics vary as well. In this survey paper, a variety of different gateways briefly share their approaches. 

   more » « less
5. Metrics for Gateways: Why and How

   https://doi.org/10.5281/zenodo.10028651  

   Sperhac, Jeanette; Wellner, Richard K; Chourasia, Amit (January 2023, Zenodo)

   Science Gateways, which provide researchers, educators, and students with streamlined access to advanced computational resources, have become increasingly important to the scientific community. Though metrics are not central to the offerings of gateways, streamlined collection and reporting of gateway usage statistics and other metrics are an important part of sustaining healthy gateways. Metrics describing usage and user activity enable gateway managers and owners to plan for expansion, improve services to the user base, and set and evaluate actionable goals. We will discuss the motivation for collecting gateway metrics, along with methods of data collection, processing, and reporting. We will describe the HUBzero metrics collection method, which has been robust and extensible enough to serve its gateway platform for the last 20 years, and propose enhancements for gateway metrics going forward. 

   more » « less