skip to main content

Title: CyberGIS-Cloud: A unified middleware framework for cloud-based geospatial research and education
Award ID(s):
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
PEARC '22: Practice and Experience in Advanced Research Computing
Page Range / eLocation ID:
1 to 4
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract The nature of molecular clouds and their statistical behavior in subsolar metallicity environments are not fully explored yet. We analyzed data from an unbiased CO ( J = 2–1) survey at the spatial resolution of ∼2 pc in the northern region of the Small Magellanic Cloud with the Atacama Compact Array to characterize the CO cloud properties. A cloud-decomposition analysis identified 426 spatially/velocity-independent CO clouds and their substructures. Based on the cross-matching with known infrared catalogs by Spitzer and Herschel, more than 90% CO clouds show spatial correlations with point sources. We investigated the basic properties of the CO clouds and found that the radius–velocity linewidth ( R – σ v ) relation follows the Milky Way-like power-law exponent, but the intercept is ∼1.5 times lower than that in the Milky Way. The mass functions ( dN / dM ) of the CO luminosity and virial mass are characterized by an exponent of ∼1.7, which is consistent with previously reported values in the Large Magellanic Cloud and in the Milky Way. 
    more » « less
  2. In this paper, we describe how we extended the Pegasus Workflow Management System to support edge-to-cloud workflows in an automated fashion. We discuss how Pegasus and HTCondor (its job scheduler) work together to enable this automation. We use HTCondor to form heterogeneous pools of compute resources and Pegasus to plan the workflow onto these resources and manage containers and data movement for executing workflows in hybrid edge-cloud environments. We then show how Pegasus can be used to evaluate the execution of workflows running on edge only, cloud only, and edge-cloud hybrid environments. Using the Chameleon Cloud testbed to set up and configure an edge-cloud environment, we use Pegasus to benchmark the executions of one synthetic workflow and two production workflows: CASA-Wind and the Ocean Observatories Initiative Orcasound workflow, all of which derive their data from edge devices. We present the performance impact on workflow runs of job and data placement strategies employed by Pegasus when configured to run in the above three execution environments. Results show that the synthetic workflow performs best in an edge only environment, while the CASA - Wind and Orcasound workflows see significant improvements in overall makespan when run in a cloud only environment. The results demonstrate that Pegasus can be used to automate edge-to-cloud science workflows and the workflow provenance data collection capabilities of the Pegasus monitoring daemon enable computer scientists to conduct edge-to-cloud research. 
    more » « less