An official website of the United States government
With the increase in data-driven analytics, the demand for high performing computing resources has risen. There are many high-performance computing centers providing cyberinfrastructure (CI) for academic research. However, there exists access barriers in bringing these resources to a broad range of users. Users who are new to data analytics field are not yet equipped to take advantage of the tools offered by CI. In this paper, we propose a framework to lower the access barriers that exist in bringing the high-performance computing resources to users that do not have the training to utilize the capability of CI. The framework uses divide-and-conquer (DC) paradigm for data-intensive computing tasks. It consists of three major components - user interface (UI), parallel scripts generator (PSG) and underlying cyberinfrastructure (CI). The goal of the framework is to provide a user-friendly method for parallelizing data-intensive computing tasks with minimal user intervention. Some of the key design goals are usability, scalability and reproducibility. The users can focus on their problem and leave the parallelization details to the framework.
more »
« less
COMPLECS: COMPrehensive Learning for end-users to Effectively utilize CyberinfraStructure
The needs of cyberinfrastructure (CI) Users are different from those of CI Contributors. Typically, much of the training in advanced CI addresses developer topics such as MPI, OpenMP, CUDA and application profiling, leaving a gap in training for these users. To remedy this situation, we developed a new program: COMPrehensive Learning for end-users to Effectively utilize CyberinfraStructure (COMPLECS). COMPLECS focuses exclusively on helping CI Users acquire the skills and knowledge they need to efficiently accomplish their compute- and data-intensive research, covering topics such as parallel computing concepts, data management, batch computing, cybersecurity, HPC hardware overview, and high throughput computing.
more »
« less
- Award ID(s):
- 2320934
- PAR ID:
- 10533766
- Publisher / Repository:
- ACM
- Date Published:
- ISBN:
- 9798400704192
- Page Range / eLocation ID:
- 1 to 4
- Subject(s) / Keyword(s):
- Computing education workforce development advanced cyberinfrastructure
- Format(s):
- Medium: X
- Location:
- Providence RI USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Advances in the volume, diversity, and complexity of research data and associated workflows requires enhanced capabilities to access, secure, reuse, process, analyze, understand, curate, share, and preserve data. To address this need at the regional level the University of Colorado, Colorado State University, and the University of Utah formed a "Cyberteam" in 2017 to provide cyberinfrastructure (CI) support to researchers at institutions in the Rocky Mountain Advanced Computing Consortium (RMACC) encompassing states across the Intermountain West. The Cyberteam is comprised of CI professionals across the three institutions who collaborate closely, sharing expertise and resources. Since its establishment, the Cyberteam has worked to broaden accessibility and options for computing, storage, and data publishing for RMACC researchers; enhance training on data- and workflow-oriented topics; improve engagement with researchers using CI; and better understand user needs and challenges. One key accomplishment has been the development of a series of focus group and survey instruments to achieve better understanding the CI needs and challenges of researchers across a diverse spectrum of disciplines. This paper provides an overview of the RMACC Cyberteam's objectives, accomplishments, challenges, and future direction.more » « less
-
While artificial intelligence and machine learning (AI/ML) frameworks gain prominence in science and engineering, most researchers face significant challenges in adopting complex AI/ML workflows to campus and national cyberinfrastructure (CI) environments. Data from the Texas A&M High Performance Computing (HPRC) researcher training program indicate that researchers increasingly want to learn how to migrate and work with their pre-existing AI/ML frameworks on large scale computing environments. Building on the continuing success of our work in developing innovative pedagogical approaches for CI- training approaches, we expand CI-infused pedagogical approaches to teach technology-based AI and data sciences. We revisit the pedagogical approaches used in the decades-old tradition of laboratories in the Physical Sciences that taught concepts via experiential learning. Here, we structure a series of exercises on interactive computing environments that give researchers immediate hands-on experience in AI/ML and data science technologies that they will use as they work on larger CI resources. These exercises, called “tech-labs,” assume that participating researchers are familiar with AI/ML approaches and focus on hands-on exercises that teach researchers how to use these approaches on large-scale CI. The tech-labs offer four consecutive sessions, each introducing a learner to specific technologies offered in CI environments for AI/ML and data workflows. We report on our tech-lab offered for Python-based AI/ML approaches during which learners are introduced to Jupyter Notebooks followed by exercises using Pandas, Matplotlib, Scikit-learn, and Keras. The program includes a series of enhancements such as container support and easy launch of virtual environments in our Web-based computing interface. The approach is scalable to programs using a command line interface (CLI) as well. In all, the program offers a shift in focus from teaching AI/ML toward increasing adoption of AI/ML in large-scale CI.more » « less
-
ABSTRACT The evolution of spatial decision support systems (SDSS) is being rapidly shaped by the integration of Cyberinfrastructure (CI) and Geospatial Artificial Intelligence (GeoAI), collectively referred to as CyberGeoAI. The rise of big data, complex decision environments, and computing power gives opportunities for advanced tool development to account for ambiguity in the context and process of spatial decision making. This paper analyzes the synergy between CI and GeoAI, identifying challenges specific to GeoAI as well as CI‐related challenges in supporting GeoAI for decision‐making. At the same time, the paper critically examines the ongoing need for human expertise in interpreting GeoAI outputs to ensure ethical use and maintain transparency and accountability. The paper also highlights key challenges in developing CyberGeoAI for decision support, including issues such as the digital divide, geo‐hallucination and associated risks, energy demand and sustainability, and the integration of human dynamics within CyberGeoAI systems. In conclusion, the paper proposes a holistic human‐centered design integrating scalable CI and GeoAI that enables users to effectively tackle the full spectrum of spatial decision challenges, from clearly defined problems to those of high complexity and ambiguity.more » « less
-
The Cyberinfrastructure Leadership Academy (CILA) addresses a critical gap in the Research Computing and Data (RCD) ecosystem: the preparation and transition of merging/institution-level Cyberinfrastructure (CI) leaders to national CI leadership, as a generation of experienced CI leaders retires. Instead of focusing primarily on technical skill acquisition, CILA emphasizes leadership, strategy, mentoring, and community-building across institution-level, regional, and national scales. Drawing on five workshops conducted between 2019 and 2025, this paper synthesizes CILA’s design elements, cross-cutting themes, and evaluation outcomes. We frame CILA as a workforce development and leadership intervention, highlighting effective practices for mentoring, leadership development, stakeholder engagement, and sustaining resilient CI communities. Evaluation results demonstrate CILA’s strong impact on participants’ professional networks, leadership con!dence, and ability to influence institution-level and national CI strategy.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Conference Paper:
- https://doi.org/10.1145/3626203.3670553
