More Like this

1. MPI-FAUN: An MPI-Based Framework for Alternating-Updating Nonnegative Matrix Factorization

   https://doi.org/10.1109/TKDE.2017.2767592  

   Kannan, Ramakrishnan ; Ballard, Grey ; Park, Haesun ( March 2018 , IEEE Transactions on Knowledge and Data Engineering)
2. Quo Vadis MPI RMA? Towards a More Efficient Use of MPI One-Sided Communication

   Schuchart, J. ; Niethammer, C. ; Gracia, J. ; Bosilca, G. ( January 2021 , Proceedings of EuroMPI 2021 (EuroMPI’21)

   The MPI standard has long included one-sided communication abstractions through the MPI Remote Memory Access (RMA) interface. Unfortunately, the MPI RMA chapter in the 4.0 version of the MPI standard still contains both well-known and lesser known short-comings for both implementations and users, which lead to potentially non-optimal usage patterns. In this paper, we identify a set of issues and propose ways for applications to better express anticipated usage of RMA routines, allowing the MPI implementation to better adapt to the application's needs. In order to increase the flexibility of the RMA interface, we add the capability to duplicate windows, allowing access to the same resources encapsulated by a window using different configurations. In the same vein, we introduce the concept of MPI memory handles, meant to provide life-time guarantees on memory attached to dynamic windows, removing the overhead currently present in using dynamically exposed memory. We will show that our extensions provide improved accumulate latencies, reduced overheads for multi-threaded flushes, and allow for zero overhead dynamic memory window usage. 

   more » « less
3. MANA for MPI: MPI-Agnostic Network-Agnostic Transparent Checkpointing

   https://doi.org/10.1145/3307681.3325962  

   Garg, Rohan ; Price, Gregory ; Cooperman, Gene ( June 2019 , Proc. of 28th Int. Symp. on High Performance Parallel and Distributed Computing (HPDC'19))

   Transparently checkpointing MPI for fault tolerance and load balancing is a long-standing problem in HPC. The problem has been complicated by the need to provide checkpoint-restart services for all combinations of an MPI implementation over all network interconnects. This work presents MANA (MPI-Agnostic Network-Agnostic transparent checkpointing), a single code base which supports all MPI implementation and interconnect combinations. The agnostic properties imply that one can checkpoint an MPI application under one MPI implementation and perhaps over TCP, and then restart under a second MPI implementation over InfiniBand on a cluster with a different number of CPU cores per node. This technique is based on a novel "split-process" approach, which enables two separate programs to co-exist within a single process with a single address space. This work overcomes the limitations of the two most widely adopted transparent checkpointing solutions, BLCR and DMTCP/InfiniBand, which require separate modifications to each MPI implementation and/or underlying network API. The runtime overhead is found to be insignificant both for checkpoint-restart within a single host, and when comparing a local MPI computation that was migrated to a remote cluster against an ordinary MPI computation running natively on that same remote cluster. 

   more » « less
4. Spark Meets MPI: Towards High-Performance Communication Framework for Spark using MPI

   Al Attar, K. ; Shafi, A. ; Abduljabbar, M. ; H. Subramoni, H. ; Panda, DK ( January 2022 , 2022 IEEE International Conference on Cluster Computing)
5. An Empirical Study of Cryptographic Libraries for MPI Communications

   https://doi.org/10.1109/CLUSTER.2019.8891033  

   Naser, Abu ; Gavahi, Mohsen ; Wu, Cong ; Hoang, Viet Tung ; Wang, Zhi ; Yuan, Xin ( September 2019 , IEEE International Conference on Cluster Computing (CLUSTER))

   As High Performance Computing (HPC) applications with data security requirements are increasingly moving to execute in the public cloud, there is a demand that the cloud infrastructure for HPC should support privacy and integrity. Incorporating privacy and integrity mechanisms in the communication infrastructure of today's public cloud is challenging because recent advances in the networking infrastructure in data centers have shifted the communication bottleneck from the network links to the network end points and because encryption is computationally intensive. In this work, we consider incorporating encryption to support privacy and integrity in the Message Passing Interface (MPI) library, which is widely used in HPC applications. We empirically study four contemporary cryptographic libraries, OpenSSL, BoringSSL, Libsodium, and CryptoPP using micro-benchmarks and NAS parallel benchmarks to evaluate their overheads for encrypting MPI messages on two different networking technologies, 10Gbps Ethernet and 40Gbps InfiniBand. The results indicate that (1) the performance differs drastically across cryptographic libraries, and (2) effectively supporting privacy and integrity in MPI communications on high speed data center networks is challenging-even with the most efficient cryptographic library, encryption can still introduce very significant overheads in some scenarios such as a single MPI communication operation on InfiniBand, but (3) the overall overhead may not be prohibitive for practical uses since there can be multiple concurrent communications. 

   more » « less