More Like this

1. MANA for MPI: MPI-Agnostic Network-Agnostic Transparent Checkpointing

   https://doi.org/10.1145/3307681.3325962  

   Garg, Rohan ; Price, Gregory ; Cooperman, Gene ( June 2019 , Proc. of 28th Int. Symp. on High Performance Parallel and Distributed Computing (HPDC'19))

   Transparently checkpointing MPI for fault tolerance and load balancing is a long-standing problem in HPC. The problem has been complicated by the need to provide checkpoint-restart services for all combinations of an MPI implementation over all network interconnects. This work presents MANA (MPI-Agnostic Network-Agnostic transparent checkpointing), a single code base which supports all MPI implementation and interconnect combinations. The agnostic properties imply that one can checkpoint an MPI application under one MPI implementation and perhaps over TCP, and then restart under a second MPI implementation over InfiniBand on a cluster with a different number of CPU cores per node. This technique is based on a novel "split-process" approach, which enables two separate programs to co-exist within a single process with a single address space. This work overcomes the limitations of the two most widely adopted transparent checkpointing solutions, BLCR and DMTCP/InfiniBand, which require separate modifications to each MPI implementation and/or underlying network API. The runtime overhead is found to be insignificant both for checkpoint-restart within a single host, and when comparing a local MPI computation that was migrated to a remote cluster against an ordinary MPI computation running natively on that same remote cluster. 

   more » « less
2. MPI-FAUN: An MPI-Based Framework for Alternating-Updating Nonnegative Matrix Factorization

   https://doi.org/10.1109/TKDE.2017.2767592  

   Kannan, Ramakrishnan ; Ballard, Grey ; Park, Haesun ( March 2018 , IEEE Transactions on Knowledge and Data Engineering)
3. Give MPI Threading a Fair Chance: A Study of Multithreaded MPI Designs

   https://doi.org/10.1109/CLUSTER.2019.8891015  

   Patinyasakdikul, T. ; Eberius, D. ; Bosilca, G. ; Hjelm, N. ( September 2019 , IEEE Cluster)

   null (Ed.)
4. Spark Meets MPI: Towards High-Performance Communication Framework for Spark using MPI

   Al Attar, K. ; Shafi, A. ; Abduljabbar, M. ; H. Subramoni, H. ; Panda, DK ( January 2022 , 2022 IEEE International Conference on Cluster Computing)
5. Quo Vadis MPI RMA? Towards a More Efficient Use of MPI One-Sided Communication

   Schuchart, J. ; Niethammer, C. ; Gracia, J. ; Bosilca, G. ( January 2021 , Proceedings of EuroMPI 2021 (EuroMPI’21)

   The MPI standard has long included one-sided communication abstractions through the MPI Remote Memory Access (RMA) interface. Unfortunately, the MPI RMA chapter in the 4.0 version of the MPI standard still contains both well-known and lesser known short-comings for both implementations and users, which lead to potentially non-optimal usage patterns. In this paper, we identify a set of issues and propose ways for applications to better express anticipated usage of RMA routines, allowing the MPI implementation to better adapt to the application's needs. In order to increase the flexibility of the RMA interface, we add the capability to duplicate windows, allowing access to the same resources encapsulated by a window using different configurations. In the same vein, we introduce the concept of MPI memory handles, meant to provide life-time guarantees on memory attached to dynamic windows, removing the overhead currently present in using dynamically exposed memory. We will show that our extensions provide improved accumulate latencies, reduced overheads for multi-threaded flushes, and allow for zero overhead dynamic memory window usage. 

   more » « less