A comprehensive study of in-memory computing on large HPC systems
Document Type
Conference Proceeding
Publication Date
11-1-2020
Abstract
—With the increasing fidelity and resolution enabled by high-performance computing systems, simulation-based scientific discovery is able to model and understand microscopic physical phenomena at a level that was not possible in the past. A grand challenge that the HPC community is faced with is how to handle the large amounts of analysis data generated from simulations. In-memory computing, among others, is recognized to be a viable path forward and has experienced tremendous success in the past decade. Nevertheless, there has been a lack of a complete study and understanding of in-memory computing as a whole on HPC systems. This paper presents a comprehensive study, which goes well beyond the typical performance metrics. In particular, we assess the in-memory computing with regard to its usability, portability, robustness and internal design trade-offs, which are the key factors that of interest to domain scientists. We use two realistic scientific workflows, LAMMPS and Laplace, to conduct comprehensive studies on state-of-the-art in-memory computing libraries, including DataSpaces, DIMES, Flexpath and Decaf. We conduct cross-platform experiments at scale on two leading supercomputers, Titan at ORNL and Cori at NERSC, and summarize our key findings in this critical area.
Identifier
85102014416 (Scopus)
ISBN
[9781728170022]
Publication Title
Proceedings International Conference on Distributed Computing Systems
External Full Text Location
https://doi.org/10.1109/ICDCS47774.2020.00045
First Page
987
Last Page
997
Volume
2020-November
Grant
CCF-1812861
Fund Ref
U.S. Department of Energy
Recommended Citation
Huang, Dan; Qin, Zhenlu; Liu, Qing; Podhorszki, Norbert; and Klasky, Scott, "A comprehensive study of in-memory computing on large HPC systems" (2020). Faculty Publications. 4877.
https://digitalcommons.njit.edu/fac_pubs/4877
