Approaches for memory-efficient communication library and runtime communication optimization

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

This article summarizes the works established in Advanced Communication for Exa (ACE) project. The most important motivation of this project was the severe demands for scalable communication toward Exa-scale computations. Therefore, in the project, we have built a PGAS-based communication library, Advanced Communication Primitives (ACP). Its fundamental communication model is onesided, based on PGAS model, so that it can consume internal memory footprint as small as possible. Based on this model, several applications including simulations of magnetohydrodynamic, molecular orbitals, and particles were tuned to achieve higher scalability. In addition to that, some communication optimization techniques have been investigated. Especially, tuning methods of collective communications, such as message ordering, algorithm selection, and overlapping, are studied. Also, in this project, a network simulator NSIM-ACE is developed. It simulates behavior of packets for one-sided communications to study the effects of congestions on interconnects.

Original languageEnglish
Title of host publicationAdvanced Software Technologies for Post-Peta Scale Computing
Subtitle of host publicationThe Japanese Post-Peta CREST Research Project
PublisherSpringer Singapore
Pages121-138
Number of pages18
ISBN (Electronic)9789811319242
ISBN (Print)9789811319235
DOIs
Publication statusPublished - Dec 6 2018

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Approaches for memory-efficient communication library and runtime communication optimization'. Together they form a unique fingerprint.

  • Cite this

    Nanri, T. (2018). Approaches for memory-efficient communication library and runtime communication optimization. In Advanced Software Technologies for Post-Peta Scale Computing: The Japanese Post-Peta CREST Research Project (pp. 121-138). Springer Singapore. https://doi.org/10.1007/978-981-13-1924-2_7