The design of advanced communication to reduce memory usage for exa-scale systems

Shinji Sumimoto, Yuichiro Ajima, Kazushige Saga, Takafumi Nose, Naoyuki Shida, Takeshi Nanri

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Current MPI (Message Passing Interface) communication libraries require larger memories in proportion of the number of processes, and can not be used for exa-scale systems. This paper proposes a global memory based communication design to reduce memory usage for exa-scale communication. To realize exa-scale communication, we propose true global memory based communication primitives called Advanced Communication Primitives (ACPs). ACPs provide global address, which is able to use remote atomic memory operations on the global memory, RDMA (Remote Direct Memory Access) based remote memory copy operation, global heap allocator and global data libraries. ACPs are different from the other communication libraries because ACPs are global memory based so that house keeping memories can be distributed to other processes and programmers explicitly consider memory usage by using ACPs. The preliminary result of memory usage by ACPs is 70 MB on one million processes.

Original languageEnglish
Title of host publicationHigh Performance Computing for Computational Science
Subtitle of host publicationVECPAR 2016 - 12th International Conference, Revised Selected Papers
EditorsInes Dutra, Rui Camacho, Jorge Barbosa, Osni Marques
PublisherSpringer Verlag
Pages149-161
Number of pages13
ISBN (Print)9783319619811
DOIs
Publication statusPublished - Jan 1 2017
Event12th International Conference on High Performance Computing for Computational Science, VECPAR 2016 - Porto, Portugal
Duration: Jun 28 2016Jun 30 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10150 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other12th International Conference on High Performance Computing for Computational Science, VECPAR 2016
CountryPortugal
CityPorto
Period6/28/166/30/16

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'The design of advanced communication to reduce memory usage for exa-scale systems'. Together they form a unique fingerprint.

  • Cite this

    Sumimoto, S., Ajima, Y., Saga, K., Nose, T., Shida, N., & Nanri, T. (2017). The design of advanced communication to reduce memory usage for exa-scale systems. In I. Dutra, R. Camacho, J. Barbosa, & O. Marques (Eds.), High Performance Computing for Computational Science: VECPAR 2016 - 12th International Conference, Revised Selected Papers (pp. 149-161). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10150 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-61982-8_15