The design of advanced communication to reduce memory usage for exa-scale systems

Shinji Sumimoto, Yuichiro Ajima, Kazushige Saga, Takafumi Nose, Naoyuki Shida, Takeshi Nanri

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    Current MPI (Message Passing Interface) communication libraries require larger memories in proportion of the number of processes, and can not be used for exa-scale systems. This paper proposes a global memory based communication design to reduce memory usage for exa-scale communication. To realize exa-scale communication, we propose true global memory based communication primitives called Advanced Communication Primitives (ACPs). ACPs provide global address, which is able to use remote atomic memory operations on the global memory, RDMA (Remote Direct Memory Access) based remote memory copy operation, global heap allocator and global data libraries. ACPs are different from the other communication libraries because ACPs are global memory based so that house keeping memories can be distributed to other processes and programmers explicitly consider memory usage by using ACPs. The preliminary result of memory usage by ACPs is 70 MB on one million processes.

    Original languageEnglish
    Title of host publicationHigh Performance Computing for Computational Science
    Subtitle of host publicationVECPAR 2016 - 12th International Conference, Revised Selected Papers
    EditorsInes Dutra, Rui Camacho, Jorge Barbosa, Osni Marques
    PublisherSpringer Verlag
    Pages149-161
    Number of pages13
    ISBN (Print)9783319619811
    DOIs
    Publication statusPublished - 2017
    Event12th International Conference on High Performance Computing for Computational Science, VECPAR 2016 - Porto, Portugal
    Duration: Jun 28 2016Jun 30 2016

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume10150 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Other

    Other12th International Conference on High Performance Computing for Computational Science, VECPAR 2016
    CountryPortugal
    CityPorto
    Period6/28/166/30/16

    All Science Journal Classification (ASJC) codes

    • Theoretical Computer Science
    • Computer Science(all)

    Fingerprint Dive into the research topics of 'The design of advanced communication to reduce memory usage for exa-scale systems'. Together they form a unique fingerprint.

    Cite this