Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers

Katsuki Fujisawa, Toyotaro Suzumura, Hitoshi Sato, Koji Ueno, Satoshi Imamura, Ryo Mizote, Akira Tanaka, Nozomi Hata, Toshio Endo

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In this paper, we present our ongoing research project. The objective of many ongoing research projects in high-performance computing (HPC) areas is to develop an advanced computing and optimization infrastructure for extremely largescale graphs on the peta-scale supercomputers. The extremely large-scale graphs that have recently emerged in various application fields, such as transportation, social networks, cybersecurity, disaster prevention, and bioinformatics, require fast and scalable analysis. The Graph500 benchmark measures the performance of any supercomputer performing a breadth-first search (BFS) in terms of traversed edges per second (TEPS). In 2014-2017, our project team has achieved about 38.6TeraTEPS on K computer and been a winner at the 8th and 10th to 15th Graph500 benchmark. We commenced our research project for developing the Urban OS (Operating System) for a large-scale city in 2013. The Urban OS, which is regarded as one of the emerging applications of the cyber-physical system (CPS), gathers big data sets of the distribution of people and transportation movements by utilizing sensor technologies and storing them in the cloud storage system. In the next step, we apply optimization, simulation, and deep learning techniques to solve them and check the validity of solutions obtained on the cyberspace. The Urban OS employs the graph analysis system developed by this research project and provides a feedback to a predicting and controlling center to optimize many social systems and services.We briefly explain our ongoing research project for realizing the Urban OS.

Original languageEnglish
Title of host publicationAdvanced Software Technologies for Post-Peta Scale Computing
Subtitle of host publicationThe Japanese Post-Peta CREST Research Project
PublisherSpringer Singapore
Pages207-226
Number of pages20
ISBN (Electronic)9789811319242
ISBN (Print)9789811319235
DOIs
Publication statusPublished - Dec 6 2018

Fingerprint

Supercomputers
Disaster prevention
Bioinformatics
Feedback
Sensors

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

Fujisawa, K., Suzumura, T., Sato, H., Ueno, K., Imamura, S., Mizote, R., ... Endo, T. (2018). Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers. In Advanced Software Technologies for Post-Peta Scale Computing: The Japanese Post-Peta CREST Research Project (pp. 207-226). Springer Singapore. https://doi.org/10.1007/978-981-13-1924-2_11

Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers. / Fujisawa, Katsuki; Suzumura, Toyotaro; Sato, Hitoshi; Ueno, Koji; Imamura, Satoshi; Mizote, Ryo; Tanaka, Akira; Hata, Nozomi; Endo, Toshio.

Advanced Software Technologies for Post-Peta Scale Computing: The Japanese Post-Peta CREST Research Project. Springer Singapore, 2018. p. 207-226.

Research output: Chapter in Book/Report/Conference proceedingChapter

Fujisawa, K, Suzumura, T, Sato, H, Ueno, K, Imamura, S, Mizote, R, Tanaka, A, Hata, N & Endo, T 2018, Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers. in Advanced Software Technologies for Post-Peta Scale Computing: The Japanese Post-Peta CREST Research Project. Springer Singapore, pp. 207-226. https://doi.org/10.1007/978-981-13-1924-2_11
Fujisawa K, Suzumura T, Sato H, Ueno K, Imamura S, Mizote R et al. Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers. In Advanced Software Technologies for Post-Peta Scale Computing: The Japanese Post-Peta CREST Research Project. Springer Singapore. 2018. p. 207-226 https://doi.org/10.1007/978-981-13-1924-2_11
Fujisawa, Katsuki ; Suzumura, Toyotaro ; Sato, Hitoshi ; Ueno, Koji ; Imamura, Satoshi ; Mizote, Ryo ; Tanaka, Akira ; Hata, Nozomi ; Endo, Toshio. / Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers. Advanced Software Technologies for Post-Peta Scale Computing: The Japanese Post-Peta CREST Research Project. Springer Singapore, 2018. pp. 207-226
@inbook{ccd9b5d76893403fa52e6d32214f85c8,
title = "Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers",
abstract = "In this paper, we present our ongoing research project. The objective of many ongoing research projects in high-performance computing (HPC) areas is to develop an advanced computing and optimization infrastructure for extremely largescale graphs on the peta-scale supercomputers. The extremely large-scale graphs that have recently emerged in various application fields, such as transportation, social networks, cybersecurity, disaster prevention, and bioinformatics, require fast and scalable analysis. The Graph500 benchmark measures the performance of any supercomputer performing a breadth-first search (BFS) in terms of traversed edges per second (TEPS). In 2014-2017, our project team has achieved about 38.6TeraTEPS on K computer and been a winner at the 8th and 10th to 15th Graph500 benchmark. We commenced our research project for developing the Urban OS (Operating System) for a large-scale city in 2013. The Urban OS, which is regarded as one of the emerging applications of the cyber-physical system (CPS), gathers big data sets of the distribution of people and transportation movements by utilizing sensor technologies and storing them in the cloud storage system. In the next step, we apply optimization, simulation, and deep learning techniques to solve them and check the validity of solutions obtained on the cyberspace. The Urban OS employs the graph analysis system developed by this research project and provides a feedback to a predicting and controlling center to optimize many social systems and services.We briefly explain our ongoing research project for realizing the Urban OS.",
author = "Katsuki Fujisawa and Toyotaro Suzumura and Hitoshi Sato and Koji Ueno and Satoshi Imamura and Ryo Mizote and Akira Tanaka and Nozomi Hata and Toshio Endo",
year = "2018",
month = "12",
day = "6",
doi = "10.1007/978-981-13-1924-2_11",
language = "English",
isbn = "9789811319235",
pages = "207--226",
booktitle = "Advanced Software Technologies for Post-Peta Scale Computing",
publisher = "Springer Singapore",

}

TY - CHAP

T1 - Advanced computing and optimization infrastructure for extremely large-scale graphs on post-peta-scale supercomputers

AU - Fujisawa, Katsuki

AU - Suzumura, Toyotaro

AU - Sato, Hitoshi

AU - Ueno, Koji

AU - Imamura, Satoshi

AU - Mizote, Ryo

AU - Tanaka, Akira

AU - Hata, Nozomi

AU - Endo, Toshio

PY - 2018/12/6

Y1 - 2018/12/6

N2 - In this paper, we present our ongoing research project. The objective of many ongoing research projects in high-performance computing (HPC) areas is to develop an advanced computing and optimization infrastructure for extremely largescale graphs on the peta-scale supercomputers. The extremely large-scale graphs that have recently emerged in various application fields, such as transportation, social networks, cybersecurity, disaster prevention, and bioinformatics, require fast and scalable analysis. The Graph500 benchmark measures the performance of any supercomputer performing a breadth-first search (BFS) in terms of traversed edges per second (TEPS). In 2014-2017, our project team has achieved about 38.6TeraTEPS on K computer and been a winner at the 8th and 10th to 15th Graph500 benchmark. We commenced our research project for developing the Urban OS (Operating System) for a large-scale city in 2013. The Urban OS, which is regarded as one of the emerging applications of the cyber-physical system (CPS), gathers big data sets of the distribution of people and transportation movements by utilizing sensor technologies and storing them in the cloud storage system. In the next step, we apply optimization, simulation, and deep learning techniques to solve them and check the validity of solutions obtained on the cyberspace. The Urban OS employs the graph analysis system developed by this research project and provides a feedback to a predicting and controlling center to optimize many social systems and services.We briefly explain our ongoing research project for realizing the Urban OS.

AB - In this paper, we present our ongoing research project. The objective of many ongoing research projects in high-performance computing (HPC) areas is to develop an advanced computing and optimization infrastructure for extremely largescale graphs on the peta-scale supercomputers. The extremely large-scale graphs that have recently emerged in various application fields, such as transportation, social networks, cybersecurity, disaster prevention, and bioinformatics, require fast and scalable analysis. The Graph500 benchmark measures the performance of any supercomputer performing a breadth-first search (BFS) in terms of traversed edges per second (TEPS). In 2014-2017, our project team has achieved about 38.6TeraTEPS on K computer and been a winner at the 8th and 10th to 15th Graph500 benchmark. We commenced our research project for developing the Urban OS (Operating System) for a large-scale city in 2013. The Urban OS, which is regarded as one of the emerging applications of the cyber-physical system (CPS), gathers big data sets of the distribution of people and transportation movements by utilizing sensor technologies and storing them in the cloud storage system. In the next step, we apply optimization, simulation, and deep learning techniques to solve them and check the validity of solutions obtained on the cyberspace. The Urban OS employs the graph analysis system developed by this research project and provides a feedback to a predicting and controlling center to optimize many social systems and services.We briefly explain our ongoing research project for realizing the Urban OS.

UR - http://www.scopus.com/inward/record.url?scp=85063801147&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063801147&partnerID=8YFLogxK

U2 - 10.1007/978-981-13-1924-2_11

DO - 10.1007/978-981-13-1924-2_11

M3 - Chapter

AN - SCOPUS:85063801147

SN - 9789811319235

SP - 207

EP - 226

BT - Advanced Software Technologies for Post-Peta Scale Computing

PB - Springer Singapore

ER -