On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

Original languageEnglish
Title of host publicationProceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages371-377
Number of pages7
ISBN (Electronic)9781467397971
DOIs
Publication statusPublished - Mar 2 2016
Event3rd International Symposium on Computing and Networking, CANDAR 2015 - Sapporo, Hokkaido, Japan
Duration: Dec 8 2015Dec 11 2015

Publication series

NameProceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

Other

Other3rd International Symposium on Computing and Networking, CANDAR 2015
CountryJapan
CitySapporo, Hokkaido
Period12/8/1512/11/15

Fingerprint

Servers

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Computational Theory and Mathematics
  • Computer Networks and Communications

Cite this

Oe, K., Nanri, T., & Okamura, K. (2016). On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. In Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015 (pp. 371-377). [7424741] (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CANDAR.2015.42

On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. / Oe, Kazuichi; Nanri, Takeshi; Okamura, Koji.

Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 371-377 7424741 (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Oe, K, Nanri, T & Okamura, K 2016, On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. in Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015., 7424741, Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015, Institute of Electrical and Electronics Engineers Inc., pp. 371-377, 3rd International Symposium on Computing and Networking, CANDAR 2015, Sapporo, Hokkaido, Japan, 12/8/15. https://doi.org/10.1109/CANDAR.2015.42
Oe K, Nanri T, Okamura K. On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. In Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 371-377. 7424741. (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015). https://doi.org/10.1109/CANDAR.2015.42
Oe, Kazuichi ; Nanri, Takeshi ; Okamura, Koji. / On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 371-377 (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015).
@inproceedings{a388af5f7f1b45fa947fee6d86402ec8,
title = "On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration",
abstract = "A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113{\%} faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.",
author = "Kazuichi Oe and Takeshi Nanri and Koji Okamura",
year = "2016",
month = "3",
day = "2",
doi = "10.1109/CANDAR.2015.42",
language = "English",
series = "Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "371--377",
booktitle = "Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015",
address = "United States",

}

TY - GEN

T1 - On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration

AU - Oe, Kazuichi

AU - Nanri, Takeshi

AU - Okamura, Koji

PY - 2016/3/2

Y1 - 2016/3/2

N2 - A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

AB - A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

UR - http://www.scopus.com/inward/record.url?scp=84964765556&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964765556&partnerID=8YFLogxK

U2 - 10.1109/CANDAR.2015.42

DO - 10.1109/CANDAR.2015.42

M3 - Conference contribution

AN - SCOPUS:84964765556

T3 - Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

SP - 371

EP - 377

BT - Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -