On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration

研究成果: 著書/レポートタイプへの貢献会議での発言

6 引用 (Scopus)

抄録

A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

元の言語英語
ホスト出版物のタイトルProceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015
出版者Institute of Electrical and Electronics Engineers Inc.
ページ371-377
ページ数7
ISBN(電子版)9781467397971
DOI
出版物ステータス出版済み - 3 2 2016
イベント3rd International Symposium on Computing and Networking, CANDAR 2015 - Sapporo, Hokkaido, 日本
継続期間: 12 8 201512 11 2015

出版物シリーズ

名前Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

その他

その他3rd International Symposium on Computing and Networking, CANDAR 2015
日本
Sapporo, Hokkaido
期間12/8/1512/11/15

Fingerprint

Servers

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Computational Theory and Mathematics
  • Computer Networks and Communications

これを引用

Oe, K., Nanri, T., & Okamura, K. (2016). On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. : Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015 (pp. 371-377). [7424741] (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CANDAR.2015.42

On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. / Oe, Kazuichi; Nanri, Takeshi; Okamura, Koji.

Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 371-377 7424741 (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015).

研究成果: 著書/レポートタイプへの貢献会議での発言

Oe, K, Nanri, T & Okamura, K 2016, On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. : Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015., 7424741, Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015, Institute of Electrical and Electronics Engineers Inc., pp. 371-377, 3rd International Symposium on Computing and Networking, CANDAR 2015, Sapporo, Hokkaido, 日本, 12/8/15. https://doi.org/10.1109/CANDAR.2015.42
Oe K, Nanri T, Okamura K. On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. : Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 371-377. 7424741. (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015). https://doi.org/10.1109/CANDAR.2015.42
Oe, Kazuichi ; Nanri, Takeshi ; Okamura, Koji. / On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration. Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 371-377 (Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015).
@inproceedings{a388af5f7f1b45fa947fee6d86402ec8,
title = "On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration",
abstract = "A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113{\%} faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.",
author = "Kazuichi Oe and Takeshi Nanri and Koji Okamura",
year = "2016",
month = "3",
day = "2",
doi = "10.1109/CANDAR.2015.42",
language = "English",
series = "Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "371--377",
booktitle = "Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015",
address = "United States",

}

TY - GEN

T1 - On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration

AU - Oe, Kazuichi

AU - Nanri, Takeshi

AU - Okamura, Koji

PY - 2016/3/2

Y1 - 2016/3/2

N2 - A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

AB - A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

UR - http://www.scopus.com/inward/record.url?scp=84964765556&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964765556&partnerID=8YFLogxK

U2 - 10.1109/CANDAR.2015.42

DO - 10.1109/CANDAR.2015.42

M3 - Conference contribution

AN - SCOPUS:84964765556

T3 - Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

SP - 371

EP - 377

BT - Proceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -