On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    8 Citations (Scopus)

    Abstract

    A hybrid storage system consisting of SSDs and HDDs improves the performance of user IOs by moving IO concentrated areas from the HDDs to the SSDs. It is important for the system to identify such areas and move them to the SSDs immediately. We studied the IO concentrations of operational storage servers and found one type that they continue for up to an hour within a narrow region of storage volume. The narrow region is either the same continued area or the area which moves to the neighboring after 3 minutes in average had passed. Moreover, it appeared at random logical block addresses (LBAs). We decide to call such IO concentrations Wandering IO Concentrated Areas (WIOCAs). To handle these concentrations, we developed an on-The-fly automated storage tiering (OTF-AST) with a caching system and both proactive and observational migration features. This method dynamically migrates the WIOCAs to the SSD of the OTF-AST and hands over the other IO concentrations to cache. The proactive migration feature migrates candidate WIOCAs to an area that will likely become one in the near future. On the other hand, the observational migration feature determines the HDD overhead by checking the user response time and migrates the sub-LUNs that were but are no longer parts of a WIOCA from the SSD to the HDD when the HDD overhead is low. Experimental results showed that our method was 113% faster than Facebook FlashCache on one of the Microsoft Research Cambridge workloads.

    Original languageEnglish
    Title of host publicationProceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages371-377
    Number of pages7
    ISBN (Electronic)9781467397971
    DOIs
    Publication statusPublished - Mar 2 2016
    Event3rd International Symposium on Computing and Networking, CANDAR 2015 - Sapporo, Hokkaido, Japan
    Duration: Dec 8 2015Dec 11 2015

    Publication series

    NameProceedings - 2015 3rd International Symposium on Computing and Networking, CANDAR 2015

    Other

    Other3rd International Symposium on Computing and Networking, CANDAR 2015
    Country/TerritoryJapan
    CitySapporo, Hokkaido
    Period12/8/1512/11/15

    All Science Journal Classification (ASJC) codes

    • Computer Science Applications
    • Computational Theory and Mathematics
    • Computer Networks and Communications

    Fingerprint

    Dive into the research topics of 'On-The-Fly Automated Storage Tiering with Caching and both Proactive and Observational Migration'. Together they form a unique fingerprint.

    Cite this