Model-Based API Testing of Apache ZooKeeper

Cyrille Artho; Quentin Gros; Guillaume Rousset; Kazuaki Banzai; Lei Ma; Takashi Kitamura; Masami Hagiya; Yoshinori Tanabe; Mitsuharu Yamamoto

doi:10.1109/ICST.2017.33

Model-Based API Testing of Apache ZooKeeper

Cyrille Artho, Quentin Gros, Guillaume Rousset, Kazuaki Banzai, Lei Ma, Takashi Kitamura, Masami Hagiya, Yoshinori Tanabe, Mitsuharu Yamamoto

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

22 Citations (Scopus)

Abstract

Apache ZooKeeper is a distributed data storage that is highly concurrent and asynchronous due to network communication, testing such a system is very challenging. Our solution using the tool 'Modbat' generates test cases for concurrent client sessions, and processes results from synchronous and asynchronous callbacks. We use an embedded model checker to compute the test oracle for non-deterministic outcomes, the oracle model evolves dynamically with each new test step. Our work has detected multiple previously unknown defects in ZooKeeper. Finally, a thorough coverage evaluation of the core classes show how code and branch coverage strongly relate to feature coverage in the model, and hence modeling effort.

Original language	English
Title of host publication	Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	288-298
Number of pages	11
ISBN (Electronic)	9781509060313
DOIs	https://doi.org/10.1109/ICST.2017.33
Publication status	Published - May 15 2017
Externally published	Yes
Event	10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017 - Tokyo, Japan Duration: Mar 13 2017 → Mar 17 2017

Publication series

Name	Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017

Conference

Conference	10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017
Country/Territory	Japan
City	Tokyo
Period	3/13/17 → 3/17/17

All Science Journal Classification (ASJC) codes

Safety, Risk, Reliability and Quality
Software

Access to Document

10.1109/ICST.2017.33

Cite this

Artho, C., Gros, Q., Rousset, G., Banzai, K., Ma, L., Kitamura, T., Hagiya, M., Tanabe, Y., & Yamamoto, M. (2017). Model-Based API Testing of Apache ZooKeeper. In Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017 (pp. 288-298). [7927983] (Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICST.2017.33

Model-Based API Testing of Apache ZooKeeper. / Artho, Cyrille; Gros, Quentin; Rousset, Guillaume et al.
Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 288-298 7927983 (Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Artho, C, Gros, Q, Rousset, G, Banzai, K, Ma, L, Kitamura, T, Hagiya, M, Tanabe, Y & Yamamoto, M 2017, Model-Based API Testing of Apache ZooKeeper. in Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017., 7927983, Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017, Institute of Electrical and Electronics Engineers Inc., pp. 288-298, 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017, Tokyo, Japan, 3/13/17. https://doi.org/10.1109/ICST.2017.33

Artho C, Gros Q, Rousset G, Banzai K, Ma L, Kitamura T et al. Model-Based API Testing of Apache ZooKeeper. In Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 288-298. 7927983. (Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017). doi: 10.1109/ICST.2017.33

Artho, Cyrille ; Gros, Quentin ; Rousset, Guillaume et al. / Model-Based API Testing of Apache ZooKeeper. Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 288-298 (Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017).

@inproceedings{c05eec72e82c47aeb058d2e3bb9855c8,

title = "Model-Based API Testing of Apache ZooKeeper",

abstract = "Apache ZooKeeper is a distributed data storage that is highly concurrent and asynchronous due to network communication, testing such a system is very challenging. Our solution using the tool 'Modbat' generates test cases for concurrent client sessions, and processes results from synchronous and asynchronous callbacks. We use an embedded model checker to compute the test oracle for non-deterministic outcomes, the oracle model evolves dynamically with each new test step. Our work has detected multiple previously unknown defects in ZooKeeper. Finally, a thorough coverage evaluation of the core classes show how code and branch coverage strongly relate to feature coverage in the model, and hence modeling effort.",

author = "Cyrille Artho and Quentin Gros and Guillaume Rousset and Kazuaki Banzai and Lei Ma and Takashi Kitamura and Masami Hagiya and Yoshinori Tanabe and Mitsuharu Yamamoto",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017 ; Conference date: 13-03-2017 Through 17-03-2017",

year = "2017",

month = may,

day = "15",

doi = "10.1109/ICST.2017.33",

language = "English",

series = "Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "288--298",

booktitle = "Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017",

address = "United States",

}

TY - GEN

T1 - Model-Based API Testing of Apache ZooKeeper

AU - Artho, Cyrille

AU - Gros, Quentin

AU - Rousset, Guillaume

AU - Banzai, Kazuaki

AU - Ma, Lei

AU - Kitamura, Takashi

AU - Hagiya, Masami

AU - Tanabe, Yoshinori

AU - Yamamoto, Mitsuharu

PY - 2017/5/15

Y1 - 2017/5/15

N2 - Apache ZooKeeper is a distributed data storage that is highly concurrent and asynchronous due to network communication, testing such a system is very challenging. Our solution using the tool 'Modbat' generates test cases for concurrent client sessions, and processes results from synchronous and asynchronous callbacks. We use an embedded model checker to compute the test oracle for non-deterministic outcomes, the oracle model evolves dynamically with each new test step. Our work has detected multiple previously unknown defects in ZooKeeper. Finally, a thorough coverage evaluation of the core classes show how code and branch coverage strongly relate to feature coverage in the model, and hence modeling effort.

AB - Apache ZooKeeper is a distributed data storage that is highly concurrent and asynchronous due to network communication, testing such a system is very challenging. Our solution using the tool 'Modbat' generates test cases for concurrent client sessions, and processes results from synchronous and asynchronous callbacks. We use an embedded model checker to compute the test oracle for non-deterministic outcomes, the oracle model evolves dynamically with each new test step. Our work has detected multiple previously unknown defects in ZooKeeper. Finally, a thorough coverage evaluation of the core classes show how code and branch coverage strongly relate to feature coverage in the model, and hence modeling effort.

UR - http://www.scopus.com/inward/record.url?scp=85018894865&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018894865&partnerID=8YFLogxK

U2 - 10.1109/ICST.2017.33

DO - 10.1109/ICST.2017.33

M3 - Conference contribution

AN - SCOPUS:85018894865

T3 - Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017

SP - 288

EP - 298

BT - Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017

Y2 - 13 March 2017 through 17 March 2017

ER -

Model-Based API Testing of Apache ZooKeeper

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this