TY - GEN
T1 - Bug Characteristics in Probabilistic Programming Systems
T2 - 21st International Conference on Software Quality, Reliability and Security Companion, QRS-C 2021
AU - Duc, Le Manh
AU - Yu, Haibo
AU - Zhao, Jianjun
N1 - Funding Information:
ACKNOWLEDGMENT This work was partially supported by JSPS KAKENHI Grant 21K11841 and KSU Foundation Research (Grant A-3 No.268, 2021).
Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Probabilistic programming systems allow developers to model random phenomena and perform reasoning about the model efficiently. As the number and adoption of probabilistic programming systems are growing significantly, the reliability of such systems is also becoming increasingly important. It is thus crucial to analyze existing bugs in similar systems to ensure the reliability of these systems. This paper conducts an empirical study to investigate bugs and their features on real probabilistic programming systems. We select three popular probabilistic programming projects on GitHub, namely Edward, Pyro, and PyMC3, and then manually analyze a sample set of bugs to label them in different categories. The results show that 29% of the bugs belong to the algorithm/method category, 22.33 % belong to the internal interface category, and 13.67 % of the bugs belong to the external interface category. We also report the relationship between bug categories and bug-fixing duration, the effort needed to fix the bugs, and bug impacts on files.
AB - Probabilistic programming systems allow developers to model random phenomena and perform reasoning about the model efficiently. As the number and adoption of probabilistic programming systems are growing significantly, the reliability of such systems is also becoming increasingly important. It is thus crucial to analyze existing bugs in similar systems to ensure the reliability of these systems. This paper conducts an empirical study to investigate bugs and their features on real probabilistic programming systems. We select three popular probabilistic programming projects on GitHub, namely Edward, Pyro, and PyMC3, and then manually analyze a sample set of bugs to label them in different categories. The results show that 29% of the bugs belong to the algorithm/method category, 22.33 % belong to the internal interface category, and 13.67 % of the bugs belong to the external interface category. We also report the relationship between bug categories and bug-fixing duration, the effort needed to fix the bugs, and bug impacts on files.
UR - http://www.scopus.com/inward/record.url?scp=85140910044&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85140910044&partnerID=8YFLogxK
U2 - 10.1109/QRS-C55045.2021.00055
DO - 10.1109/QRS-C55045.2021.00055
M3 - Conference contribution
AN - SCOPUS:85140910044
T3 - Proceedings - 2021 21st International Conference on Software Quality, Reliability and Security Companion, QRS-C 2021
SP - 319
EP - 325
BT - Proceedings - 2021 21st International Conference on Software Quality, Reliability and Security Companion, QRS-C 2021
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 6 December 2021 through 10 December 2021
ER -