Wart treatment method selection using AdaBoost with random forests as a weak learner

Main Article Content

M. Azka Putra
Noor Akhmad Setiawan
Sunu Wibirama

Abstract

Selection of wart treatment method using machine learning is being a concern to researchers. Machine learning is expected to select the treatment of warts such as cryotherapy and immunotherapy to patients appropriately. In this study, the data used were cryotherapy and immunotherapy datasets. This study aims to improve the accuracy of wart treatment selection with machine learning. Previously, there are several algorithms have been proposed which were able to provide good accuracy in this case. However, the existing results still need improvement to achieve better level of accuracy so that treatment selection can satisfy the patients. The purpose of this study is to increase the accuracy by improving the performance of weak learner algorithm of ensemble machine learning. AdaBoost is used in this study as a strong learner and Random Forest (RF) is used as a weak learner. Furthermore, stratified 10-fold cross validation is used to evaluate the proposed algorithm. The experimental results show accuracy of 96.6% and 91.1% in cryotherapy and immunotherapy respectively.

Article Details

Section
Articles
Author Biographies

M. Azka Putra, Department of Electrical Engineering and Information Technology, University Gadjah Mada

M. Azka Putra graduated bachelor degree from Bina Nusantara University. Then he is studying to get master degree programs in Gadjah Mada University

Noor Akhmad Setiawan, Department of Electrical Engineering and Information Technology, University Gadjah Mada

Noor Akhmad Setiawan received his Bachelor and Master degree in Electrical Engineering from Universitas Gadjah Mada in 1998 and 2003 respectively. He received his PhD degree in Electrical and Electronics Engineering from Universiti Teknologi PETRONAS in 2009. He is with the Department of Electrical Engineering and Information Technology Universitas Gadjah Mada. His research interests are Soft Computing and Machine Learning.

Sunu Wibirama, Department of Electrical Engineering and Information Technology, University Gadjah Mada

Sunu Wibirama serves as faculty member in Department of Electrical Engineering and Information Technology, Faculty of Engineering, Universitas Gadjah Mada, Indonesia. His primary research area includes computer vision, eye-gaze tracking applications, human-computer interaction, and technology commercialization. He is also keen to work in usability testing, user experience (UX), and marketing research based on eye tracking analysis.

Dr. Sunu was appointed as a research associate under JICA and Erasmus Mundus fellowship, member of IEEE Engineering in Medicine and Biology Society (EMBS), IEEE Consumer Electronics, IEEE Biometrics Council, and IEEE Sensors Council. He is an Associate Editor in Indonesian Scholar Journal. In 2015, he served as Vice Head of Academic Affairs for Undergraduate Program in Department of Electrical Engineering and Information Technology, Faculty of Engineering, UGM. In 2017, he was appointed as a Senate Member of Faculty of Engineering, Universitas Gadjah Mada.

References

J. N. B. Bavinck, J. A. H. Eekhof and S. C. Bruggink, Treatments for common and plantar warts, BMJ Br. Med. J. 342 (2011) d3119.

S. K. Loo and W. Y. Tang, Warts (non-genital), BMJ Clin. Evid. 2009 (2009) 1710.

S. Garg and S. Baveja, Intralesional immunotherapy for difficult to treat warts with Mycobacterium w vaccine, J. Cutan. Aesthet. Surg. 7 (2014) 203.

M. D. Lynch, J. Cliffe, and R. Morris-Jones, “Management of cutaneous viral warts, BMJ, 348 (2014) g3339.

S. Cockayne, et .al, Cryotherapy versus salicylic acid for the treatment of plantar warts (verrucae): a randomised controlled trial, BMJ 342 (2011) d3271.

D. McGeorge, Rupture of tendons after cryotherapy for hand warts, BMJ Br. Med. J. 297 (1988) 1475.

M. El-Khalawany, D. Shaaban and S. Aboeldahab, Immunotherapy of viral warts: myth and reality, Egypt. J. Dermatology Venerol. 35 (2015) 1-13.

F. Khozeimeh, R. Alizadehsani, M. Roshanzamir, A. Khosravi, P. Layegh, and S. Nahavandi, An expert system for selecting wart treatment method, Comput. Biol. Med. 81 (2017) 167–175.

F. Khozeimeh et al., Intralesional immunotherapy compared to cryotherapy in the treatment of warts, Int. J. Dermatol. 56 (2017) 474–478.

R. A. M Teimoorian, F Khozeimeh and P Layegh, Intralesional immunotherapy with Candida antigen compared to cryotherapy in the treatment of warts, in American Academy of Dermatology Conference, 2016.

H. W. Nugroho, T. B. Adji and N. A. Setiawan, Random forest weighting based feature selection for c4.5 algorithm on wart treatment selection method, Int. J. Adv. Sci. Eng. Inf. Technol. 8 (2018) 1858-1863.

S. B. Akben, Predicting the success of wart treatment methods using decision tree based fuzzy informative images, Biocybern. Biomed. Eng. 38 (2018) 819–827.

Y. Freund and R. E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, J. Comput. Syst. Sci. 55 (1997) 119–139.

V. B. Vaghela, A. Ganatra and A. Thakkar, Boost a weak learner to a strong learner using ensemble system approach, in 2009 IEEE International Advance Computing Conference, IACC 2009, 2009, pp. 1432–1436.

L. Breiman, Random forest, Mach. Learn. 45 (2001) 5–32.

F. Khozeimeh, P. Layeghet, R. Alizadehsani and M. Roshanzamir, “Cryotherapy Dataset Data Set.” Internet: https://archive.ics.uci.edu/ml/datasets/Cryotherapy+Dataset+.

F. Khozeimeh, P. Layeghet, R. Alizadehsani and M. Roshanzamir, “Immunotherapy Dataset Data Set.” Internet: https://archive.ics.uci.edu/ml/datasets/Immunotherapy+Dataset.

A. Kraskov, H. Stögbauer and P. Grassberger, Estimating mutual information, Phys. Rev. E 69 (2004) 066138.

T. Huijskens, “Mutual information-based feature selection.” Internet: https://thuijskens.github.io/2017/10/07/feature-selection/.

G. Leshem and Y. Ritov, Traffic flow prediction using adaboost algorithm with random forests as a weak learner, Int. J. Math. Comput. Sci. 1 (2007) 193–198.

S. Bin and G. Sun, Data mining in census data with CART, in ICACTE 2010 - 2010 3rd International Conference on Advanced Computer Theory and Engineering, Proceedings vol 3, 2010.

R. A. Berk. Statistical Learning from a Regression Perspective - 2nd Edition, 2008, pp. 103-163.

A. W. Whitney, A direct method of nonparametric measurement selection, IEEE Trans. Comput. C–20 (1971) 1100–1103.

J. R. Vergara and P. A. Estévez, A review of feature selection methods based on mutual information, Neural Comput. Appl. 24 (2014) 175–186.

R. Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, Proc. 14th Int. Jt. Conf. Artif. Intell. - vol. 2, pp. 1137–1143, 1995.

W. J. Youden, Index for rating diagnostic tests, Cancer 3 (1950) 32–35.

F. Pedregosa, et. al, Scikit-learn: Machine learning in python, J. Mach. Learn. Res. 12 (2011) 2825-2830.