THE COMPARATIVE EFFECTIVENESS OF IMAGES CLASSIFIERS IN THE COURSE OF RECOGNITION OF ZONES OF INTEREST DURING LAPAROSCOPIC INTERVENTION
DOI:
https://doi.org/10.11603/mie.1996-1960.2020.2.11175Keywords:
images analysis, machine learning, HAAR features,, AdaBoost classifier, laparoscopic surgeryAbstract
Background. The purpose of the study is to evaluate the effectiveness of the automatic computer diagnostic (ACD) systems developed on the basis of two classifiers — HAAR features cascade and AdaBoost for the detection of appendicitis and metastatic damages of the liver.
Materials and methods. For the classifiers training the images/frames, which have been cropped out from video gained in the course of laparoscopic diagnostics were used. Namely, RGB frames, and gamma-corrected RGB frames and converted into HSV have been explored. Also descriptors were extracted from images with the modified method of Local Binary Pattern (LBT), which includes data on color characteristics («modified color LBT» — MCLBT) and textural ones were used later on for AdaBoost classifier training. After cessation of training the tests were performed with the aim of the estimation of effectiveness of recognition. Test session images were different from those ones which have been used for training of the classifier.
Results. The highest recall for appendicitis diagnostics was achieved after training of AdaBoost with MCLBT descriptors extracted from RGB images—0,745, and in case for metastatic damages diagnostics — 0,902. Hence developed AdaBoost based CAD system achieved 74,4 % correct classification rate (accuracy) for appendicitisc and 89,3 % for metastatic images. The accuracy of HAAR features classifier was highest in case of metastatic foci identification and achieved 0,672 (RGB) — 0,723 (HSV) values.
Conclusions. Haar features based cascade classifier turned to be less effective when compared with AdaBoost classifier trained with MCLBT descriptors.
References
Lyashenko, A. V., Bayazitov, N. R., Godlevsky, L. S. et al. (2016). Informational-technical system for the automatized laparoscopic diagnostics. Radio Electronics, Computer Science, Control, 4, 90-6. [In Ukrainian].
Bayazitov, D. N., Kresyun, N. V., Buzmovsky, A. B. et al. (2017). The effectiveness of automatic laparoscopic diagnostics of liver pathology using different methods of digital images classification. Patologiya (Pathology), 14, № 2 (40), 182-7. DOI: https://doi.org/10.14739/2310-1237.2017.2.109219
Albisser Z. (2015). Computer-aided screening of capsule endoscopy videos. Master's Thesis, University of Oslo.
Hashimoto, D. A., Rosman, G., Rus, D., Meireles, O. R. (2018). Artificial Intelligence in Surgery: Promises and Perils. Ann.Surg., 268 (1), 70-6. doi: 10.1097I SLA.0000000000002693. DOI: https://doi.org/10.1097/SLA.0000000000002693
Bay, H., Tuytelaars, T., Van Gool, L. (2006). Surf: Speeded up robust features. Computer vision-ECCV, 3951, 404-17. DOI: https://doi.org/10.1007/11744023_32
Bouguet J. (2000). Pyramidal implementation of the Lucas-Kanade feature tracker: description of the algorithm, openCV documentation. Available on: http:II www.intel.comIresearchImrlIreserachIopencv.
Neofytou, M. S., Tanos, V., Constantinou, I. et al. (2015). Computer-aided diagnosis in hysteroscopic imaging. IEEE J Biomed Health Inform., 19 (3), 1129-36. DOI: https://doi.org/10.1109/JBHI.2014.2332760
Lahane, a., Yesha, Y., Grasso, M. et al. (2012). Detection
of unsafe action from laparoscopic cholecystectomy video. Proc. 2nd ACM SIGHIT International Health Informatics Symposium, 315-22.
Fatiev D. (2015). Faculty of Science and Technology Department of Computer Science Object tracking for improved telementoring and telestration. INF-3997 Master's Thesis in Telemedicine and E-health, The Arctic University of Norway.
Ledoux, A., Losson, O., Macaire, L. (2016). Color local binary patterns: compact descriptors for texture classification. Journal of Electronic Imaging, Society of Photo-optical Instrumentation Engineers, 25 (6), 061404. Available on: http://dx.doi.org/10.1117/1. JEI.25.6.061404.
Ojala, T., Pietikainen, M., Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 4 (7), 971-87. DOI: https://doi.org/10.1109/TPAMI.2002.1017623
Petscharnig, S., Schoffmann, K. (2018). Learning laparoscopic video shot classification for gynecological surgery. Multimed. Tools Appl, 77, 8061-79. DOI: https://doi.org/10.1007/s11042-017-4699-5
Zhou, M., Bao, G., Geng, Y. (2014). Polyp detection and radius measurement in small intestine using video capsule endoscopy. Proc 7th International Conference on Biomedical Engineering and Informatics (BMEI), 237-41. DOI: https://doi.org/10.1109/BMEI.2014.7002777
Shu, Y., Bilodeau, G. A., Cheriet, F. (2005). Segmentation of laparoscopic images: Integrating graph-based segmentation and multistage region merging. Proc 2nd Canadian Conference on Computer and Robot Vision (CRV'05), doi: 10.1109/ CRV. 2005.74.
Madad Zadeh, S., Francois, T., Calvet, L. et al. (2020). SurgAI: deep learning for computerized laparoscopic image understanding in gynaecology. Surg. Endosc. Available on: https://doi.org/10.1007/s00464-019-07330-8. DOI: https://doi.org/10.1007/s00464-019-07330-8
Viola, P., Jones M. (2001). Rapid object detection using a boosted cascade of simple features. Proc IEEE Computer Society Conference on Computer Vision and Pattern Recognition., 1, 511-518. DOI: https://doi.org/10.1109/CVPR.2001.990517
Parent, F., Mandal, K. K., Loranger, S. et al. (2016). 3D shape tracking of minimally invasive instruments using optical frequency domain reflectometry. Proc of SPIE, 9786. doi: 10.1117/12.2214998. DOI: https://doi.org/10.1117/12.2214998
Downloads
Published
How to Cite
Issue
Section
License
Journal Medical Informatics and Engineering allows the author(s) to hold the copyright without registration
The majority of Medical Informatics and Engineering Open Access journals publish open access articles under the terms of the Creative Commons Attribution (CC BY) License which permits use, distribution and reproduction in any medium, provided the original work is properly cited. The remaining journals offer a choice of licenses.
This journal is available through Creative Commons (CC) License CC-BY 4.0
