THE COMPARATIVE EFFECTIVENESS OF IMAGES CLASSIFIERS IN THE COURSE OF RECOGNITION OF ZONES OF INTEREST DURING LAPAROSCOPIC INTERVENTION

Authors

  • N. R. Bayazitov Odessa National Medical University
  • D. N. Bayazitov Odessa National Medical University
  • A. B. Buzynovsky Odessa National Medical University
  • A. V. Lyashenko Odessa National Medical University
  • D. V. Novikov Odessa National Medical University
  • L. S. Godlevsky Odessa National Medical University

DOI:

https://doi.org/10.11603/mie.1996-1960.2020.2.11175

Keywords:

images analysis, machine learning, HAAR features,, AdaBoost classifier, laparoscopic surgery

Abstract

Background. The purpose of the study is to evaluate the effectiveness of the automatic computer diagnostic (ACD) systems developed on the basis of two classifiers — HAAR features cascade and AdaBoost for the detection of appendicitis and metastatic damages of the liver.

Materials and methods. For the classifiers training the images/frames, which have been cropped out from video gained in the course of laparoscopic diagnostics were used. Namely, RGB frames, and gamma-corrected RGB frames and converted into HSV have been explored. Also descriptors were extracted from images with the modified method of Local Binary Pattern (LBT), which includes data on color characteristics («modified color LBT» — MCLBT) and textural ones were used later on for AdaBoost classifier training. After cessation of training the tests were performed with the aim of the estimation of effectiveness of recognition. Test session images were different from those ones which have been used for training of the classifier.

Results. The highest recall for appendicitis diagnostics was achieved after training of AdaBoost with MCLBT descriptors extracted from RGB images—0,745, and in case for metastatic damages diagnostics — 0,902. Hence developed AdaBoost based CAD system achieved 74,4 % correct classification rate (accuracy) for appendicitisc and 89,3 % for metastatic images. The accuracy of HAAR features classifier was highest in case of metastatic foci identification and achieved 0,672 (RGB) — 0,723 (HSV) values.

Conclusions. Haar features based cascade classifier turned to be less effective when compared with AdaBoost classifier trained with MCLBT descriptors.

References

Lyashenko, A. V., Bayazitov, N. R., Godlevsky, L. S. et al. (2016). Informational-technical system for the automatized laparoscopic diagnostics. Radio Electronics, Computer Science, Control, 4, 90-6. [In Ukrainian].

Bayazitov, D. N., Kresyun, N. V., Buzmovsky, A. B. et al. (2017). The effectiveness of automatic laparoscopic diagnostics of liver pathology using different methods of digital images classification. Patologiya (Pathology), 14, № 2 (40), 182-7. DOI: https://doi.org/10.14739/2310-1237.2017.2.109219

Albisser Z. (2015). Computer-aided screening of capsule endoscopy videos. Master's Thesis, University of Oslo.

Hashimoto, D. A., Rosman, G., Rus, D., Meireles, O. R. (2018). Artificial Intelligence in Surgery: Promises and Perils. Ann.Surg., 268 (1), 70-6. doi: 10.1097I SLA.0000000000002693. DOI: https://doi.org/10.1097/SLA.0000000000002693

Bay, H., Tuytelaars, T., Van Gool, L. (2006). Surf: Speeded up robust features. Computer vision-ECCV, 3951, 404-17. DOI: https://doi.org/10.1007/11744023_32

Bouguet J. (2000). Pyramidal implementation of the Lucas-Kanade feature tracker: description of the algorithm, openCV documentation. Available on: http:II www.intel.comIresearchImrlIreserachIopencv.

Neofytou, M. S., Tanos, V., Constantinou, I. et al. (2015). Computer-aided diagnosis in hysteroscopic imaging. IEEE J Biomed Health Inform., 19 (3), 1129-36. DOI: https://doi.org/10.1109/JBHI.2014.2332760

Lahane, a., Yesha, Y., Grasso, M. et al. (2012). Detection

of unsafe action from laparoscopic cholecystectomy video. Proc. 2nd ACM SIGHIT International Health Informatics Symposium, 315-22.

Fatiev D. (2015). Faculty of Science and Technology Department of Computer Science Object tracking for improved telementoring and telestration. INF-3997 Master's Thesis in Telemedicine and E-health, The Arctic University of Norway.

Ledoux, A., Losson, O., Macaire, L. (2016). Color local binary patterns: compact descriptors for texture classification. Journal of Electronic Imaging, Society of Photo-optical Instrumentation Engineers, 25 (6), 061404. Available on: http://dx.doi.org/10.1117/1. JEI.25.6.061404.

Ojala, T., Pietikainen, M., Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 4 (7), 971-87. DOI: https://doi.org/10.1109/TPAMI.2002.1017623

Petscharnig, S., Schoffmann, K. (2018). Learning laparoscopic video shot classification for gynecological surgery. Multimed. Tools Appl, 77, 8061-79. DOI: https://doi.org/10.1007/s11042-017-4699-5

Zhou, M., Bao, G., Geng, Y. (2014). Polyp detection and radius measurement in small intestine using video capsule endoscopy. Proc 7th International Conference on Biomedical Engineering and Informatics (BMEI), 237-41. DOI: https://doi.org/10.1109/BMEI.2014.7002777

Shu, Y., Bilodeau, G. A., Cheriet, F. (2005). Segmentation of laparoscopic images: Integrating graph-based segmentation and multistage region merging. Proc 2nd Canadian Conference on Computer and Robot Vision (CRV'05), doi: 10.1109/ CRV. 2005.74.

Madad Zadeh, S., Francois, T., Calvet, L. et al. (2020). SurgAI: deep learning for computerized laparoscopic image understanding in gynaecology. Surg. Endosc. Available on: https://doi.org/10.1007/s00464-019-07330-8. DOI: https://doi.org/10.1007/s00464-019-07330-8

Viola, P., Jones M. (2001). Rapid object detection using a boosted cascade of simple features. Proc IEEE Computer Society Conference on Computer Vision and Pattern Recognition., 1, 511-518. DOI: https://doi.org/10.1109/CVPR.2001.990517

Parent, F., Mandal, K. K., Loranger, S. et al. (2016). 3D shape tracking of minimally invasive instruments using optical frequency domain reflectometry. Proc of SPIE, 9786. doi: 10.1117/12.2214998. DOI: https://doi.org/10.1117/12.2214998

Published

2020-07-13

How to Cite

Bayazitov, N. R., Bayazitov, D. N., Buzynovsky, A. B., Lyashenko, A. V. ., Novikov, D. V., & Godlevsky, L. S. (2020). THE COMPARATIVE EFFECTIVENESS OF IMAGES CLASSIFIERS IN THE COURSE OF RECOGNITION OF ZONES OF INTEREST DURING LAPAROSCOPIC INTERVENTION. Medical Informatics and Engineering, (2), 62–69. https://doi.org/10.11603/mie.1996-1960.2020.2.11175

Issue

Section

Articles