Multimodal deep learning from sputum image segmentation to classify Mycobacterium tuberculosis using IUATLD assessment
Nia Saurina, Nur Chamidah, Riries Rulaningtyas, Aryati Aryati
Abstract
Tuberculosis (TB) continues to be a major global health issue, especially in areas with limited resources where diagnostic tools are often insufficient. Traditional TB detection methods are slow and lack sensitivity, particularly for early-stage or low bacterial load cases. This study introduces a new multimodal deep learning model that integrates sputum image segmentation across RGB, hue, saturation, and value (HSV), and CIELAB color channels, using the YOLOv8 model for real-time detection and segmentation. The model uses the International Union Against Tuberculosis and Lung Disease (IUATLD) grading scale for accurate Mycobacterium tuberculosis (MTB) classification. Our approach shows high accuracy (92.24%) and precise forecasting (mean absolute percent error (MAPE) of 0.23%), greatly enhancing diagnostic speed and reliability. This research offers a novel method for classifying MTB using a multimodal deep learning model that integrates sputum image segmentation across RGB, HSV, and CIELAB color channels. By using the YOLOv8 model for real-time bounding box detection and segmentation, and the IUATLD grading scale for classification, our method achieves high accuracy and precision in identifying TB bacteria. Our findings indicate that this multimodal deep learning approach significantly improves diagnostic accuracy and speed, providing a reliable tool for early TB detection.
Keywords
Image segmentation; International Union Against Tuberculosis and Lung Disease; Multimodal deep learning; Sputum; Tuberculosis
DOI:
https://doi.org/10.11591/eei.v14i2.9250
Refbacks
There are currently no refbacks.
This work is licensed under a
Creative Commons Attribution-ShareAlike 4.0 International License .
<div class="statcounter"><a title="hit counter" href="http://statcounter.com/free-hit-counter/" target="_blank"><img class="statcounter" src="http://c.statcounter.com/10241695/0/5a758c6a/0/" alt="hit counter"></a></div>
Bulletin of EEI Stats
Bulletin of Electrical Engineering and Informatics (BEEI) ISSN: 2089-3191, e-ISSN: 2302-9285 This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU) .