Transformers for aerial images semantic segmentation of natural disaster-impacted areas in natural disaster assessment

Deny Wiria Nugraha, Amil Ahmad Ilham, Andani Achmad, Ardiaty Arief

Abstract


Aerial image segmentation of natural disaster-impacted areas and detailed and automatic natural disaster assessment are the main focus of this study. Detecting and recognizing objects on aerial images of areas impacted by natural disasters and assessing natural disaster-impacted areas are still difficult problems. To solve these problems, this study utilizes four of the latest transformer-based semantic segmentation network models, bidirectional encoder representation from image transformers (BEIT), dense prediction transformer (DPT), OneFormer, and SegFormer, and proposes a detailed and automatic natural disaster assessment of the segmented image. The SegFormer model achieved the first-best result, and the OneFormer model achieved the second-best result. The SegFormer model outperformed OneFormer by 1.58% higher for the mean accuracy value and 4.28% for the mean intersection over union (mIoU) value. All receiver operating characteristics (ROC) curves have mean area under curve (AUC) values above 0.9, which means that the SegFormer model performs well in generating semantic segmentation images. The fuzzy c-means (FCM) clustering algorithm performed well and could automatically cluster the natural disaster assessments into four categories. This study has produced semantic segmentation of aerial images of areas impacted by natural disasters and natural disaster assessments, which can be used in natural disaster management systems.

Keywords


Aerial image; Natural disaster; Natural disaster assessment; Semantic segmentation; Transformer

Full Text:

PDF


DOI: https://doi.org/10.11591/eei.v14i2.8454

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Bulletin of EEI Stats

Bulletin of Electrical Engineering and Informatics (BEEI)
ISSN: 2089-3191, e-ISSN: 2302-9285
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).