Deep object segmentation and classification networks for building damage detection using the xBD dataset

References

• Adam, Jibril Muhammad, Weiquan Liu, Yu Zang, Muhammad Kamran Afzal, Saifullahi Aminu Bello, Abdullahi Uwaisu Muhammad, Cheng Wang, and Jonathan Li. 2023. “Deep Learning-Based Semantic Segmentation of Urban-Scale 3D Meshes in Remote Sensing: A Survey.” International Journal of Applied Earth Observation and Geoinformation 121: 103365. https://doi.org/10.1016/j.jag.2023.103365.
   Web of Science ®Google Scholar
• Armesto-González, Julia, Belén Riveiro-Rodríguez, Diego González-Aguilera, and M Teresa Rivas-Brea. 2010. “Terrestrial Laser Scanning Intensity Data Applied to Damage Detection for Historical Buildings.” Journal of Archaeological Science 37 (12): 3037–3047. https://doi.org/10.1016/j.jas.2010.06.031
   Web of Science ®Google Scholar
• Balz, Timo, and Mingsheng Liao. 2010. “Building-Damage Detection Using Post-Seismic High-Resolution SAR Satellite Data.” International Journal of Remote Sensing 31 (13): 3369–3391. https://doi.org/10.1080/01431161003727671.
   Web of Science ®Google Scholar
• Bromley, J., I. Guyon, Y. Lecun, Eduard Sckinger, and R. Shah. 1993. “Signature Verification Using a Siamese Time Delay Neural Network.” Paper presented at the Advances in Neural Information Processing Systems 6, [7th NIPS Conference, Denver, Colorado, USA, 1993].
   Google Scholar
• Brunner, Dominik, Karsten Schulz, and Thorsten Brehm. 2011. “Building Damage Assessment in Decimeter Resolution SAR Imagery: A Future Perspective.” 2011 Joint Urban Remote Sensing Event 217–220. https://doi.org/10.1109/JURSE.2011.5764759.
   Google Scholar
• Chen, Yunpeng, Jianan Li, Huaxin Xiao, Xiaojie Jin, Shuicheng Yan, and Jiashi Feng. 2017. “Dual Path Networks.” Paper presented at the NIPS.
   Google Scholar
• Chen, T., Z. Lu, Y. Yang, Y. Zhang, B. Du, and A. Plaza. 2022. “A Siamese Network Based U-Net for Change Detection in High Resolution Remote Sensing Images.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15, 2357–2369. https://doi.org/10.1109/JSTARS.2022.3157648.
   Web of Science ®Google Scholar
• Chollet, François. 2016. “Xception: Deep Learning with Depthwise Separable Convolutions.” 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1800–1807, https://doi.org/10.48550/arXiv.1610.02357.
   Google Scholar
• Curtis, Andrew, and William F. Fagan. 2013. “Capturing Damage Assessment with a Spatial Video: An Example of a Building and Street-Scale Analysis of Tornado-Related Mortality in Joplin, Missouri, 2011.” Annals of the Association of American Geographers 103 (6): 1522–1538. https://doi.org/10.1080/00045608.2013.784098.
   Web of Science ®Google Scholar
• Dell'Acqua, F, and P Gamba. 2012. “Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives.” Proceedings of the IEEE 100 (10): 2876–2890. https://doi.org/10.1109/JPROC.2012.2196404
   Web of Science ®Google Scholar
• Deng, Liwei, and Yue Wang. 2022. “Post-disaster Building Damage Assessment Based on Improved U-Net.” Scientific Reports 12 (1): 15862. https://doi.org/10.1038/s41598-022-20114-w.
   PubMed Web of Science ®Google Scholar
• Du, Shouji, Shihong Du, Bo Liu, and Xiuyuan Zhang. 2021. “Incorporating DeepLabv3+ and Object-Based Image Analysis for Semantic Segmentation of Very High Resolution Remote Sensing Images.” International Journal of Digital Earth 14 (3): 357–378. https://doi.org/10.1080/17538947.2020.1831087.
   Web of Science ®Google Scholar
• Durnov. 2023. “xView2_first_place: 1st Place Solution for ‘xView2: Assess Building Damage’ Challenge.” Accessed June 26. https://github.com/DIUx-xView/xView2_first_place.
   Google Scholar
• Eguchi, Ronald T., Charles K. Huyck, Shubharoop Ghosh, Beverley J. Adams, and Anneley McMillan. 2010. “Utilizing New Technologies in Managing Hazards and Disasters.” In Geospatial Techniques in Urban Hazard and Disaster Analysis, edited by Pamela S. Showalter and Yongmei Lu, 295–323. Dordrecht: Springer Netherlands.
   Google Scholar
• Fan, Yida, Qi Wen, Wei Wang, Ping Wang, Lingling Li, and Peng Zhang. 2017. “Quantifying Disaster Physical Damage Using Remote Sensing Data—A Technical Work Flow and Case Study of the 2014 Ludian Earthquake in China.” International Journal of Disaster Risk Science 8 (04): 471–488. https://doi.org/10.1007/s13753-017-0143-8.
   Google Scholar
• Feng, Gao, Chu Boce, and Shuai Tong. 2019. “Detection of Farmland Changes Using Deep Learning Techniques.” Radio Engineering 49 (7): 4. https://doi.org/10.3969/j.issn.1003-3106.2019.07.004.
   Google Scholar
• Galanis, Marios, Krishna Rao, Xinle Yao, Yi-Lin Tsai, Jonathan Ventura, and G. Andrew Fricker. 2021. “DamageMap: A Post-Wildfire Damaged Buildings Classifier.” International Journal of Disaster Risk Reduction 65: 102540. https://doi.org/10.1016/j.ijdrr.2021.102540.
   Web of Science ®Google Scholar
• Gamanya, R., P. D. Maeyer, and M. D. Dapper. 2009. “Object-oriented Change Detection for the City of Harare, Zimbabwe.” Expert Systems with Applications 36 (1): 571–588. https://doi.org/10.1016/j.eswa.2007.09.067.
   Web of Science ®Google Scholar
• Ghaffarian, S., N. Kerle, and T. Filatova. 2018. “Remote Sensing-Based Proxies for Urban Disaster Risk Management and Resilience: A Review.” Remote Sensing 10 (11). https://doi.org/10.3390/rs10111760.
   Web of Science ®Google Scholar
• Gupta, Ritwik, Bryce Goodman, Nirav N. Patel, Richard Hosfelt, Sandra Sajeev, Eric T. Heim, Jigar Doshi, Keane Lucas, Howie Choset, and Matthew E. Gaston. 2019. “Creating xBD: A Dataset for Assessing Building Damage from Satellite Imagery.” Paper presented at the CVPR Workshops.
   Google Scholar
• Gupta, Ritwik, Richard Hosfelt, Sandra Sajeev, Nirav Patel, Bryce Goodman, Jigar Doshi, Eric Heim, Howie Choset, and Matthew Gaston. 2019. “xbd: A Dataset for Assessing Building Damage from Satellite Imagery.” arXiv preprint arXiv:1911.09296. https://doi.org/10.48550/arXiv.1911.09296.
   Google Scholar
• Gupta, R., and M. Shah. 2021. “RescueNet: Joint Building Segmentation and Damage Assessment from Satellite Imagery.” Paper presented at the 2020 25th International Conference on Pattern Recognition (ICPR), 10–15 January 2021.
   Google Scholar
• Haigang, Sui, Liu Chaoxian, Huang Lihong, and Hua Li. 2019. “Application of Remote Sensing Technology in Earthquake-Induced Building Damage Detection.” Geomatics and Information Science of Wuhan University 44 (07): 1008–1019. https://doi.org/10.13203/j.whugis20190070.
   Google Scholar
• Haoguo, Du, Zhang Fanghao, Lu Yongkun, and Lin Xuchuan. 2021. “Recognition of the Earthquake Damage to Buildings in the 2021 Yangbi,Yunnan MS6.4 Earthquake Area Based on Multi-source Remote Sensing Images.” Journal of Seismological Research 44 (03): 490–498. https://doi.org/10.3969/j.issn.1000-0666.2021.03.022.
   Google Scholar
• He, Kaiming, X. Zhang, Shaoqing Ren, and Jian Sun. 2015a. “Deep Residual Learning for Image Recognition.” Paper presented at the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
   Google Scholar
• He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015b. “Delving Deep Into Rectifiers: Surpassing Human-Level Performance on Imagenet Classification.” Paper presented at the Proceedings of the IEEE International Conference on Computer Vision.
   Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” Paper presented at the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27–30 June 2016.
   Google Scholar
• Hedjam, R., A. Abdesselam, and F. Melgani. 2019. “Change Detection from Unlabeled Remote Sensing Images Using Siamese ANN.” Paper presented at the IEEE IGARSS'19. 28 July–August 2, 2019. Yokohama, Japan.
   Google Scholar
• Huang, Tongyuan, Jiangxia Chen, and Linfeng Jiang. 2022. “DS-UNeXt: Depthwise Separable Convolution Network with Large Convolutional Kernel for Medical Image Segmentation.” Signal, Image and Video Processing, 1–9. https://doi.org/10.1007/s11760-022-02388-9.
   Web of Science ®Google Scholar
• Hussain, Masroor, Dongmei Chen, Angela Cheng, Hui Wei, and David Stanley. 2013. “Change Detection from Remotely Sensed Images: From Pixel-Based to Object-Based Approaches.” ISPRS Journal of Photogrammetry and Remote Sensing 80: 91–106. https://doi.org/10.1016/j.isprsjprs.2013.03.006.
   Web of Science ®Google Scholar
• Jamali, Ali, Swalpa Kumar Roy, and Pedram Ghamisi. 2023a. “WetMapFormer: A Unified Deep CNN and Vision Transformer for Complex Wetland Mapping.” International Journal of Applied Earth Observation and Geoinformation 120: 103333. https://doi.org/10.1016/j.jag.2023.103333.
   Web of Science ®Google Scholar
• Jamali, Ali, Swalpa Kumar Roy, Jonathan Li, and Pedram Ghamisi. 2023b. “TransU-Net++: Rethinking Attention Gated TransU-Net for Deforestation Mapping.” International Journal of Applied Earth Observation and Geoinformation 120: 103332. https://doi.org/10.1016/j.jag.2023.103332.
   Web of Science ®Google Scholar
• Jie, H., S. Li, S. Gang, and S. Albanie. 2018. “Squeeze-and-Excitation Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 99: 7132–7141. https://doi.org/10.48550/arXiv.1709.01507.
   Google Scholar
• Khoshelham, Kourosh, Sander Oude Elberink, and Sudan Xu. 2013. “Segment-based Classification of Damaged Building Roofs in Aerial Laser Scanning Data.” IEEE Geoscience and Remote Sensing Letters 10 (5): 1258–1262. https://doi.org/10.1109/LGRS.2013.2257676.
   Web of Science ®Google Scholar
• Lin, Qigen, Tianyu Ci, Leibin Wang, Sanjit Kumar Mondal, Huaxiang Yin, and Ying Wang. 2022. “Transfer Learning for Improving Seismic Building Damage Assessment.” Remote Sensing 14 (1): 201. https://doi.org/10.3390/rs14010201.
   Web of Science ®Google Scholar
• Liu, R., D. Jiang, L. Zhang, and Z. Zhang. 2020. “Deep Depthwise Separable Convolutional Network for Change Detection in Optical Aerial Images.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13: 1109–1118. https://doi.org/10.1109/JSTARS.2020.2974276.
   Web of Science ®Google Scholar
• Miller, O., A. Pikaz, and A. Averbuch. 2005. “Objects Based Change Detection in a Pair of Gray-Level Images.” Pattern Recognition 38 (11): 1976–1992. https://doi.org/10.1016/j.patcog.2004.07.010.
   Web of Science ®Google Scholar
• Nan, Fangzhe, Qingliang Zeng, Yanni Xing, and Yurong Qian. 2020. “Single Image Super-Resolution Reconstruction Based on the ResNeXt Network.” Multimedia Tools and Applications 7. https://doi.org/10.1007/s11042-020-09053-8.
   Google Scholar
• Rahnemoonfar, M., T. Chowdhury, A. Sarkar, D. Varshney, M. Yari, and R. R. Murphy. 2021. “FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understanding.” IEEE Access 9: 89644–89654. https://doi.org/10.1109/ACCESS.2021.3090981.
   Web of Science ®Google Scholar
• Ren, Miao, Xianfeng Zhang, Xiao Chen, Bo Zhou, and Ziyuan Feng. 2023. “YOLOv5s-M: A Deep Learning Network Model for Road Pavement Damage Detection from Urban Street-View Imagery.” International Journal of Applied Earth Observation and Geoinformation 120: 103335. https://doi.org/10.1016/j.jag.2023.103335.
   Web of Science ®Google Scholar
• Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” ArXiv abs/1505.04597. https://doi.org/10.1007/978-3-319-24574-4_28.
   Google Scholar
• Roy, M., S. Ghosh, and A. Ghosh. 2014. “A Novel Approach for Change Detection of Remotely Sensed Images Using Semi-Supervised Multiple Classifier System.” Information Sciences. https://doi.org/10.1016/j.ins.2014.01.037.
   Web of Science ®Google Scholar
• Sugiyama, Mitgt, and Hitoshi Saji Keiichi Abe. 2002. “Detection of Earthquake Damaged Areas from Aerial Photographs by Using Color and Edge Information.” Paper presented at the Proceedings of the 5th Asian Conference on Computer Vision, Melbourne, Australia.
   Google Scholar
• Vetrivel, Anand, Markus Gerke, and Norman Kerle. 2018. “Disaster Damage Detection Through Synergistic use of Deep Learning and 3D Point Cloud Features Derived from Very High Resolution Oblique Aerial Images, and Multiple-Kernel-Learning.” ISPRS Journal of Photogrammetry and Remote Sensing 140: 45–59. https://doi.org/10.1016/j.isprsjprs.2017.03.001.
   Web of Science ®Google Scholar
• Viana, C. M., S. Oliveira, S. C. Oliveira, and J. Rocha. 2019. “Land Use/Land Cover Change Detection and Urban Sprawl Analysis.” Spatial Modeling in GIS and R for Earth and Environmental Sciences, 621–651. https://doi.org/10.1016/B978-0-12-815226-3.00029-6.
   Google Scholar
• Vu, Tuong Thuy, Masashi Matsuoka, and Fumio Yamazaki. 2005. “Detection and Animation of Damage Using Very High-Resolution Satellite Data Following the 2003 Bam, Iran, Earthquake.” Earthquake Spectra 21 (1_suppl): 319–327. https://doi.org/10.1193/1.2101127.
   Google Scholar
• Wan, L., Y. Xiang, and H. You. 2019. “A Post-Classification Comparison Method for SAR and Optical Images Change Detection.” IEEE Geoscience and Remote Sensing Letters 16 (7): 1026–1030. https://doi.org/10.1109/LGRS.2019.2892432
   Web of Science ®Google Scholar
• Wang, Q., B. Wu, P. Zhu, P. Li, and Q. Hu. 2020. “ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks.” Paper presented at the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
   Google Scholar
• Website, National Disaster Reduction. 2022. “The Ministry of Emergency Management Released the Basic Situation of Natural Disasters Nationwide in 2022.” National Disaster Reduction Website. https://www.mem.gov.cn/xw/yjglbgzdt/202301/t20230113_440478.shtml.
   Google Scholar
• Wei, Lin. 2022. “Building Earthquake Damage Detection Based on High-Resolution Remote Sensing Image.” Geospatial Information 20 (03): 68–71+116.
   Google Scholar
• Wu, P., Z. Cui, Z. Gan, and F. Liu. 2020. “Three-Dimensional ResNeXt Network Using Feature Fusion and Label Smoothing for Hyperspectral Image Classification.” Sensors (Basel, Switzerland) 20 (6). https://doi.org/10.3390/s20061652.
   Web of Science ®Google Scholar
• Xie, Saining, Ross B. Girshick, Piotr Dollár, Zhuowen Tu, and Kaiming He. 2017. “Aggregated Residual Transformations for Deep Neural Networks.” Paper presented at the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
   Google Scholar
• Xu, X., Z. Chen, and F. Yin. 2021. “Monocular Depth Estimation with Multi-Scale Feature Fusion.” IEEE Signal Processing Letters, 28, 678–682. https://doi.org/10.1109/LSP.2021.3067498.
   Web of Science ®Google Scholar
• Xu, S., and H. Y. Noh. 2021. “PhyMDAN: Physics-Informed Knowledge Transfer Between Buildings for Seismic Damage Diagnosis Through Adversarial Learning.” Mechanical Systems and Signal Processing 151: 107374. https://doi.org/10.1016/j.ymssp.2020.107374.
   Web of Science ®Google Scholar
• Xu, Xiaowo, Xiaoling Zhang, and Tianwen Zhang. 2022. “Lite-YOLOv5: A Lightweight Deep Learning Detector for On-Board Ship Detection in Large-Scene Sentinel-1 SAR Images.” Remote Sensing 14 (4): 1018. https://doi.org/10.3390/rs14041018.
   Web of Science ®Google Scholar
• Yang, Xue, Xiang Fan, Mingjun Peng, Qingfeng Guan, and Luliang Tang. 2022. “Semantic Segmentation for Remote Sensing Images Based on an AD-HRNet Model.” International Journal of Digital Earth 15 (1): 2376–2399. https://doi.org/10.1080/17538947.2022.2159080
   Web of Science ®Google Scholar
• Yankai, Du, Gong Lixia, Li Qiang, and Zhang Jingfa. 2020. “Earthquake Damage Building Identification Technology Based on High Resolution Remote Sensing Image with Optimal Segmentation.” Acta Seismologica Sinica. 2020 (06): 760–768. https://doi.org/10.11939/jass.20200027.
   Google Scholar
• Zhai, Huiqin, and Lei Rong. 2008. “Analysis of Automatic Information Abstraction from High Spatial Resolution RS Image.” Geomatics Technology and Equipment (3): 24–26.
   Google Scholar
• Zhang, Tianwen, and Xiaoling Zhang. 2021. “Squeeze-and-excitation Laplacian Pyramid Network with Dual-Polarization Feature Fusion for Ship Classification in sar Images.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. https://doi.org/10.1109/LGRS.2021.3119875.
   Web of Science ®Google Scholar
• Zhang, Tianwen, and Xiaoling Zhang. 2022. “A Full-Level Context Squeeze-and-Excitation ROI Extractor for SAR Ship Instance Segmentation.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. https://doi.org/10.1109/LGRS.2022.3166387.
   Web of Science ®Google Scholar
• Zhang, Tianwen, Xiaoling Zhang, Jun Shi, and Shunjun Wei. 2020. “HyperLi-Net: A Hyper-Light Deep Learning Network for High-Accurate and High-Speed Ship Detection from Synthetic Aperture Radar Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 167: 123–153. https://doi.org/10.1016/j.isprsjprs.2020.05.016.
   Web of Science ®Google Scholar