Pavement crack detection through a deep-learned asymmetric encoder-decoder convolutional neural network

References

• Abdou, M.A, 2022. Literature review: efficient deep neural networks techniques for medical image analysis. Neural Computing and Applications, 34 (8), 5791–5812.
   Web of Science ®Google Scholar
• Agarap, A.F, 2018. Deep learning using rectified linear units (ReLU). arXiv preprint arXiv:1803.08375.
   Google Scholar
• Ai, D., et al., 2023. Computer vision framework for crack detection of civil infrastructure – a review. Engineering Applications of Artificial Intelligence, 117, 105478.
   Web of Science ®Google Scholar
• Akagic, A., et al., 2018. Pavement crack detection using Otsu thresholding for image segmentation. In: 2018 41st international convention on information and communication technology, electronics and microelectronics (MIPRO). 1092–1097.
   Google Scholar
• Ali, R., et al., 2021. Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures. Automation in Construction, 130, 103831.
   Web of Science ®Google Scholar
• Asadi Shamsabadi, E., et al., 2022. Vision transformer-based autonomous crack detection on asphalt and concrete surfaces. Automation in Construction, 140, 104316.
   Web of Science ®Google Scholar
• Badrinarayanan, V., Kendall, A., and Cipolla, R., 2017. Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (12), 2481–2495.
   PubMed Web of Science ®Google Scholar
• Biau, G., and Scornet, E, 2016. A random forest guided tour. TEST, 25 (2), 197–227.
   Web of Science ®Google Scholar
• Bisong, E., and Bisong, E, 2019. Google colaboratory. In: Building machine learning and deep learning models on google cloud platform: a comprehensive guide for beginners. Berkeley, CA: Apress, 59–64. https://link.springer.com/book/10.1007/978-1-4842-4470-8#bibliographic-information.
   Google Scholar
• Caldeira, B., et al., 2019. Studying the construction of floor mosaics in the roman villa of pisões (Portugal) using noninvasive methods: high-resolution 3D GPR and photogrammetry. Remote Sensing, 11 (16), 1882.
   Web of Science ®Google Scholar
• Cao, C., et al., 2022. Refined landslide susceptibility analysis based on InSAR technology and UAV multi-source data. Journal of Cleaner Production, 368, 133146.
   Web of Science ®Google Scholar
• Cha, Y., Choi, W., and Büyüköztürk, O, 2017. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 32 (5), 361–378.
   Web of Science ®Google Scholar
• Cheng, J., et al., 2018. Pixel-level crack detection using U-Net. In: TENCON 2018 – 2018 IEEE region 10 conference. 0462–0466.
   Google Scholar
• Chicho, B.T., and Sallow, A.B, 2021. A comprehensive survey of deep learning models based on Keras framework. Journal of Soft Computing and Data Mining, 2 (2), 49–62.
   Google Scholar
• Chlap, P., et al., 2021. A review of medical image data augmentation techniques for deep learning applications. Journal of Medical Imaging and Radiation Oncology, 65 (5), 545–563.
   PubMed Web of Science ®Google Scholar
• Choi, W., and Cha, Y.-J, 2019. SDDNet: real-time crack segmentation. IEEE Transactions on Industrial Electronics, 67, 1–1.
   Web of Science ®Google Scholar
• Congress, S.S.C., and Puppala, A.J, 2020. Evaluation of UAV–CRP data for monitoring transportation infrastructure constructed over expansive soils. Indian Geotechnical Journal, 50 (2), 159–171.
   Web of Science ®Google Scholar
• Cubero-Fernandez, A., et al., 2017. Efficient pavement crack detection and classification. EURASIP Journal on Image and Video Processing, 2017, 1–11.
   Google Scholar
• Deng, J., et al., 2022. Review on computer vision-based crack detection and quantification methodologies for civil structures. Construction and Building Materials, 356, 129238.
   Web of Science ®Google Scholar
• Dilek, E., and Dener, M, 2023. Computer vision applications in intelligent transportation systems: a survey. Sensors, 23, 2938.
   PubMed Web of Science ®Google Scholar
• Ersoz, A.B., Pekcan, O., and Teke, T., 2017. Crack identification for rigid pavements using unmanned aerial vehicles. In: Presented at the IOP conference series: materials science and engineering, IOP Publishing, 012101.
   Google Scholar
• Fakhri, S.A., et al., 2022. Evaluation of UAV photogrammetric capability in road pavement cracks detection. Amirkabir Journal of Civil Engineering, 54 (5), 1705–1730.
   Google Scholar
• Fakhri, S.A., et al., 2023. Comparison of UAV image spatial resolution based on the siemens star target. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, X-4/W1-2022, 143–150.
   Google Scholar
• Fakhri, S.A., and Shah-Hosseini, R, 2022. Improved road detection algorithm based on fusion of deep convolutional neural networks and random forest classifier on VHR remotely-sensed images. Journal of the Indian Society of Remote Sensing, 50 (8), 1409–1421.
   Web of Science ®Google Scholar
• Francis, A., Sidiropoulos, P., and Muller, J.-P, 2019. CloudFCN: accurate and robust cloud detection for satellite imagery with deep learning. Remote Sensing, 11, 19.
   Web of Science ®Google Scholar
• Glasbey, C.A, 1993. An analysis of histogram-based thresholding algorithms. CVGIP: Graphical Models and Image Processing, 55 (6), 532–537.
   Google Scholar
• Glorot, Xavier, and Bengio, Yoshua, 2010. Understanding the difficulty of training deep feed forward neural networks. In: Yee Whye Teh and Mike Titterington, eds. Proceedings of the thirteenth international conference on artificial intelligence and statistics. Sardinia: PMLR, 249–256.
   Google Scholar
• Guo, J., et al., 2021. CDnetv2: CNN-based cloud detection for remote sensing imagery With cloud-snow coexistence. IEEE Transactions on Geoscience and Remote Sensing, 59 (1), 700–713.
   Web of Science ®Google Scholar
• Han, X.-L., et al., 2022. Deep learning based approach for the instance segmentation of clayey soil desiccation cracks. Computers and Geotechnics, 146, 104733.
   Web of Science ®Google Scholar
• Hoang, N.-D., and Nguyen, Q.-L, 2019. A novel method for asphalt pavement crack classification based on image processing and machine learning. Engineering with Computers, 35 (2), 487–498.
   Web of Science ®Google Scholar
• Ioffe, Sergey, and Szegedy, Christian, 2015. Batch normalization: accelerating deep network training by reducing internal Covariate Shift. In: Francis Bach and David Blei, eds. Proceedings of the 32nd international conference on machine learning. Lille France: PMLR, 448–456.
   Google Scholar
• Ji, J., et al., 2018. Automated pixel-level surface crack detection using U-Net. In: Presented at the multi-disciplinary trends in artificial intelligence: 12th international conference, MIWAI 2018, Hanoi, Vietnam, November 18–20, 2018, Proceedings 12, Springer, 69–78.
   Google Scholar
• Ji, A., et al., 2020. An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement. Automation in Construction, 114, 103176.
   Web of Science ®Google Scholar
• Kang, D., and Cha, Y.-J, 2018. Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging. Computer-Aided Civil and Infrastructure Engineering, 33 (10), 885–902.
   Web of Science ®Google Scholar
• Kang, D.H., and Cha, Y.-J, 2022. Efficient attention-based deep encoder and decoder for automatic crack segmentation. Structural Health Monitoring, 21 (5), 2190–2205.
   PubMed Web of Science ®Google Scholar
• Kao, S.-P., Chang, Y.-C., and Wang, F.-L, 2023. Combining the YOLOv4 deep learning model with UAV imagery processing technology in the extraction and quantization of cracks in bridges. Sensors, 23, 5.
   Web of Science ®Google Scholar
• Kaul, A., et al., 2005. An epidemiological study of fatal road traffic accidents in Allahabad region. Indian Congress of Forensic Medicine & Toxicology.
   Google Scholar
• Khan, A., et al., 2020. A survey of the recent architectures of deep convolutional neural networks. Artificial Intelligence Review, 53 (8), 5455–5516.
   Web of Science ®Google Scholar
• Kheradmandi, N., and Mehranfar, V, 2022. A critical review and comparative study on image segmentation-based techniques for pavement crack detection. Construction and Building Materials, 321, 126162.
   Web of Science ®Google Scholar
• Khoshboresh-Masouleh, M., and Shah-Hosseini, R, 2020. A deep learning method for near-real-time cloud and cloud shadow segmentation from gaofen-1 images. Computational Intelligence and Neuroscience, 2020, 1.
   Web of Science ®Google Scholar
• Kim, B., and Cho, S, 2018. Automated vision-based detection of cracks on concrete surfaces using a deep learning technique. Sensors, 18, 10.
   Web of Science ®Google Scholar
• Kolappan Geetha, G., Yang, H.-J., and Sim, S.-H., 2023. Fast detection of missing thin propagating cracks during deep-learning-based concrete crack/non-crack classification. Sensors, 23, 1419.
   PubMedGoogle Scholar
• Kouretas, I., and Paliouras, V., 2019. Simplified hardware implementation of the softmax activation function. In: 2019 8th international conference on modern circuits and systems technologies (MOCAST). 1–4.
   Google Scholar
• Krizhevsky, A., Sutskever, I., and Hinton, G.E, 2017. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60 (6), 84–90.
   Web of Science ®Google Scholar
• Lagaros, N.D, 2023. Artificial neural networks applied in civil engineering. Applied Sciences, 13, 1131.
   Google Scholar
• Lee, Jin-Hwan, et al., 2018. Diagnosis of crack damage on structures based on image processing techniques and R-CNN using unmanned aerial vehicle (UAV). In: Presented at the Proc.SPIE, 1059811.
   Google Scholar
• Leshno, M., et al., 1993. Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Networks, 6 (6), 861–867.
   Web of Science ®Google Scholar
• Lewis, J., Cha, Y.-J., and Kim, J, 2023. Dual encoder–decoder-based deep polyp segmentation network for colonoscopy images. Scientific Reports, 13 (1), 1183.
   PubMed Web of Science ®Google Scholar
• Li, H., et al., 2022. A review of deep learning methods for pixel-level crack detection. Journal of Traffic and Transportation Engineering (English Edition), 9 (6), 945–968.
   Google Scholar
• Liu, Z., et al., 2019. Computer vision-based concrete crack detection using U-Net fully convolutional networks. Automation in Construction, 104, 129–139.
   Web of Science ®Google Scholar
• Liu, Y., et al., 2019. Deepcrack: a deep hierarchical feature learning architecture for crack segmentation. Neurocomputing, 338, 139–153.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2023. Automatic pixel-level detection of vertical cracks in asphalt pavement based on GPR investigation and improved mask R-CNN. Automation in Construction, 146, 104689.
   Web of Science ®Google Scholar
• Liu, K., Han, X., and Chen, B. M., 2019. Deep learning based automatic crack detection and segmentation for unmanned aerial vehicle inspections. In: 2019 IEEE international conference on robotics and biomimetics (ROBIO). 381–387.
   Google Scholar
• Lu, S., et al., 2022. An asymmetric encoder–decoder model for Zn-ion battery lifetime prediction. In: 2022 7th international conference on green energy technologies, 8, 33–50.
   Google Scholar
• Maini, R., and Aggarwal, H, 2009. Study and comparison of various image edge detection techniques. International Journal of Image Processing (IJIP), 3 (1), 1–11.
   Web of Science ®Google Scholar
• Nappo, N., et al., 2021. Use of UAV-based photogrammetry products for semi-automatic detection and classification of asphalt road damage in landslide-affected areas. Engineering Geology, 294, 106363.
   Web of Science ®Google Scholar
• Nash, W., Drummond, T., and Birbilis, N, 2018. A review of deep learning in the study of materials degradation. NPJ Materials Degradation, 2 (1), 37.
   Google Scholar
• Noh, H., Hong, S., and Han, B, 2015. Learning deconvolution network for semantic segmentation. In: Presented at the proceedings of the IEEE international conference on computer vision, 1520–1528.
   Google Scholar
• Oreto, C., et al., 2023. Leveraging infrastructure BIM for life-cycle-based sustainable road pavement management. Materials, 16 (3), 1047.
   PubMed Web of Science ®Google Scholar
• Pan, Y., et al., 2017. Object-based and supervised detection of potholes and cracks from the pavement images acquired by UAV. International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences, 42.
   Google Scholar
• Pan, Y., et al., 2018. Detection of asphalt pavement potholes and cracks based on the unmanned aerial vehicle multispectral imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11 (10), 3701–3712.
   Web of Science ®Google Scholar
• Pan, Y., et al., 2021. Monitoring asphalt pavement aging and damage conditions from low-altitude UAV imagery based on a CNN approach. Canadian Journal of Remote Sensing, 47 (3), 432–449.
   Web of Science ®Google Scholar
• Panagiotopoulou, A., et al., 2023. Super-resolution techniques in photogrammetric 3D reconstruction from close-range UAV imagery. Heritage, 6 (3), 2701–2715.
   Google Scholar
• Pandzić, M., et al., 2016. Assessment of the geometric quality of sentinel-2 data. presented at the XXIII ISPRS congress, commission I. International Society for Photogrammetry and Remote Sensing, XLI-B1, 489–494.
   Google Scholar
• Peng, C., et al., 2020. A triple-thresholds pavement crack detection method leveraging random structured forest. Construction and Building Materials, 263, 120080.
   Web of Science ®Google Scholar
• Qiao, W., et al., 2021. Automatic pixel-level pavement crack recognition using a deep feature aggregation segmentation network with a scSE attention mechanism module. Sensors, 21, 9.
   Web of Science ®Google Scholar
• Quach, M., et al., 2021. A deep perceptual metric for 3D point clouds. arXiv preprint arXiv:2102.12839. https://arxiv.org/abs/2102.12839.
   Google Scholar
• Rajadurai, R.-S., and Kang, S.-T, 2021. Automated vision-based crack detection on concrete surfaces using deep learning. Applied Sciences, 11, 11.
   Google Scholar
• Ronneberger, O., Fischer, P., and Brox, T, 2015. U-Net: convolutional networks for biomedical image segmentation. In: Presented at the medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, Springer, 234–241.
   Google Scholar
• Santillan, J.R., Gesta, J.L.E., and Marcial, M.C.N, 2023. Effects of flight plan parameters on the quality and usability of low-cost UAS photogrammetry data products for tree crown delineation. In: K. Jain, V. Mishra, and B. Pradhan, eds. Proceedings of UASG 2021: wings 4 sustainability, Cham: Springer International Publishing, 243–266.
   Google Scholar
• Shi, Y., et al., 2016. Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems, 17 (12), 3434–3445.
   Web of Science ®Google Scholar
• Shi, Y., Guo, S., and Sun, P, 2017. The role of infrastructure in China’s regional economic growth. Journal of Asian Economics, 49, 26–41.
   Web of Science ®Google Scholar
• Shorten, C., and Khoshgoftaar, T.M, 2019. A survey on image data augmentation for deep learning. Journal of Big Data, 6 (1), 60.
   Google Scholar
• Shrivakshan, G., and Chandrasekar, C, 2012. A comparison of various edge detection techniques used in image processing. International Journal of Computer Science Issues (IJCSI), 9 (5), 269.
   Google Scholar
• Silva, L.A., et al., 2020. An architectural multi-agent system for a pavement monitoring system with pothole recognition in UAV images. Sensors, 20, 21.
   Web of Science ®Google Scholar
• Song, W., et al., 2020. Automated pavement crack damage detection using deep multiscale convolutional features. Journal of Advanced Transportation, 2020, 1.
   Web of Science ®Google Scholar
• Sony, S., et al., 2021. A systematic review of convolutional neural network-based structural condition assessment techniques. Engineering Structures, 226, 111347.
   Web of Science ®Google Scholar
• Tabaković, A., and Schlangen, E, 2016. Self-healing technology for asphalt pavements. In: M.D. Hager, S. van der Zwaag, and U.S. Schubert, eds. Self-healing materials, Cham: Springer International Publishing, 285–306.
   Google Scholar
• Taylor Owens, A., and Tippur, H.V., 2023. An image processing technique to identify crack tip position and automate fracture parameter extraction using DIC: application to dynamic fracture. Experimental Mechanics, 63 (3), 445–466.
   Web of Science ®Google Scholar
• Wang, W., et al., 2019. Pavement crack image acquisition methods and crack extraction algorithms: a review. Journal of Traffic and Transportation Engineering (English Edition), 6 (6), 535–556.
   Google Scholar
• Wang, X., and Hu, Z., 2017. Grid-based pavement crack analysis using deep learning. In: 2017 4th international conference on transportation information and safety (ICTIS). 917–924.
   Google Scholar
• Waqas, A., Kang, D., and Cha, Y.-J, 2023. Deep learning-based obstacle-avoiding autonomous UAVs with fiducial marker-based localization for structural health monitoring. Structural Health Monitoring, 14759217231177314. doi:10.1177/14759217231177314.
   Google Scholar
• Wei, H., and Meng, L, 2023. An accurate stereo matching method based on color segments and edges. Pattern Recognition, 133, 108996.
   Web of Science ®Google Scholar
• Wieland, M., Li, Y., and Martinis, S, 2019. Multi-sensor cloud and cloud shadow segmentation with a convolutional neural network. Remote Sensing of Environment, 230, 111203.
   Web of Science ®Google Scholar
• Winkelmaier, G., et al., 2021. Topographically guided UAV for identifying tension cracks using image-based analytics in open-Pit mines. IEEE Transactions on Industrial Electronics, 68 (6), 5415–5424.
   Web of Science ®Google Scholar
• Wu, W., et al., 2018. Coupling deep learning and UAV for infrastructure condition assessment automation. In: Presented at the 2018 IEEE international smart cities conference (ISC2), IEEE, 1–7.
   Google Scholar
• Xiao, S., et al., 2023. Pavement crack detection with hybrid-window attentive vision transformers. International Journal of Applied Earth Observation and Geoinformation, 116, 103172.
   Web of Science ®Google Scholar
• Xu, B., and Liu, C, 2022. Pavement crack detection algorithm based on generative adversarial network and convolutional neural network under small samples. Measurement, 196, 111219.
   Web of Science ®Google Scholar
• Yang, X., et al., 2018. Automatic pixel-level crack detection and measurement using fully convolutional network. Computer-Aided Civil and Infrastructure Engineering, 33 (12), 1090–1109.
   Web of Science ®Google Scholar
• Yang, J.-B., et al., 2023. Establishment of urban road maintenance model based on performance-based contracts. Journal of the Chinese Institute of Engineers, 46 (3), 208–219.
   Web of Science ®Google Scholar
• Ye, X., Jin, T., and Yun, C, 2019. A review on deep learning-based structural health monitoring of civil infrastructures. Smart Structures and Systems, 24 (5), 567–585.
   Web of Science ®Google Scholar
• Zakeri, H., Nejad, F.M., and Fahimifar, A, 2016. Rahbin: a quadcopter unmanned aerial vehicle based on a systematic image processing approach toward an automated asphalt pavement inspection. Automation in Construction, 72, 211–235.
   Web of Science ®Google Scholar
• Zhang, L., et al., 2019. Study on pavement defect detection based on image processing utilizing UAV. In: Presented at the journal of physics: conference series, IOP Publishing, 042011.
   Google Scholar
• Zhang, Y., et al., 2022. Road damage detection using UAV images based on multi-level attention mechanism. Automation in Construction, 144, 104613.
   Web of Science ®Google Scholar
• Zhao, H., et al., 2017. Pyramid scene parsing network. In: Presented at the proceedings of the ieee conference on computer vision and pattern recognition, 2881–2890.
   Google Scholar
• Zhong, J., et al., 2023. A deeper generative adversarial network for grooved cement concrete pavement crack detection. Engineering Applications of Artificial Intelligence, 119, 105808.
   Web of Science ®Google Scholar
• Zhou, R.-G., et al., 2019. Quantum image edge extraction based on improved prewitt operator. Quantum Information Processing, 18 (9), 261.
   Web of Science ®Google Scholar
• Zhou, S., and Song, W, 2020. Deep learning-based roadway crack classification using laser-scanned range images: a comparative study on hyperparameter selection. Automation in Construction, 114, 103171.
   Web of Science ®Google Scholar
• Zou, Q., et al., 2019. Deepcrack: learning hierarchical convolutional features for crack detection. IEEE Transactions on Image Processing, 28 (3), 1498–1512.
   Web of Science ®Google Scholar