Automated detection of airfield pavement damages: an efficient light-weight algorithm

References

• Ale, L., Zhang, N., and Li, L., 2018. Road damage detection using RetinaNet. In: 2018 IEEE international conference on big data (big data). 5197–5200.
   Google Scholar
• Ali, A., et al., 2022. Predicting pavement condition index using fuzzy logic technique. Infrastructures, 7 (7), 91.
   Google Scholar
• Amhaz, R., et al., 2016. Automatic crack detection on two-dimensional pavement images: an algorithm based on minimal path selection. IEEE Transactions on Intelligent Transportation Systems, 17 (10), 2718–2729.
   Web of Science ®Google Scholar
• Apeagyei, A., Ademolake, T.E., and Adom-Asamoah, M., 2023. Evaluation of deep learning models for classification of asphalt pavement distresses. International Journal of Pavement Engineering, 24 (1), 2180641.
   Web of Science ®Google Scholar
• Arjapure, S., and Kalbande, D., 2021. Deep learning model for pothole detection and area computation. In: 2021 international conference on communication information and computing technology (ICCICT), June. 1–6.
   Google Scholar
• Attoh-Okine, N., et al., 2008. The empirical mode decomposition and the Hilbert–Huang transform. EURASIP Journal on Advances in Signal Processing, 2008 (1), 1–2.
   Google Scholar
• Avila, M., et al., 2014. 2D image based road pavement crack detection by calculating minimal paths and dynamic programming. In: 2014 IEEE international conference on image processing (ICIP). 783–787. ISSN: 2381–8549.
   Google Scholar
• Cao, X., et al., 2018. Region based CNN for foreign object debris detection on airfield pavement. Sensors, 18 (3), 737.
   PubMed Web of Science ®Google Scholar
• Chen, F.C., et al., 2017. A texture-based video processing methodology using Bayesian data fusion for autonomous crack detection on metallic surfaces: a texture-based video processing. Computer-Aided Civil and Infrastructure Engineering, 32 (4), 271–287.
   Web of Science ®Google Scholar
• Cheng, H.D., Shi, X.J., and Glazier, C., 2003. Real-time image thresholding based on sample space reduction and interpolation approach. Journal of Computing in Civil Engineering, 17 (4), 264–272.
   Web of Science ®Google Scholar
• Chitale, P.A., et al., 2020. Pothole detection and dimension estimation system using deep learning (YOLO) and image processing. In: 2020 35th international conference on image and vision computing New Zealand (IVCNZ). 1–6. ISSN: 2151–2205.
   Google Scholar
• Cord, A., and Chambon, S., 2012. Automatic road defect detection by textural pattern recognition based on adaboost. Computer-Aided Civil and Infrastructure Engineering, 27 (4), 244–259.
   Web of Science ®Google Scholar
• Dong, H., et al., 2022. Deep metric learning-based for multi-target few-shot pavement distress classification. IEEE Transactions on Industrial Informatics, 18 (3), 1801–1810.
   Web of Science ®Google Scholar
• Du, Y., et al., 2021. Pavement distress detection and classification based on YOLO network. International Journal of Pavement Engineering, 22 (13), 1659–1672. https://doi.org/10.1080/10298436.2020.1833204
   Web of Science ®Google Scholar
• Fawcett, T., 2006. An introduction to ROC analysis. Pattern Recognition Letters, 27 (8), 861–874.
   Web of Science ®Google Scholar
• Fujita, Y., et al., 2017. A method based on machine learning using hand-crafted features for crack detection from asphalt pavement surface images. March, Tokyo, Japan. 103380I.
   Google Scholar
• Girshick, R., et al., 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In: 2014 IEEE conference on computer vision and pattern recognition, June, Columbus, OH, USA: IEEE, 580–587.
   Google Scholar
• Girshick, R., 2015. Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision. 1440–1448.
   Google Scholar
• Gong, H., Sun, Y., and Huang, B., 2019. Gradient boosted models for enhancing fatigue cracking prediction in mechanistic-empirical pavement design guide. Journal of Transportation Engineering, Part B: Pavements, 145 (2), 04019014.
   Web of Science ®Google Scholar
• Gopalakrishnan, K., et al., 2017. Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction and Building Materials, 157, 322–330.
   Web of Science ®Google Scholar
• Guan, H., et al., 2014. Iterative tensor voting for pavement crack extraction using mobile laser scanning data. IEEE Transactions on Geoscience and Remote Sensing, 53 (3), 1527–1537.
   Web of Science ®Google Scholar
• Guo, K., et al., 2022. A pavement distresses identification method optimized for YOLOv5s. Scientific Reports, 12 (1), 3542.
   PubMed Web of Science ®Google Scholar
• Han, K., et al., 2020. GhostNet: More Features from Cheap Operations. March. ArXiv:1911.11907 [cs].
   Google Scholar
• He, K., et al., 2015a. Deep residual learning for image recognition. CoRR, abs/1512.03385. Available from: http://arxiv.org/abs/1512.03385.
   Google Scholar
• He, K., et al., 2015b. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37 (9), 1904–1916.
   PubMed Web of Science ®Google Scholar
• Hoang, N.D., and Nguyen, Q.L., 2019. A novel method for asphalt pavement crack classification based on image processing and machine learning. Engineering with Computers, 35 (2), 487–498.
   Web of Science ®Google Scholar
• Huang, Y., and Xu, B., 2006. Automatic inspection of pavement cracking distress. Journal of Electronic Imaging, 15 (1), 013017.
   Web of Science ®Google Scholar
• Ibragimov, E., et al., 2022. Automated pavement distress detection using region based convolutional neural networks. International Journal of Pavement Engineering, 23 (6), 1981–1992. https://doi.org/10.1080/10298436.2020.1833204
   Web of Science ®Google Scholar
• Issa, A., Samaneh, H., and Ghanim, M., 2022. Predicting pavement condition index using artificial neural networks approach. Ain Shams Engineering Journal, 13 (1), 101490.
   Web of Science ®Google Scholar
• Jocher, G., et al., 2020. Ultralytics/yolov5: v3.1 - bug fixes and performance improvements. October. Available from: https://doi.org/10.5281/zenodo.4154370
   Google Scholar
• Kapela, R., et al., 2015. Asphalt surfaced pavement cracks detection based on histograms of oriented gradients. In: 2015 22nd international conference mixed design of integrated circuits & systems (MIXDES). IEEE, 579–584.
   Google Scholar
• Kaseko, M.S., and Ritchie, S.G., 1993. A neural network-based methodology for pavement crack detection and classification. Transportation Research Part C: Emerging Technologies, 1 (4), 275–291.
   Google Scholar
• Kirschke, K.R., and Velinsky, S.A., 1992. Histogram-based approach for automated pavement-crack sensing. Journal of Transportation Engineering, 118 (5), 700–710.
   Google Scholar
• Krizhevsky, A., Sutskever, I., and Hinton, G.E., 2012. ImageNet classification with deep convolutional neural networks. In: F. Pereira, C.J. Burges, L. Bottou and K.Q. Weinberger, eds. Advances in neural information processing systems. Curran Associates, Inc., vol. 25.
   Google Scholar
• Lecun, Y., et al., 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86 (11), 2278–2324.
   Web of Science ®Google Scholar
• LeCun, Y., Bengio, Y., and Hinton, G., 2015. Deep learning. Nature, 521 (7553), 436–444.
   PubMed Web of Science ®Google Scholar
• Lee, J.H., et al., 2018. Diagnosis of crack damage on structures based on image processing techniques and R-CNN using unmanned aerial vehicle (UAV). In: Sensors and smart structures technologies for civil, mechanical, and aerospace systems 2018. SPIE, vol. 10598, 265–272.
   Google Scholar
• Li, H., et al., 2021a. Algorithm for the detection of thin strip-shaped structural small diseases on airport pavement based on improved pyramid and feature fusion. In: 2021 IEEE international conference on real-time computing and robotics (RCAR), July, Xining, China: IEEE, 1361–1367.
   Google Scholar
• Li, H., et al., 2021b. Algorithm for the detection of thin strip-shaped structural small diseases on airport pavement based on improved pyramid and feature fusion. In: 2021 IEEE international conference on real-time computing and robotics (RCAR). IEEE, 1361–1367.
   Google Scholar
• Li, J., et al., 2022b. Automated asphalt pavement damage rate detection based on optimized GA-CNN. Automation in Construction, 136, 104180.
   Web of Science ®Google Scholar
• Li, J., Liu, T., and Wang, X., 2022a. Advanced pavement distress recognition and 3D reconstruction by using GA-DenseNet and binocular stereo vision. Measurement, 201, 111760.
   Web of Science ®Google Scholar
• Liang, H., et al., 2023. Investigating long-term performance of flexible pavement using Bayesian multilevel models. Road Materials and Pavement Design, 24 (8), 1995–2009.
   Web of Science ®Google Scholar
• Lin, T.Y., et al., 2017. Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision. 2980–2988.
   Google Scholar
• Liu, S.W., et al., 2002b. Detection of cracks using neural networks and computational mechanics. Computer Methods in Applied Mechanics and Engineering, 191 (25–26), 2831–2845.
   Web of Science ®Google Scholar
• Liu, W., et al., 2016. SSD: single shot MultiBox detector. In: B. Leibe, J. Matas, N. Sebe and M. Welling, eds. Computer vision – ECCV 2016. vol. 9905. Cham: Springer International Publishing, 21–37.
   Google Scholar
• Liu, S., et al., 2018. Path aggregation network for instance segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 8759–8768.
   Google Scholar
• Liu, L., et al., 2020. Deep learning for generic object detection: a survey. International Journal of Computer Vision, 128 (2), 261–318.
   Web of Science ®Google Scholar
• Liu, H., et al., 2022a. Pavement distress initiation prediction by time-lag analysis and logistic regression. Applied Sciences, 12 (22), 11855.
   Google Scholar
• Liu, Z., et al., 2023. Automatic intelligent recognition of pavement distresses with limited dataset using generative adversarial networks. Automation in Construction, 146, 104674.
   Web of Science ®Google Scholar
• Ma, X., et al., 2019. Airport asphalt pavement health monitoring system for mechanical model updating and distress evaluation under realistic random aircraft loads. Construction and Building Materials, 226, 227–237.
   Web of Science ®Google Scholar
• Maeda, H., et al., 2018. Road damage detection and classification using deep neural networks with smartphone images: road damage detection and classification. Computer-Aided Civil and Infrastructure Engineering, 33 (12), 1127–1141.
   Web of Science ®Google Scholar
• Mandal, V., Uong, L., and Adu-Gyamfi, Y., 2018. Automated road crack detection using deep convolutional neural networks. In: 2018 IEEE international conference on big data (big data). 5212–5215.
   Google Scholar
• Nguyen, T.S., Avila, M., and Begot, S., 2009. Automatic detection and classification of defect on road pavement using anisotropy measure. In: 2009 17th European signal processing conference. 617–621.
   Google Scholar
• Nie, M., and Wang, K., 2018. Pavement distress detection based on transfer learning. In: 2018 5th international conference on systems and informatics (ICSAI). 435–439.
   Google Scholar
• Oliveira, H., and Correia, P.L., 2009. Automatic road crack segmentation using entropy and image dynamic thresholding. In: 2009 17th European signal processing conference. 622–626.
   Google Scholar
• Oliveira, H., and Correia, P.L., 2013. Automatic road crack detection and characterization. IEEE Transactions on Intelligent Transportation Systems, 14 (1), 155–168.
   Web of Science ®Google Scholar
• Pan, Y., et al., 2017. Object-based and supervised detection of potholes and cracks from the pavement images acquired by UAV. International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences, 42, 209–217.
   Google Scholar
• Peng, L., et al., 2015. Research on crack detection method of airport runway based on twice-threshold segmentation. In: 2015 fifth international conference on instrumentation and measurement, computer, communication and control (IMCCC), September, Qinhuangdao, China: IEEE, 1716–1720.
   Google Scholar
• Redmon, J., et al., 2016. You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 779–788.
   Google Scholar
• Ren, S., et al., 2015. Faster R-CNN: towards real-time object detection with region proposal networks. In: C. Cortes, N.D. Lawrence, D.D. Lee, M. Sugiyama and R. Garnett, eds. Advances in neural information processing systems 28. Curran Associates, Inc., 91–99.
   Google Scholar
• Ren, S., et al., 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (6), 1137–1149.
   PubMed Web of Science ®Google Scholar
• Salman, M., et al., 2013. Pavement crack detection using the Gabor filter. In: 16th international IEEE conference on intelligent transportation systems (ITSC 2013), October. 2039–2044.
   Google Scholar
• Santos, B., et al., 2020. Validation of an indirect data collection method to assess airport pavement condition. Case Studies in Construction Materials, 13, e00419.
   Google Scholar
• Shah, S., and Deshmukh, C., 2019. Pothole and Bump detection using convolution neural networks. In: 2019 IEEE transportation electrification conference (ITEC-India). 1–4.
   Google Scholar
• Shelhamer, E., Long, J., and Darrell, T., 2017. Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (4), 640–651.
   PubMed Web of Science ®Google Scholar
• Shi, Y., et al., 2016. Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems, 17 (12), 3434–3445.
   Web of Science ®Google Scholar
• Shi, J., et al., 2023. Image processing of aggregate skeleton structure of asphalt mixture for aggregate uniformity quantification. Journal of Materials in Civil Engineering, 35 (1), 04022388.
   Web of Science ®Google Scholar
• Sholevar, N., Golroo, A., and Esfahani, S.R., 2022. Machine learning techniques for pavement condition evaluation. Automation in Construction, 136, 104190.
   Web of Science ®Google Scholar
• Stricker, R., et al., 2019. Improving visual road condition assessment by extensive experiments on the extended GAPs dataset. In: 2019 international joint conference on neural networks (IJCNN), July. 1–8.
   Google Scholar
• Subirats, P., et al., 2006. Automation of pavement surface crack detection using the continuous wavelet transform. In: 2006 international conference on image processing, October. 3037–3040.
   Google Scholar
• Sun, B.C., Qiu, Y.J., and Liang, S.Q., 2010. Cracking recognition of pavement surface based on wavelet technology. Chongqing Jiotong Daxue Xuebao(Ziran Kexue Ban), 29 (1), 69–72.
   Google Scholar
• Tang, W., et al., 2021. An iteratively optimized patch label inference network for automatic pavement distress detection. IEEE Transactions on Intelligent Transportation Systems, 23 (7), 8652–8661.
   Web of Science ®Google Scholar
• Tsai, Y.C.J., Jiang, C., and Huang, Y., 2014. Multiscale crack fundamental element model for real-world pavement crack classification. Journal of Computing in Civil Engineering, 28 (4), 04014012.
   Web of Science ®Google Scholar
• Wang, K.C.P., Li, Q., and Gong, W., 2007. Wavelet-based pavement distress image edge detection with À trous algorithm. Transportation Research Record, 2024 (1), 73–81.
   Google Scholar
• Wen, T., et al., 2022. Automated pavement distress segmentation on asphalt surfaces using a deep learning network. International Journal of Pavement Engineering, 1–14.
   Web of Science ®Google Scholar
• Yang, F., et al., 2019. Feature pyramid and hierarchical boosting network for pavement crack detection. January. ArXiv:1901.06340 [cs].
   Google Scholar
• Yang, F., et al., 2022. Study on preparation and performance of a thermosetting polyurethane modified asphalt binder for bridge deck pavements. Construction and Building Materials, 326, 126784.
   Web of Science ®Google Scholar
• Ying, L., and Salari, E., 2010. Beamlet transform-based technique for pavement crack detection and classification. Computer-Aided Civil and Infrastructure Engineering, 25 (8), 572–580. https://doi.org/10.1111/j.1467-8667.2010.00674.x
   Web of Science ®Google Scholar
• Yong, H., and Chun-Xia, Z., 2010. A local binary pattern based methods for pavement crack detection. Journal of Pattern Recognition Research, 5 (1), 140–147.
   Google Scholar
• Zalama, E., et al., 2014. Road crack detection using visual features extracted by gabor filters. Computer-Aided Civil and Infrastructure Engineering, 29 (5), 342–358.
   Web of Science ®Google Scholar
• Zeiler, M.D., and Fergus, R., 2013. Visualizing and understanding convolutional networks. November. ArXiv:1311.2901 [cs].
   Google Scholar
• Zhang, A., et al., 2013. Matched filtering algorithm for pavement cracking detection. Transportation Research Record: Journal of the Transportation Research Board, 2367 (1), 30–42.
   Google Scholar
• Zhang, L., et al., 2016. Road crack detection using deep convolutional neural network. In: 2016 IEEE international conference on image processing (ICIP). IEEE, 3708–3712.
   Google Scholar
• Zhang, A., et al., 2017. Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-Learning network: pixel-level pavement crack detection on 3D asphalt surfaces. Computer-Aided Civil and Infrastructure Engineering, 32 (10), 805–819.
   Web of Science ®Google Scholar
• Zhang, H., et al., 2022. Investigation of pavement crack detection based on deep learning method using weakly supervised instance segmentation framework. Construction and Building Materials, 358, 129117.
   Web of Science ®Google Scholar
• Zhong, J., et al., 2022. Multi-scale feature fusion network for pixel-level pavement distress detection. Automation in Construction, 141, 104436.
   Web of Science ®Google Scholar
• Zhou, J., Huang, P.S., and Chiang, F.P., 2006. Wavelet-based pavement distress detection and evaluation. Optical Engineering, 45 (2), 027007.
   Web of Science ®Google Scholar
• Zou, Q., et al., 2012. CrackTree: automatic crack detection from pavement images. Pattern Recognition Letters, 33 (3), 227–238.
   Web of Science ®Google Scholar
• Zou, Q., et al., 2019. DeepCrack: learning hierarchical convolutional features for crack detection. IEEE Transactions on Image Processing, 28 (3), 1498–1512.
   Web of Science ®Google Scholar