Pixel-Level patch detection from full-scale asphalt pavement images based on deep learning

References

• Astm, 2018. Standard practice for roads and parking lots pavement condition index surveys. West Conshohocken, PA, USA: ASTM International.
   Google Scholar
• Benmhahe, B., and Chentoufi, J.A, 2021. Automated pavement distress detection, classification and measurement: A review. International Journal of Advanced Computer Science and Applications, 12 (8), 708–718. Available from: <Go to ISI>://WOS:000693682500082.
   Web of Science ®Google Scholar
• Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M, 2020. YOLOv4: Optimal speed and accuracy of object detection. Preprint arXiv:2004.10934.
   Google Scholar
• Bodla, N., et al., 2017. Soft-NMS - improving object detection with one line of code. In: 2017 IEEE international conference on computer vision (ICCV), 5562–5570. Available from: <Go to ISI>://WOS:000425498405068.
   Google Scholar
• Chen, J.Z., et al., 2022. A real-time and high-precision method for small traffic-signs recognition. Neural Computing & Applications, 34 (3), 2233–2245. Available from: https://doi.org/10.1007/s00521-021-06526-1.
   Web of Science ®Google Scholar
• Chuang, T.Y., Perng, N.H. & Han, J.Y., 2019. Pavement performance monitoring and anomaly recognition based on crowdsourcing spatiotemporal data. Automation in Construction, 106, 102882. Available from: https://www.sciencedirect.com/science/article/pii/S0926580519302298.
   Web of Science ®Google Scholar
• Coenen, T.B.J., and Golroo, A, 2017. A review on automated pavement distress detection methods. Cogent Engineering, 4 (1), 1374822.
   Web of Science ®Google Scholar
• Du, Y.C., et al., 2021. Pavement distress detection and classification based on YOLO network. International Journal of Pavement Engineering, 22 (13), 1659–1672. Available from: <Go to ISI>://WOS:000509082000001.
   Web of Science ®Google Scholar
• Everingham, M., et al., 2010. The pascal visual object classes (VOC) challenge. International Journal of Computer Vision, 88 (2), 303–338. Available from: <Go to ISI>://WOS:000275955400009.
   Web of Science ®Google Scholar
• Gavilan, M., et al., 2011. Adaptive road crack detection system by pavement classification. Sensors, 11 (10), 9628–9657. Available from: <Go to ISI>://WOS:000296577000032.
   PubMed Web of Science ®Google Scholar
• Girshick, R., 2015. Fast r-cnned. In: Proceedings of the IEEE international conference on computer vision, 1440–1448.
   Google Scholar
• Gopalakrishnan, K., et al., 2017. Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction and Building Materials, 157, 322–330. Available from: <Go to ISI>://WOS:000414106200032.
   Web of Science ®Google Scholar
• Gopalakrishnan, K, 2018. Deep learning in data-driven pavement image analysis and automated distress detection: A review. Data, 3 (3), 28.
   Web of Science ®Google Scholar
• Han, K., et al., 2022. A survey on vision transformer. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45 (1), 87–110.
   PubMed Web of Science ®Google Scholar
• He, K.M., et al., 2015. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37 (9), 1904–1916. Available from: <Go to ISI>://WOS:000359216600013.
   PubMed Web of Science ®Google Scholar
• He, K.M., et al., 2016. Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), 770–778. Available from: <Go to ISI>://WOS:000400012300083.
   Google Scholar
• Hoang, N.-D, 2019. Image processing based automatic recognition of asphalt pavement patch using a metaheuristic optimized machine learning approach. Advanced Engineering Informatics, 40, 110–120.
   Web of Science ®Google Scholar
• Hoang, N.-D., et al., 2022. A novel approach for detection of pavement crack and sealed crack using image processing and salp swarm algorithm optimized machine learning. Advances in Civil Engineering, 2022, 9193511. https://doi.org/10.1155/2022/9193511.
   Web of Science ®Google Scholar
• Hu, W.B., et al., 2021. Machine vision-based surface crack analysis for transportation infrastructure. Automation in Construction, 132, 103973.
   Web of Science ®Google Scholar
• Huidrom, L., Das, L.K., and Sud, S.K, 2013. Method for automated assessment of potholes, cracks and patches from road surface video clips. In: 2nd Conference of transportation research group of India (2nd Ctrg), 104, 312–321. Available from: <Go to ISI>://WOS:000335889700033.
   Google Scholar
• Ibragimov, E., et al., 2020. Automated pavement distress detection using region based convolutional neural networks. International Journal of Pavement Engineering, 23 (6), 1981–1992.
   Web of Science ®Google Scholar
• Ioffe, S., and Szegedy, C., 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shifted. In: International conference on machine learning PMLR, 448–456.
   Google Scholar
• Koch, C., et al., 2015. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Advanced Engineering Informatics, 29 (2), 196–210. Available from: <Go to ISI>://WOS:000355038200006.
   Web of Science ®Google Scholar
• Lau, S.L.H., et al., 2020. Automated pavement crack segmentation using u-net-based convolutional neural network. IEEE Access, 8, 114892–114899. Available from: <Go to ISI>://WOS:000549169900001.
   Google Scholar
• Li, S., et al., 2021. Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm. Construction and Building Materials, 273, 121949.
   Web of Science ®Google Scholar
• Li, L., Luo, W.T., and Wang, K.C.P, 2018. Lane marking detection and reconstruction with line-scan imaging data. Sensors, 18 (5), 1635.
   PubMed Web of Science ®Google Scholar
• Lin, T.-Y., et al., 2017a. Feature pyramid networks for object detectioned. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2117–2125.
   Google Scholar
• Lin, T.-Y., et al., 2017b. Focal loss for dense object detectioned. In: Proceedings of the IEEE international conference on computer vision, 2980–2988.
   Google Scholar
• Liu, W., et al., 2016. SSD: Single shot multibox detector. In: Computer Vision - Eccv 2016, Pt I, 9905, 21–37. Available from: <Go to ISI>://WOS:000389382700002.
   Google Scholar
• Liu, S., et al., 2018. Path aggregation network for instance segmentation. In: 2018 Ieee/Cvf conference on computer vision and pattern recognition (Cvpr), 8759–8768. Available from: <Go to ISI>://WOS:000457843608096.
   Google Scholar
• Liu, J., et al., 2020. Automated pavement crack detection and segmentation based on two-step convolutional neural network. Computer-Aided Civil and Infrastructure Engineering, 35 (11), 1291–1305.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2022a. Gpr-based detection of internal cracks in asphalt pavement: A combination method of deepaugment data and object detection. Measurement, 197, 111281.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2022b. Novel YOLOv3 model with structure and hyperparameter optimization for detection of pavement concealed cracks in gpr images. IEEE Transactions on Intelligent Transportation Systems, 23 (11), 22258–22268.
   Web of Science ®Google Scholar
• Lopes, G., et al., 2016. High resolution trichromatic road surface scanning with a line scan camera and light emitting diode lighting for road-kill detection. Sensors, 16 (4), 558.
   PubMed Web of Science ®Google Scholar
• Lv, H., et al., 2021. An extended search method for identifying optimal parameters of the generalized Maxwell model. Construction and Building Materials, 266, 120796.
   Web of Science ®Google Scholar
• Maas, A.L., Hannun, A.Y., and Ng, A.Y., 2013. Rectifier nonlinearities improve neural network acoustic modelsed. In: Proc. icmlCiteseer, 3.
   Google Scholar
• Majidifard, H., Adu-Gyamfi, Y., and Buttlar, W.G, 2020. Deep machine learning approach to develop a new asphalt pavement condition index. Construction and Building Materials, 247, 118513.
   Web of Science ®Google Scholar
• Mei, Q.P., and Gul, M, 2020. A cost effective solution for pavement crack inspection using cameras and deep neural networks. Construction and Building Materials, 256, 119397.
   Web of Science ®Google Scholar
• Misra, D, 2019. Mish: A self regularized non-monotonic activation function. Preprint, arXiv:1908.08681.
   Google Scholar
• Ouyang, W., and Xu, B, 2013. Pavement cracking measurements using 3d laser-scan images. Measurement Science and Technology, 24 (10), 105204.
   Web of Science ®Google Scholar
• Radopoulou, S.C., and Brilakis, I, 2015. Patch detection for pavement assessment. Automation in Construction, 53, 95–104.
   Web of Science ®Google Scholar
• Ragnoli, A., De Blasiis, M.R., and Di Benedetto, A., 2018. Pavement distress detection methods: A review. Infrastructures, 3 (4), 58.
   Google Scholar
• Redmon, J., et al., 2016. You only look once: unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, 779–788.
   Google Scholar
• Redmon, J., and Farhadi, A, 2017. YOLO9000: Better, faster, stronger. In: 30th IEEE conference on computer vision and pattern recognition (CVPR 2017), 6517–6525. Available from: <Go to ISI>://WOS:000418371406065.
   Google Scholar
• Redmon, J., and Farhadi, A, 2018. YOLOv3: An incremental improvement. Preprint, arXiv:1804.02767.
   Google Scholar
• Ren, S.Q., et al., 2017. Faster r-cnn: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (6), 1137–1149. Available from: <Go to ISI>://WOS:000401091200007.
   PubMed Web of Science ®Google Scholar
• Sholevar, N., Golroo, A., and Esfahani, S.R, 2022. Machine learning techniques for pavement condition evaluation. Automation in Construction, 136, 104190.
   Web of Science ®Google Scholar
• Silva, S.H., and Najafirad, P, 2020. Opportunities and challenges in deep learning adversarial robustness: A survey. Preprint, arXiv:2007.00753.
   Google Scholar
• Sun, L., Kamaliardakani, M., and Zhang, Y.M, 2016. Weighted neighborhood pixels segmentation method for automated detection of cracks on pavement surface images. Journal of Computing in Civil Engineering, 30 (2), 04015021.
   Web of Science ®Google Scholar
• Sutskever, I., et al., 2013. On the importance of initialization and momentum in deep learninged. In: International conference on machine learning PMLR, 1139–1147.
   Google Scholar
• Tao, J.Q., et al., 2021. Automated image segmentation of air voids in hardened concrete surface using photometric stereo method. International Journal of Pavement Engineering, 23 (14), 5168–5185.
   Web of Science ®Google Scholar
• Wang, C.Y., et al., 2020. Cspnet: A new backbone that can enhance learning capability of CNNED. In: 2020 IEEE/CVF conference on computer vision and pattern recognition workshops (CVPRW).
   Google Scholar
• Wang, D., et al., 2022b. Automatic detection of pothole distress in asphalt pavement using improved convolutional neural networks. Remote Sensing, 14 (16), 3892.
   Web of Science ®Google Scholar
• Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M., 2021. Scaled-YOLOv4: Scaling cross stage partial networked. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 13029–13038.
   Google Scholar
• Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M, 2022a. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Preprint, arXiv:2207.02696.
   Google Scholar
• Yao, M., et al., 2015. Fusing complementary images for pavement cracking measurements. Measurement Science and Technology, 26 (2), 025005.
   Web of Science ®Google Scholar
• Yao, X., Yao, M., and Xu, B.G, 2011. Automated measurements of road cracks using line-scan imaging. Journal of Testing and Evaluation, 39 (4), 621–629. Available from: <Go to ISI>://WOS:000296596400013.
   Web of Science ®Google Scholar
• Yao, M., Zhao, Z.Y., and Xu, B.G, 2014. Geometric calibration of line-scan camera using a planar pattern. Journal of Electronic Imaging, 23 (1), 013028–013028.
   Web of Science ®Google Scholar
• Yuan, G., et al., 2021. A precise calibration method for line scan cameras. IEEE Transactions on Instrumentation and Measurement, 70, 1–9.
   PubMed Web of Science ®Google Scholar
• Yun, S., et al., 2019. Cutmix: Regularization strategy to train strong classifiers with localizable features. In: 2019 IEEE/CVF international conference on computer vision (ICCV 2019), 6022–6031. Available from: <Go to ISI>://WOS:000548549201014.
   Google Scholar
• Zegeye-Teshale, E., et al., 2021. Application of advanced multi-sensor non-destructive testing system for the evaluation of pavements affected by transverse crack-heaving. Transportation Research Record, 2675 (9), 1149–1162. Available from: <Go to ISI>://WOS:000684615500001.
   Web of Science ®Google Scholar
• Zeiler, M.D, 2012. Adadelta: An adaptive learning rate method. Preprint, arXiv:1212.5701.
   Google Scholar
• Zhang, K., et al., 2017. Accurate detection and evaluation method for aggregate distribution uniformity of asphalt pavement. Construction and Building Materials, 152, 715–730. Available from: <Go to ISI>://WOS:000411545600067.
   Web of Science ®Google Scholar
• Zhang, G., et al., 2018. Three mechanisms of weight decay regularization. Preprint, arXiv:1810.12281.
   Google Scholar
• Zhang, H.B., et al., 2020a. Real-time detection method for small traffic signs based on YOLOv3. Ieee Access, 8, 64145–64156. Available from: <Go to ISI>://WOS:000530832200129.
   Web of Science ®Google Scholar
• Zhang, K., Zhang, Y., and Cheng, H.-D, 2020b. Crackgan: pavement crack detection using partially accurate ground truths based on generative adversarial learning. IEEE Transactions on Intelligent Transportation Systems, 22 (2), 1306–1319.
   Web of Science ®Google Scholar
• Zheng, Z., et al., 2020. Distance-iou loss: Faster and better learning for bounding box regressioned. In: Proceedings of the AAAI conference on artificial intelligence, 12993–13000.
   Google Scholar
• Zhu, J.Q., et al., 2022. Pavement distress detection using convolutional neural networks with images captured via UAV. Automation in Construction, 133, 103991.
   Web of Science ®Google Scholar