Feature extraction and segmentation of pavement distress using an improved hybrid task cascade network

References

• Bodla, N., et al., 2017. Soft-nms - improving object detection with one line of codeed.^eds.Institute of Electrical and Electronics Engineers Inc., 5562–5570.
   Google Scholar
• Bolya, D., et al., 2019. Yolact: Real-time instance segmentation. arXiv e-prints, arXiv:1904.02689 Available from: https://ui.adsabs.harvard.edu/abs/2019arXiv190402689B.
   Google Scholar
• Cai, Z., and Vasconcelos, N., 2018. Cascade r-cnn: Delving into high quality object detection. IEEE, 6154–6162.
   Google Scholar
• Chen, S., et al., 2021a. Survey of application of deep learning in chromosome segmentation. Computer Engineering and Application, 57 (11), 46–56.
   Google Scholar
• Chen, S.Y., et al., 2021b. A dense feature pyramid network-based deep learning model for road marking instance segmentation using mls point clouds. IEEE Transactions on Geoscience and Remote Sensing, 59 (1), 784–800.
   Web of Science ®Google Scholar
• Chen, Y.H., et al., 2022. A fast inference vision transformer for automatic pavement image classification and its visual interpretation method. Remote Sensing, 14 (8), 1877.
   Web of Science ®Google Scholar
• Chen, S.L., et al., 2023. Large-scale individual building extraction from open-source satellite imagery via super-resolution-based instance segmentation approach. ISPRS Journal of Photogrammetry and Remote Sensing, 195, 129–152.
   Web of Science ®Google Scholar
• Dai, J., et al., 2017. Deformable convolutional networks. arXiv e-prints, arXiv:1703.06211 Available from: https://ui.adsabs.harvard.edu/abs/2017arXiv170306211D.
   Google Scholar
• Dong, H.W., et al., 2022. Deep metric learning-based for multi-target few-shot pavement distress classification. IEEE Transactions on Industrial Informatics, 18 (3), 1801–1810.
   Web of Science ®Google Scholar
• Eslami, E., and Yun, H.B., 2021. Attention-based multi-scale convolutional neural network (a plus mcnn) for multi-class classification in road images. Sensors, 21 (15), 5137.
   PubMed Web of Science ®Google Scholar
• Gao, N.Y., et al., 2021. Ssap: single-shot instance segmentation with affinity pyramid. IEEE Transactions on Circuits and Systems for Video Technology, 31 (2), 661–673.
   Web of Science ®Google Scholar
• Garilli, E., et al., 2021. Automatic detection of stone pavement's pattern based on uav photogrammetry. Automation in Construction, 122, 103477.
   Web of Science ®Google Scholar
• Gatta, C., Rizzi, A., and Marini, D., 2002. Ace: An automatic color equalization algorithm. CGIV'2002: FIRST EUROPEAN CONFERENCE ON COLOUR IN GRAPHICS, IMAGING, AND VISION, CONFERENCE PROCEEDINGS. 316-320.
   Google Scholar
• Gopalakrishnan, K., et al., 2017. Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction and Building Materials, 157, 322–330. Available from: https://www.sciencedirect.com/science/article/pii/S0950061817319335.
   Web of Science ®Google Scholar
• Guo, T.W., et al., 2018. Wool and cashmere images identification based on deep learning. Textile Bioengineering and Informatics Symposium (TBIS) Proceedings, 2018, 950–956.
   Google Scholar
• He, K., et al., 2016. Deep residual learning for image recognition. IEEE, 770–778.
   Google Scholar
• Kheradmandi, N., and Mehranfar, V., 2022. A critical review and comparative study on image segmentation-based techniques for pavement crack detection. Construction and Building Materials, 321 (7), 126162. Available from: https://www.sciencedirect.com/science/article/pii/S0950061821038940.
   Google Scholar
• Li, S., et al., 2021. Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm. Construction and Building Materials, 273, 121949. Available from: https://www.sciencedirect.com/science/article/pii/S0950061820339532.
   Web of Science ®Google Scholar
• Liu, S., et al., 2018. Path aggregation network for instance segmentation. IEEE, 8759–8768.
   Google Scholar
• Liu, Z., et al., 2021. Application of combining yolo models and 3d gpr images in road detection and maintenance. Remote Sensing, 13 (6), 1081.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2022b. Visibility classification and influencing-factors analysis of airport: A deep learning approach. Atmospheric Environment, 278 (C), 119085.
   Google Scholar
• Liu, Z., et al., 2022c. Gpr-based detection of internal cracks in asphalt pavement: A combination method of deepaugment data and object detection. Measurement, 197, 111281.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2023a. Automatic recognition of pavement cracks from combined gpr b-scan and c-scan images using multiscale feature fusion deep neural networks. Automation in Construction, 146, 104698. Available from: https://www.sciencedirect.com/science/article/pii/S0926580522005684.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2023c. Permanent deformation monitoring and remaining life prediction of asphalt pavement combining full-scale accelerated pavement testing and fem. Structural Control and Health Monitoring, 2023, 6932621. doi:10.1155/2023/6932621.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2023d. Characteristics, mechanisms, and environmental lca of wma containing sasobit: An analysis perspective combing viscosity-temperature regression and interface bonding strength. Journal of Cleaner Production, 391, 136255. Available from: https://www.sciencedirect.com/science/article/pii/S0959652623004134.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2023e. Automatic pixel-level detection of vertical cracks in asphalt pavement based on gpr investigation and improved mask r-cnn. Automation in Construction, 146, 104689. Available from: https://www.sciencedirect.com/science/article/pii/S0926580522005593.
   Web of Science ®Google Scholar
• Liu, Z., et al., 2023f. Laboratory evaluation of the performance of reclaimed asphalt mixed with composite crumb rubber-modified asphalt: reconciling relatively high content of rap and virgin asphalt. International Journal of Pavement Engineering, 24 (1), 2217320. doi:10.1080/10298436.2023.2217320.
   Web of Science ®Google Scholar
• Liu, Z., Gu, X.Y., and Dong, Q., 2023a. Permanent deformation evaluation and instability prediction of semi-rigid pavement structure using accelerated pavement testing and finite element method. Journal of Testing and Evaluation, 52 (1), 20230209. doi:10.1520/JTE20230209.
   Google Scholar
• Liu, Z., Gu, X.Y., and Ren, H., 2023b. Rutting prediction of asphalt pavement with semi-rigid base: numerical modeling on laboratory to accelerated pavement testing. Construction and Building Materials, 375, 130903. Available from: https://www.sciencedirect.com/science/article/pii/S0950061823006153.
   Web of Science ®Google Scholar
• Liu, M., Wang, Z., and Ji, S., 2022c. Non-local graph neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, Pattern Analysis and Machine Intelligence, IEEE Transactions on, IEEE Trans. Pattern Anal. Mach. Intell., 44 (12), 10270–10276. Available from: https://search.ebscohost.com/login.aspx?direct=true&db=edseee&AN=edseee.9645300&lang=zh-cn&site=eds-live.
   PubMed Web of Science ®Google Scholar
• Liu, Z., Yang, Q.F., and Gu, X.Y., 2023d. Assessment of pavement structural conditions and remaining life combining accelerated pavement testing and ground-penetrating radar. Remote Sensing, 15 (18), 4620. doi:10.3390/rs15184620.
   Web of Science ®Google Scholar
• Llopis-Castello, D., et al., 2021. Automatic classification and quantification of basic distresses on urban flexible pavement through convolutional neural networks. Journal of Transportation Engineering PART B-Pavements, 147 (4), 04021063.
   Web of Science ®Google Scholar
• Mao, C.Y., et al., 2015. Research on safety and static-dynamic legibility of distressed pavement. Discrete Dynamics in Nature and Society, 2015 (602), 1–7.
   Google Scholar
• Pinheiro, P.O., Collobert, R., and Dollar, P., 2015. Learning to segment object candidates. arXiv e-prints, arXiv:1506.06204 Available from: https://ui.adsabs.harvard.edu/abs/2015arXiv150606204P.
   Google Scholar
• Rahman, A., Mustafa, R. & Hossain, M.S., 2022. Real-time pothole detection and localization using convolutional neural network. In: M. S. Arefin, M. S. Kaiser, A. Bandyopadhyay, M. a. R. Ahad and K. Ray, eds. Proceedings of the international conference on Big data, IoT, and machine learning. Singapore: Springer Singapore, 579–592.
   Google Scholar
• Ren, S., et al., 2015. Faster r-cnn: Towards real-time object detection with region proposal networks.
   Google Scholar
• Shi, Y., et al., 2016. Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems, 17 (12), 3434–3445.
   Web of Science ®Google Scholar
• Shubber, A.a.M., Al-Rubaee, R.H.A., and Taher, M.H., 2020. Prediction models for distress noise generated due to tire-pavement surface interaction. 4th International Conference on Buildings, Construction and Environmental Engineering.
   Google Scholar
• Szegedy, C., et al., 2014. Going deeper with convolutions.
   Google Scholar
• Taghanaki, S.A., et al., 2021. Deep semantic segmentation of natural and medical images: A review. Artificial Intelligence Review, 54 (1), 137–178.
   Web of Science ®Google Scholar
• Wang, X., et al., 2019. Solo: Segmenting objects by locations. arXiv e-prints, arXiv:1912.04488 Available from: https://ui.adsabs.harvard.edu/abs/2019arXiv191204488W.
   Google Scholar
• Wang, H., et al., 2020. Flexible pavement response analysis under dynamic loading at different vehicle speeds and pavement surface roughness conditions. Journal of Transportation Engineering Part B-Pavements, 146 (3), 04020040.
   Web of Science ®Google Scholar
• Wang, D.Y., et al., 2022. Automatic detection of pothole distress in asphalt pavement using improved convolutional neural networks. Remote Sensing, 14 (16), 3892.
   Web of Science ®Google Scholar
• Xie, S., et al., 2016. Aggregated residual transformations for deep neural networks.
   Google Scholar
• Xie, E., et al., 2020. Polarmask: Single shot instance segmentation with polar representation. IEEE, 12190–12199.
   Google Scholar
• Xie, C., et al., 2021. Unseen object instance segmentation for robotic environments. IEEE Transactions on Robotics, 37 (5), 1343–1359.
   Web of Science ®Google Scholar
• Xu, Y.Y., et al., 2021. Automatic defect detection and segmentation of tunnel surface using modified mask r-cnn. Measurement, 178 (4), 109316.
   Google Scholar
• Zhang, H., et al., 2022a. Investigation of pavement crack detection based on deep learning method using weakly supervised instance segmentation framework. Construction and Building Materials, 358, 129117. Available from: https://www.sciencedirect.com/science/article/pii/S0950061822027726.
   Web of Science ®Google Scholar
• Zhang, H., et al., 2022b. Analyzing the pore structure of pervious concrete based on the deep learning framework of mask r-cnn. Construction and Building Materials, 318, 125987. Available from: https://www.sciencedirect.com/science/article/pii/S0950061821037193.
   Web of Science ®Google Scholar
• Zhao, Z.G., et al., 2022. Convolutional transformer network for hyperspectral image classification. IEEE Geoscience and Remote Sensing Letters, 19, 6009005.
   Web of Science ®Google Scholar