A classification framework with multi-level fusion of object-based analysis and convolutional neural network: a case study for land use classification in mining areas

References

• Achanta, R., A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk. 2012. “SLIC Superpixels Compared to State-Of-The-Art Superpixel Methods.” IEEE Transactions on Pattern Analysis and Machine Intelligence 34 (11): 2274–2281. https://doi.org/10.1109/tpami.2012.120.
   PubMed Web of Science ®Google Scholar
• Ahamad, A., C. C. Sun, N. J. Yang, and W. K. Kuo. 2022. “A New Fast Estimating Floor Region Based on Image Segmentation for Smart Rovers.” IET Image Processing 16 (9): 2457–2466. https://doi.org/10.1049/ipr2.12500.
   Web of Science ®Google Scholar
• Cai, J. H., and Y. M. Chen. 2022. “A Novel Unsupervised Deep Learning Method for the Generalization of Urban Form.” Geo-Spatial Information Science 25 (4): 568–587. https://doi.org/10.1080/10095020.2022.2068384.
   Web of Science ®Google Scholar
• Cai, H. J., T. Chen, R. Q. Niu, and A. Plaza. 2021. “Landslide Detection Using Densely Connected Convolutional Networks and Environmental Conditions.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14: 5235–5247. https://doi.org/10.1109/jstars.2021.3079196.
   Web of Science ®Google Scholar
• Chen, T., N. X. Hu, R. Q. Niu, N. Zhen, and A. Plaza. 2020. “Object-Oriented Open-Pit Mine Mapping Using Gaofen-2 Satellite Image and Convolutional Neural Network, for the Yuzhou City, China.” Remote Sensing 12 (23): 20. https://doi.org/10.3390/rs12233895.
   Web of Science ®Google Scholar
• Chen, W. T., X. J. Li, H. X. He, and L. Z. Wang. 2018a. “Assessing Different Feature Sets’ Effects on Land Cover Classification in Complex Surface-Mined Landscapes by Ziyuan-3 Satellite Imagery.” Remote Sensing 10 (1): 20. https://doi.org/10.3390/rs10010023.
   Web of Science ®Google Scholar
• Chen, W. T., X. J. Li, H. X. He, and L. Z. Wang. 2018b. “A Review of Fine-Scale Land Use and Land Cover Classification in Open-Pit Mining Areas by Remote Sensing Techniques.” Remote Sensing 10 (1): 19. https://doi.org/10.3390/rs10010015.
   Web of Science ®Google Scholar
• Chen, L., J. J. Liu, H. Li, W. J. Zhan, B. D. Zhou, and Q. Q. Li. 2021. “Dual Context Prior and Refined Prediction for Semantic Segmentation.” Geo-Spatial Information Science 24 (2): 228–240. https://doi.org/10.1080/10095020.2020.1785957.
   Web of Science ®Google Scholar
• Chen, W. T., X. J. Li, and L. Z. Wang. 2020. “Fine Land Cover Classification in an Open Pit Mining Area Using Optimized Support Vector Machine and Worldview-3 Imagery.” Remote Sensing 12 (1): 16. https://doi.org/10.3390/rs12010082.
   Web of Science ®Google Scholar
• Chen, Y. L., H. L. Xu, X. J. Zhang, P. Gao, Z. G. Xu, and X. B. Huang. 2023. “An Object Detection Method for Bayberry Trees Based on an Improved YOLO Algorithm.” International Journal of Digital Earth 16 (1): 781–805. https://doi.org/10.1080/17538947.2023.2173318.
   Web of Science ®Google Scholar
• Chen, T., X. X. Zheng, R. Q. Niu, and A. Plaza. 2022. “Open-Pit Mine Area Mapping with Gaofen-2 Satellite Images Using U-Net.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15: 3589–3599. https://doi.org/10.1109/jstars.2022.3171290.
   Web of Science ®Google Scholar
• Chen, L. C. E., Y. K. Zhu, G. Papandreou, F. Schroff, and H. Adam. 2018.“Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation.” Paper presented at the 15th European Conference on Computer Vision (ECCV), Munich, September 8–14.
   Google Scholar
• Dai, J. F., H. Z. Qi, Y. W. Xiong, Y. Li, G. D. Zhang, H. Hu, and Y. C. Wei. 2017. “Deformable Convolutional Networks.” Paper presented at the 16th IEEE International Conference on Computer Vision (ICCV), Venice, October 22-29.
   Google Scholar
• Du, S. J., S. H. Du, B. Liu, and X. Y. Zhang. 2021. “Incorporating DeepLabv3+ and Object-Based Image Analysis for Semantic Segmentation of Very High Resolution Remote Sensing Images.” International Journal of Digital Earth 14 (3): 357–378. https://doi.org/10.1080/17538947.2020.1831087.
   Web of Science ®Google Scholar
• Du, S. H., W. Li, J. Li, S. H. Du, C. Y. Zhang, and Y. Q. Sun. 2022. “Open-Pit Mine Change Detection from High Resolution Remote Sensing Images Using DA-UNet Plus Plus and Object-Based Approach.” International Journal of Mining, Reclamation and Environment 36 (7): 512–535. https://doi.org/10.1080/17480930.2022.2072102.
   Web of Science ®Google Scholar
• Du, S. H., J. H. Xing, J. Li, S. H. Du, C. Y. Zhang, and Y. Q. Sun. 2022. “Open-Pit Mine Extraction from Very High-Resolution Remote Sensing Images Using OM-Deeplab.” Natural Resources Research 31 (6): 3173–3194. https://doi.org/10.1007/s11053-022-10114-y.
   Web of Science ®Google Scholar
• Ge, C. J., W. J. Xie, and L. K. Meng. 2022. “Extracting Lakes and Reservoirs from GF-1 Satellite Imagery Over China Using Improved U-Net.” IEEE Geoscience and Remote Sensing Letters 19: 5. https://doi.org/10.1109/lgrs.2022.3155653.
   Web of Science ®Google Scholar
• Guo, Z. Q., H. L. Liu, Z. Z. Zheng, X. Chen, and Y. Liang. 2021. “Accurate Extraction of Mountain Grassland from Remote Sensing Image Using a Capsule Network.” IEEE Geoscience and Remote Sensing Letters 18 (6): 964–868. https://doi.org/10.1109/lgrs.2020.2992661.
   Web of Science ®Google Scholar
• He, K. M., X. Y. Zhang, S. Q. Ren, and J. Sun. 2015. “Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 37 (9): 1904–1916. https://doi.org/10.1109/tpami.2015.2389824.
   PubMed Web of Science ®Google Scholar
• He, K. M., X. Y. Zhang, S. Q. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” Paper presented at the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, June 27–30.
   Google Scholar
• Huang, G., Z. Liu, L. van der Maaten, and K. Q. Weinberger. 2017. “Densely Connected Convolutional Networks.” Paper presented at the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, July 21–26.
   Google Scholar
• Jamali, A., M. Mahdianpari, F. Mohammadimanesh, and S. Homayouni. 2022. “A Deep Learning Framework Based on Generative Adversarial Networks and Vision Transformer for Complex Wetland Classification Using Limited Training Samples.” International Journal of Applied Earth Observation and Geoinformation 115: 11. https://doi.org/10.1016/j.jag.2022.103095.
   Web of Science ®Google Scholar
• Jing, R., S. Liu, Z. N. Gong, Z. H. Wang, H. L. Guan, A. Gautam, and W. J. Zhao. 2020. “Object-Based Change Detection for VHR Remote Sensing Images Based on a Trisiamese-LSTM.” International Journal of Remote Sensing 41 (16): 6209–6231. https://doi.org/10.1080/01431161.2020.1734253.
   Web of Science ®Google Scholar
• Li, L. H., W. P. Jing, and H. H. Wang. 2021. “Extracting the Forest Type from Remote Sensing Images by Random Forest.” IEEE Sensors Journal 21 (16): 17447–17454. https://doi.org/10.1109/jsen.2020.3045501.
   Web of Science ®Google Scholar
• Li, Z. Q., E. Z. Li, A. Samat, T. Y. Xu, W. Liu, and Y. H. Zhu. 2022. “An Object-Oriented CNN Model Based on Improved Superpixel Segmentation for High-Resolution Remote Sensing Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15: 4782–4796. https://doi.org/10.1109/jstars.2022.3181744.
   Web of Science ®Google Scholar
• Liu, B., S. H. Du, S. J. Du, and X. Y. Zhang. 2020. “Incorporating Deep Features into GEOBIA Paradigm for Remote Sensing Imagery Classification: A Patch-Based Approach.” Remote Sensing 12 (18): 24. https://doi.org/10.3390/rs12183007.
   Web of Science ®Google Scholar
• Li, J., J. H. Xing, S. H. Du, S. H. Du, C. Y. Zhang, and W. Li. 2023. “Change Detection of Open-Pit Mine Based on Siamese Multiscale Network.” IEEE Geoscience and Remote Sensing Letters 20: 5. https://doi.org/10.1109/lgrs.2022.3232763.
   Web of Science ®Google Scholar
• Li, J., Y. L. Xu, C. Y. Zhang, J. T. Guo, X. J. Wang, and Y. C. Zhang. 2023. “Unmixing the Coupling Influence from Driving Factors on Vegetation Changes Considering Spatio-Temporal Heterogeneity in Mining Areas: A Case Study in Xilinhot, Inner Mongolia, China.” Environmental Monitoring and Assessment 195 (1): 19. https://doi.org/10.1007/s10661-022-10815-0.
   Web of Science ®Google Scholar
• Li, R., S. Y. Zheng, C. X. Duan, J. L. Su, and C. Zhang. 2022. “Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images.” IEEE Geoscience and Remote Sensing Letters 19: 5. https://doi.org/10.1109/lgrs.2021.3063381.
   Web of Science ®Google Scholar
• Li, R., S. Y. Zheng, C. X. Duan, L. B. Wang, and C. Zhang. 2022. “Land Cover Classification from Remote Sensing Images Based on Multi-Scale Fully Convolutional Network.” Geo-Spatial Information Science 25 (2): 278–294. https://doi.org/10.1080/10095020.2021.2017237.
   Web of Science ®Google Scholar
• Qu, L. A., M. C. Li, Z. J. Chen, W. B. Liu, J. J. Zhi, and L. C. Zhang. 2022. “Mapping Large Area Tea Plantations Using Progressive Random Forest and Google Earth Engine.” Journal of Applied Remote Sensing 16 (2): 22. https://doi.org/10.1117/1.Jrs.16.024509.
   Web of Science ®Google Scholar
• Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Paper presented at the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, October 05-09.
   Google Scholar
• Shafer, G. 1992. “Dempster-Shafer Theory.” In Encyclopedia of Artificial Intelligence, edited by S. C. Shapiro, 330–331. New York: John Wiley & Sons.
   Google Scholar
• Shelhamer, E., J. Long, and T. Darrell. 2017. “Fully Convolutional Networks for Semantic Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (4): 640–651. https://doi.org/10.1109/tpami.2016.2572683.
   PubMed Web of Science ®Google Scholar
• Simonyan, K., and A. Zisserman. 2014. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 36 (8): 1573–1585. https://doi.org/10.1109/TPAMI.2014.2301163.
   PubMedGoogle Scholar
• Su, Z. B., Y. Wang, Q. Xu, R. Gao, and Q. M. Kong. 2022. “LodgeNet: Improved Rice Lodging Recognition Using Semantic Segmentation of UAV High-Resolution Remote Sensing Images.” Computers and Electronics in Agriculture 196: 14. https://doi.org/10.1016/j.compag.2022.106873.
   Web of Science ®Google Scholar
• Szegedy, C., W. Liu, Y. Q. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. “Going Deeper with Convolutions.” Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, June 7-12.
   Google Scholar
• Wang, D. C., X. N. Chen, N. B. Guo, H. Yi, and Y. A. Li. 2023. “STCD: Efficient Siamese Transformers-Based Change Detection Method for Remote Sensing Images.” Geo-Spatial Information Science 20. https://doi.org/10.1080/10095020.2022.2157762.
   Google Scholar
• Wang, C., T. Chen, and A. Plaza. 2023. “MFE-Resnet: A New Extraction Framework for Land Cover Characterization in Mining Areas.” Future Generation Computer Systems-The International Journal of Escience 145: 550–562. https://doi.org/10.1016/j.future.2023.04.001.
   Web of Science ®Google Scholar
• Wang, X., J. H. Du, K. Tan, J. W. Ding, Z. X. Liu, C. Pan, and B. Han. 2022. “A High-Resolution Feature Difference Attention Network for the Application of Building Change Detection.” International Journal of Applied Earth Observation and Geoinformation 112: 15. https://doi.org/10.1016/j.jag.2022.102950.
   Web of Science ®Google Scholar
• Wang, X., K. Tan, P. J. Du, C. Pan, and J. W. Ding. 2022. “A Unified Multiscale Learning Framework for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60: 19. https://doi.org/10.1109/tgrs.2022.3147198.
   Google Scholar
• Woo, S. H., J. Park, J. Y. Lee, and I. S. Kweon. 2018. “CBAM: Convolutional Block Attention Module.” Paper presented at the 15th European Conference on Computer Vision (ECCV), Munich, September 8-14.
   Google Scholar
• Xiao, D., L. Y. Yin, and Y. H. Fu. 2022. “Open-Pit Mine Road Extraction from High-Resolution Remote Sensing Images Using RATT-UNet.” IEEE Geoscience and Remote Sensing Letters 19: 5. https://doi.org/10.1109/lgrs.2021.3065148.
   Google Scholar
• Xie, H. B., Y. Z. Pan, J. H. Luan, X. Yang, and Y. W. Xi. 2021. “Open-Pit Mining Area Segmentation of Remote Sensing Images Based on DUSegNet.” The Journal of the Indian Society of Remote Sensing 49 (6): 1257–1270. https://doi.org/10.1007/s12524-021-01312-x.
   Web of Science ®Google Scholar
• Xu, Y., J. Y. Gong, X. Huang, X. Y. Hu, J. Y. Li, Q. Li, and M. Peng. 2022. “Luojia-HSSR: A High Spatial-Spectral Resolution Remote Sensing Dataset for Land-Cover Classification with a New 3D-HRNet.” Geo-Spatial Information Science 13. https://doi.org/10.1080/10095020.2022.2070555.
   Web of Science ®Google Scholar
• Yang, L., W. Chen, P. S. Bi, H. Z. Tang, F. J. Zhang, and Z. Wang. 2022. “Improving Vegetation Segmentation with Shadow Effects Based on Double Input Networks Using Polarization Images.” Computers and Electronics in Agriculture 199: 12. https://doi.org/10.1016/j.compag.2022.107123.
   Web of Science ®Google Scholar
• Yuan, J. Y., X. Ma, Z. T. Zhang, Q. Xu, G. Han, S. Li, W. Gong, F. Y. Liu, and X. Cai. 2023. “EFFC-Net: Lightweight Fully Convolutional Neural Networks in Remote Sensing Disaster Images.” Geo-Spatial Information Science 12. https://doi.org/10.1080/10095020.2023.2183145.
   Web of Science ®Google Scholar
• Yu, L., Z. R. Du, R. M. Dong, J. P. Zheng, Y. Tu, X. Chen, P. Y. Hao, et al. 2022. “FROM-GLC Plus: Toward Near Real-Time and Multi-Resolution Land Cover Mapping.” GIScience and Remote Sensing 59 (1): 1026–1047. https://doi.org/10.1080/15481603.2022.2096184.
   Web of Science ®Google Scholar
• Zhang, C., I. Sargent, X. Pan, H. P. Li, A. Gardiner, J. Hare, and P. M. Atitinson. 2018. “An Object-Based Convolutional Neural Network (OCNN) for Urban Land Use Classification.” Remote Sensing of Environment 216: 57–70. https://doi.org/10.1016/j.rse.2018.06.034.
   Web of Science ®Google Scholar
• Zhang, C. Y., J. H. Xing, J. Li, S. H. Du, and Q. M. Qin. 2023. “A New Method for the Extraction of Tailing Ponds from Very High-Resolution Remotely Sensed Images: PSVED.” International Journal of Digital Earth 16 (1): 2681–2703. https://doi.org/10.1080/17538947.2023.2234338.
   Web of Science ®Google Scholar
• Zhao, W. Z., S. H. Du, and W. J. Emery. 2017. “Object-Based Convolutional Neural Network for High-Resolution Imagery Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (7): 3386–3396. https://doi.org/10.1109/jstars.2017.2680324.
   Web of Science ®Google Scholar
• Zhao, L. R., R. Q. Niu, B. Q. Li, T. Chen, and Y. Y. Wang. 2022. “Application of Improved Instance Segmentation Algorithm Based on VoVnet-V2 in Open-Pit Mines Remote Sensing Pre-Survey.” Remote Sensing 14 (11): 24. https://doi.org/10.3390/rs14112626.
   Web of Science ®Google Scholar
• Zhao, X., P. Wang, C. Chen, T. Jiang, Z. G. Yu, and B. Y. Guo. 2017. “Waterbody Information Extraction from Remote-Sensing Images After Disasters Based on Spectral Information and Characteristic Knowledge.” International Journal of Remote Sensing 38 (5): 1404–1422. https://doi.org/10.1080/01431161.2016.1278284.
   Web of Science ®Google Scholar
• Zhou, G. D., J. H. Xu, W. T. Chen, X. J. Li, J. Li, and L. Z. Wang. 2023. “Deep Feature Enhancement Method for Land Cover with Irregular and Sparse Spatial Distribution Features: A Case Study on Open-Pit Mining.” IEEE Transactions on Geoscience and Remote Sensing 61: 20. https://doi.org/10.1109/tgrs.2023.3241331.
   Web of Science ®Google Scholar
• Zuo, R. X., G. Y. Zhang, R. T. Zhang, and X. P. Jia. 2022. “A Deformable Attention Network for High-Resolution Remote Sensing Images Semantic Segmentation.” IEEE Transactions on Geoscience and Remote Sensing 60: 14. https://doi.org/10.1109/tgrs.2021.3119537.
   Web of Science ®Google Scholar