Scene classification for remote sensing image of land use and land cover using dual-model architecture with multilevel feature fusion

References

• Adegun, Adekanmi Adeyinka, Serestina Viriri, and Jules-Raymond Tapamo. 2023. “Review of Deep Learning Methods for Remote Sensing Satellite Images Classification: Experimental Survey and Comparative Analysis.” Journal of Big Data 10 (1): 93. https://doi.org/10.1186/s40537-023-00772-x.
   Google Scholar
• Alhichri, Haikel. 2023. “RS-DeepSuperLearner: Fusion of CNN Ensemble for Remote Sensing Scene Classification.” Annals of GIS 29 (1): 121–142.
   Web of Science ®Google Scholar
• Alhichri, Haikel, Asma S. Alswayed, Yakoub Bazi, Nassim Ammour, and Naif A. Alajlan. 2021. “Classification of Remote Sensing Images using EfficientNet-B3 CNN Model with Attention.” IEEE Access 9: 14078–14094.
   Web of Science ®Google Scholar
• Alomar, Khaled, Halil Ibrahim Aysel, and Xiaohao Cai. 2023. “Data Augmentation in Classification and Segmentation: A Survey and new Strategies.” Journal of Imaging 9 (2): 46. https://doi.org/10.3390/jimaging9020046.
   PubMed Web of Science ®Google Scholar
• Bazi, Yakoub, Laila Bashmal, Mohamad M. Al Rahhal, Reham Al Dayil, and Naif Al Ajlan. 2021. “Vision Transformers for Remote Sensing Image Classification.” Remote Sensing 13 (3): 516. https://doi.org/10.3390/rs13030516.
   Web of Science ®Google Scholar
• Chen, Chen, Baochang Zhang, Hongjun Su, Wei Li, and Lu Wang. 2016. “Land-use Scene Classification Using Multi-Scale Completed Local Binary Patterns.” Signal, Image and Video Processing 10: 745–752. https://doi.org/10.1007/s11760-015-0804-2.
   Web of Science ®Google Scholar
• Chollet, François. 2017. “Xception: Deep Learning with Depthwise Separable Convolutions.” Paper Presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Hawaii, July 2017.
   Google Scholar
• Cheng, Gong, Junwei Han, and Xiaoqiang Lu. 2017. “Remote Sensing Image Scene Classification: Benchmark and State of the Art.” Proceeding of the IEEE 105 (10): 1865–1883.
   Web of Science ®Google Scholar
• Cheng, Gong, Xingxing Xie, Junwei Han, Lei Guo, and Gui-Song Xia. 2020. “Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13: 3735–3756.
   Web of Science ®Google Scholar
• Dosovitskiy, Alexey, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, et al. 2020. “An image is worth 16x16 words: Transformers for image recognition at scale.” arXiv preprint arXiv:2010.11929.
   Google Scholar
• Dutta, Suparna, and Monidipa Das. 2023. “Remote Sensing Scene Classification under Scarcity of Labelled Samples—A Survey of the State-of-the-Arts.” Computers and Geosciences 171: 105295.
   Web of Science ®Google Scholar
• Ekim, Burak, and Elif Sertel. 2021. “Deep Neural Network Ensembles for Remote Sensing Land Cover and Land use Classification.” International Journal of Digital Earth 14 (12): 1868–1881.
   Web of Science ®Google Scholar
• Fan, Runyu, Lizhe Wang, Ruyi Feng, and Yingqian Zhu. 2019. “Attention Based Residual Network for High-Resolution Remote Sensing Imagery Scene Classification.” Paper Presented at the 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, July 2019.
   Google Scholar
• Gao, Yue, Jun Shi, Jun Li, and Ruoyu Wang. 2020. “Remote Sensing Scene Classification with Dual Attention-Aware Network.” Paper Presented at the 2020 IEEE 5th International Conference on Image, Vision and Computing, Beijing, July 2020.
   Google Scholar
• Guofeng, Sheng, Wen Yang, Tao Xu, and Hong Sun. 2012. “High-resolution Satellite Scene Classification using a Sparse Coding based Multiple Feature Combination.” International Journal of Remote Sensing 33 (8): 2395–2412.
   Web of Science ®Google Scholar
• Hou, Yan-E, Kang Yang, Lanxue Dang, and Yang Liu. 2023. “Contextual Spatial-Channel Attention Network for Remote Sensing Scene Classification.” IEEE Geoscience and Remote Sensing Letters 21: 1–5.
   Web of Science ®Google Scholar
• Hu, Jie, Li Shen, and Gang Sun. 2018. “Squeeze-and-excitation Networks.” Paper Presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, June 2018.
   Google Scholar
• Jégou, Hervé, Florent Perronnin, Matthijs Douze, Jorge Sánchez, Patrick Pérez, and Cordelia Schmid. 2012. “Aggregating Local Image Descriptors Into Compact Codes.” IEEE Transactions on Pattern Analysis and Machine Intelligence 34 (9): 1704–1716. https://doi.org/10.1109/TPAMI.2011.235.
   PubMed Web of Science ®Google Scholar
• Kumar, A. Ramesh, and D. Saravanan. 2013. “Content Based Image Retrieval Using Color Histogram.” International Journal of Computer Science and Information Technologies 4 (2): 242–245.
   Google Scholar
• Lazebnik, Svetlana, Cordelia Schmid, and Jean Ponce. 2006. “Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories.” Paper Presented at the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, USA, June 2006.
   Google Scholar
• Li, Zewen, Wenjie Yang, Shouheng Peng, and Fan Liu. 2021. “A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects.” IEEE Transactions on Neural Networks and Learning Systems 33 (12): 6999–7019.
   Web of Science ®Google Scholar
• Liu, Ze, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” Paper Presented at the Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, Canada, October 2021.
   Google Scholar
• Mehmood, Maryam, Ahsan Shahzad, Bushra Zafar, Amsa Shabbir, and Nouman Ali. 2022. “Remote Sensing Image Classification: A Comprehensive Review and Applications.” Mathematical Problems in Engineering 1–24.
   Web of Science ®Google Scholar
• Naushad, Raoof, Tarunpreet Kaur, and Ebrahim Ghaderpour. 2021. “Deep Transfer Learning for Land use and Land Cover Classification: A Comparative Study.” Sensors 21 (23): 8083. https://doi.org/10.3390/s21238083.
   PubMed Web of Science ®Google Scholar
• Olga, Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2015. “ImageNet Large Scale Visual Recognition Challenge.” International Journal of Computer Vision 115: 211–252.
   Web of Science ®Google Scholar
• Oliva, Aude, and Antonio Torralba. 2006. “Building the Gist of a Scene: The Role of Global Image Features in Recognition.” Progress in Brain Research 155: 23–36.
   PubMed Web of Science ®Google Scholar
• Peng, Feifei, Wei Lu, Wenxia Tan, Kunlun Qi, Xiaokang Zhang, and Quansheng Zhu. 2022. “Multi-output Network Combining GNN and CNN for Remote Sensing Scene Classification.” Remote Sensing 14 (6): 1478.
   Web of Science ®Google Scholar
• Rendón, Eréndira, Roberto Alejo, Carlos Castorena, Frank J. Isidro-Ortega, and Everardo E. Granda-Gutiérrez. 2020. “Data Sampling Methods to Deal with the Big Data Multi-class Imbalance Problem.” Applied Sciences 10 (4): 1276.
   Google Scholar
• Seung, Park, Cheol-Hwan Yoo, and Yong-Goo Shin. 2023. “Effective Shortcut Technique for Generative Adversarial Networks.” Applied Intelligence 53 (2): 2055–2067.
   Web of Science ®Google Scholar
• Shen, Junge, Tianwei Yu, Haopeng Yang, Ruxin Wang, and Qi Wang. 2022. “An Attention Cascade Global–Local Network for Remote Sensing Scene Classification.” Remote Sensing 14 (9): 2042. https://doi.org/10.3390/rs14092042.
   Web of Science ®Google Scholar
• Shen, Junge, Tong Zhang, Yichen Wang, Ruxin Wang, and Min Qi. 2021. “A Dual-Model Architecture with Grouping-Attention-Fusion for Remote Sensing Scene Classification.” Remote Sensing 13 (3): 433. https://doi.org/10.3390/rs13030433.
   Web of Science ®Google Scholar
• Tan, Mingxing, and Quoc V. Le. 2019. “Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks.” Paper Presented at the International Conference on Machine Learning, Stockholm, USA, June 2019.
   Google Scholar
• Tan, Mingxing, and Quoc V. Le. 2021. “EfficientNetV2: Smaller Models and Faster Training.” Paper Presented at the International Conference on Machine Learning, Online, July 2021.
   Google Scholar
• Tang, Xu, Mingteng Li, Jingjing Ma, Xiangrong Zhang, Fang Liu, and Licheng Jiao. 2022. "EMTCAL: Efficient Multiscale Transformer and Cross-level Attention Learning for Remote Sensing Scene Classification." IEEE Transactions on Geoscience and Remote Sensing 60: 1–15.
   Web of Science ®Google Scholar
• Tang, Xu, Qiushuo Ma, Xiangrong Zhang, Fang Liu, Jingjing Ma, and Licheng Jiao. 2021. "Attention Consistent Network for Remote Sensing Scene Classification." IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14: 2030–2045.
   Web of Science ®Google Scholar
• Tang, Guoliang, Zhijing Liu, and Jing Xiong. 2019. “Distinctive Image Features from Illumination and Scale Invariant Keypoints.” Multimedia Tools and Applications 78: 23415–23442.
   Web of Science ®Google Scholar
• Temenos, Anastasios, Nikos Temenos, Maria Kaselimi, Anastasios Doulamis, and Nikolaos Doulamis. 2023. “Interpretable Deep Learning Framework for Land use and Land Cover Classification in Remote Sensing Using SHAP.” IEEE Geoscience and Remote Sensing Letters 20: 1–5.
   Web of Science ®Google Scholar
• Thapa, Aakash, Teerayut Horanont, Bipul Neupane, and Jagannath Aryal. 2023. "Deep Learning for Remote Sensing Image Scene Classification: A Review and Meta-Analysis." Remote Sensing 15 (19):4804.
   Web of Science ®Google Scholar
• Wang, Sheng, Kaiyu Guan, Chenhui Zhang, Qu Zhou, Sibo Wang, Xiaocui Wu, Chongya Jiang, et al. 2023. “Cross-scale Sensing of Field-Level Crop Residue Cover: Integrating Field Photos, Airborne Hyperspectral Imaging, and Satellite Data.” Remote Sensing of Environment 285: 113366. https://doi.org/10.1016/j.rse.2022.113366.
   Web of Science ®Google Scholar
• Wang, Jinjun, Jianchao Yang, Kai Yu, Fengjun Lv, Thomas Huang, and Yihong Gong. 2010. “Locality-constrained Linear Coding for Image Classification.” Paper Presented at the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, June 2010.
   Google Scholar
• Wang, Lituan, Lei Zhang, Xiaofeng Qi, and Zhang Yi. 2021. “Deep Attention-based Imbalanced Image Classification.” IEEE Transactions on Neural Networks and Learning Systems 33 (8): 3320–3330.
   Web of Science ®Google Scholar
• Wang, Qi, Shaoteng Liu, Jocelyn Chanussot, and Xuelong Li. 2018. “Scene Classification with Recurrent Attention of VHR Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 57 (2): 1155–1167.
   Web of Science ®Google Scholar
• Woo, Sanghyun, Jongchan Park, Joon-Young Lee, and In So Kweon. 2018. “Cbam: Convolutional Block Attention Module.” Paper Presented at the Proceedings of the European Conference on Computer Vision, Munich, Germany, September 2018.
   Google Scholar
• Xia, Gui-Song, Jingwen Hu, Fan Hu, Baoguang Shi, Xiang Bai, Yanfei Zhong, Liangpei Zhang, and Xiaoqiang Lu. 2017. “AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (7): 3965–3981.
   Web of Science ®Google Scholar
• Xu, Kejie, Hong Huang, and Peifang Deng. 2021. "Remote Sensing Image Scene Classification based on Global–local Dual-branch Structure Model." IEEE Geoscience and Remote Sensing Letters 19: 1–5.
   Google Scholar
• Yang, Yi, and Shawn Newsam. 2010. “Bag-of-visual-words and Spatial Extensions for Land-use Classification.” Paper Presented at the Proceedings of the 18th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, California, November 2010.
   Google Scholar
• Yu, Yunlong, and Fuxian Liu. 2018. “A two-Stream Deep Fusion Framework for High-Resolution Aerial Scene Classification.” Computational Intelligence and Neuroscience 2018 (4-5): 1–13.
   Google Scholar
• Zhao, Zhicheng, Jiaqi Li, Ze Luo, and Jian Li. 2020. “Remote Sensing Image Scene Classification Based on an Enhanced Attention Module.” IEEE Geoscience Chen, and Remote Sensing Letters 18 (11): 1926–1930.
   Web of Science ®Google Scholar
• Zhou, Jie, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun Jie. 2020. “Graph Neural Networks: A Review of Methods and Applications.” AI Open 1: 57–81. https://doi.org/10.1016/j.aiopen.2021.01.001.
   Google Scholar
• Zhang, Bin, Yongjun Zhang, and Shugen Wang. 2019. “A Lightweight and Discriminative Model for Remote Sensing Scene Classification with Multidilation Pooling Module.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (8): 2636–2653.
   Web of Science ®Google Scholar
• Zhang, Wei, Ping Tang, and Lijun Zhao. 2019. “Remote Sensing Image Scene Classification using CNN-CapsNet.” Remote Sensing 11 (5): 494.
   Web of Science ®Google Scholar
• Zou, Qin, Lihao Ni, Tong Zhang, and Qian Wang. 2015. “Deep Learning Based Feature Selection for Remote Sensing Scene Classification.” IEEE Geoscience and Remote Sensing Letters 12 (11): 2321–2325. https://doi.org/10.1109/LGRS.2015.2475299.
   Web of Science ®Google Scholar