SSC-SFN: spectral-spatial non-local segment federated network for hyperspectral image classification with limited labeled samples

References

• Abdelmoneim, H., M. Soliman, and H. Moghazy. 2020. “Evaluation of TRMM 3B42V7 and CHIRPS Satellite Precipitation Products as an Input for Hydrological Model Over Eastern Nile Basin.” Earth Systems and Environment 4: 685–698. https://doi.org/10.1007/s41748-020-00185-3.
   Google Scholar
• Achanta, R., A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk. 2012. “SLIC Superpixels Compared to State-of-the-Art Superpixel Methods.” IEEE Transactions on Pattern Analysis and Machine Intelligence 34 (11): 2274–2282. https://doi.org/10.1109/TPAMI.2012.120.
   PubMed Web of Science ®Google Scholar
• Ahishali, M., S. Kiranyaz, T. Ince, and M. Gabbouj. 2021. “Classification of Polarimetric SAR Images Using Compact Convolutional Neural Networks.” GIScience & Remote Sensing 58 (1): 28–47. https://doi.org/10.1080/15481603.2020.1853948.
   Web of Science ®Google Scholar
• Alkhatib, M. Q., and M. Velez-Reyes. 2019. “Improved Spatial-Spectral Superpixel Hyperspectral Unmixing.” Remote Sensing 11 (20): 2374. https://doi.org/10.3390/rs11202374.
   Web of Science ®Google Scholar
• Amirabbas, D., A. Erchan, Y. Berrin, M. Andreas, and R. Christian. 2018. “GMM-Based Synthetic Samples for Classification of Hyperspectral Images With Limited Training Data.” IEEE Geoscience and Remote Sensing Letters 15 (6): 942–946. https://doi.org/10.1109/LGRS.2018.2817361.
   Web of Science ®Google Scholar
• Anderson, J. 1976. “A Land Use and Land Cover Classification System for Use With Remote Sensor Data.” US Government Printing Office 964.
   Google Scholar
• Cao, J., and B. Wang. 2017. “Embedding Learning on Spectral-Spatial Graph for Semisupervised Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1805–1809. https://doi.org/10.1109/LGRS.2017.2737020.
   Web of Science ®Google Scholar
• Chen, Y., H. Jiang, C. Li, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. https://doi.org/10.1109/TGRS.2016.2584107.
   Web of Science ®Google Scholar
• Chen, R., G. Li, and C. Dai. 2022. “DRGCN: Dual Residual Graph Convolutional Network for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19: 6009205.
   Web of Science ®Google Scholar
• Dong, Y., Q. Liu, B. Du, and L. Zhang. 2022. “Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Image Processing 31: 1559–1572. https://doi.org/10.1109/TIP.2022.3144017.
   PubMed Web of Science ®Google Scholar
• Farooq, A., X. Jia, J. Hu, and J. Zhou. 2019. “Multi-Resolution Weed Classification via Convolutional Neural Network and Superpixel Based Local Binary Pattern Using Remote Sensing Images.” Remote Sensing 11 (14): 1692. https://doi.org/10.3390/rs11141692.
   Web of Science ®Google Scholar
• Fukunaga, K., and L. Hostetler. 1975. “The Estimation of the Gradient of a Density Function, with Applications in Pattern Recognition.” IEEE Transactions on Information Theory 21 (1): 32–40. https://doi.org/10.1109/TIT.1975.1055330.
   Web of Science ®Google Scholar
• Gaba, S., I. Budhiraja, V. Kumar, S. Garg, G. Kaddoum, and M. Hassan. 2022. “A Federated Calibration Scheme for Convolutional Neural Networks: Models, Applications and Challenges.” Computer Communications 192: 144–162. https://doi.org/10.1016/j.comcom.2022.05.035.
   Web of Science ®Google Scholar
• Galieni, A., N. Nicastro, A. Pentangelo, C. Platani, T. Cardi, and C. Pane. 2022. “Surveying Soil-Borne Disease Development on Wild Rocket Salad Crop by Proximal Sensing Based on High-Resolution Hyperspectral Features.” Scientific Reports 12: 5098. https://doi.org/10.1038/s41598-022-08969-5.
   PubMed Web of Science ®Google Scholar
• Gao, Q., F. Xie, D. Huang, and C. Jin. 2022. “Spectral and Spatial Reduction of Hyperspectral Image Guided by Data Reconstruction and Superpixels.” Engineering Applications of Artificial Intelligence 111: 104803. https://doi.org/10.1016/j.engappai.2022.104803.
   Web of Science ®Google Scholar
• Gimeno, P., V. Mingote, A. Ortega, A. Miguel, and E. Lleida. 2021. “Generalizing AUC Optimization to Multiclass Classification for Audio Segmentation with Limited Training Data.” IEEE Signal Processing Letters 28: 1135–1139. https://doi.org/10.1109/LSP.2021.3084501.
   Web of Science ®Google Scholar
• Gong, H., Q. Li, C. Li, H. Dai, Z. He, W. Wang, H. Li, F. Han, A. Tuniyazi, and T. Mu. 2021. “Multiscale Information Fusion for Hyperspectral Image Classification Based on Hybrid 2D-3D CNN.” Remote Sensing 13 (12): 2268. https://doi.org/10.3390/rs13122268.
   Web of Science ®Google Scholar
• Hammond, D. K., P. Vandergheynst, and R. Gribonval. 2011. “Wavelets on Graphs via Spectral Graph Theory.” Applied and Computational Harmonic Analysis 30 (2): 129–150. https://doi.org/10.1016/j.acha.2010.04.005.
   Web of Science ®Google Scholar
• Hänsch, R., and O. Hellwich. 2021. “Fusion of Multispectral LiDAR, Hyperspectral, and RGB Data for Urban Land Cover Classification.” IEEE Geoscience and Remote Sensing Letters 18 (2): 366–370. https://doi.org/10.1109/LGRS.2020.2972955.
   Web of Science ®Google Scholar
• He, Q., X. Sun, Z. Yan, and K. Fu. 2022a. “DABNet: Deformable Contextual and Boundary-Weighted Network for Cloud Detection in Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 60: 5601216.
   Web of Science ®Google Scholar
• He, Q., X. Sun, Z. Yan, B. Li, and K. Fu. 2022b. “Multi-Object Tracking in Satellite Videos with Graph-Based Multitask Modeling.” IEEE Transactions on Geoscience and Remote Sensing 60: 5619513.
   Web of Science ®Google Scholar
• Hong, S., K. Cho, S. Park, T. Kang, M. Kim, G. Nam, and J. Pyo. 2022. “Estimation of Cyanobacteria Pigments in the Main Rivers of South Korea Using Spatial Attention Convolutional Neural Network with Hyperspectral Imagery.” GIScience & Remote Sensing 59 (1): 547–567. https://doi.org/10.1080/15481603.2022.2037887.
   Web of Science ®Google Scholar
• Hong, D., L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot. 2021. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (7): 5966–5978. https://doi.org/10.1109/TGRS.2020.3015157.
   Web of Science ®Google Scholar
• Hong, D., N. Yokoya, G. Xia, J. Chanussot, and X. Zhu. 2020. “X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data.” ISPRS Journal of Photogrammetry and Remote Sensing 167: 12–23. https://doi.org/10.1016/j.isprsjprs.2020.06.014.
   PubMed Web of Science ®Google Scholar
• Irteza, S., J. Nichol, W. Shi, and S. Abbas. 2021. “NDVI and Fluorescence Indicators of Seasonal and Structural Changes in a Tropical Forest Succession.” Earth Systems and Environment 5: 127–133. https://doi.org/10.1007/s41748-020-00175-5.
   Google Scholar
• Jia, S., Z. Zhan, M. Zhang, M. Xu, Q. Huang, J. Zhou, and X. Jia. 2021. “Multiple Feature-Based Superpixel-Level Decision Fusion for Hyperspectral and LiDAR Data Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (2): 1437–1452. https://doi.org/10.1109/TGRS.2020.2996599.
   Web of Science ®Google Scholar
• Jiang, M., X. Zhang, Y. Sun, W. Feng, Q. Gan, and Y. Ruan. 2022. “AFSNet: Attention-Guided Full-Scale Feature Aggregation Network for High-Resolution Remote Sensing Image Change Detection.” GIScience & Remote Sensing 59 (1): 1882–1900. https://doi.org/10.1080/15481603.2022.2142626.
   Web of Science ®Google Scholar
• Ke, H., D. Chen, X. Li, Y. Tang, T. Shah, and R. Ranjan. 2018. “Towards Brain Big Data Classification: Epileptic EEG Identification With a Lightweight VGGNet on Global MIC.” IEEE Access 6: 14722–14733. https://doi.org/10.1109/ACCESS.2018.2810882.
   Web of Science ®Google Scholar
• Kipf, T. N., and M. Welling. 2017. “Semi-supervised Classification with Graph Convolutional Networks.” International Conference on Learning Representations (ICLR), 1–14.
   Google Scholar
• Li, M., H. Chen, and Z. Cheng. 2022. “An Attention-Guided Spatiotemporal Graph Convolutional Network for Sleep Stage Classification.” Life (chicago, Ill 12 (5): 622. https://doi.org/10.3390/life12050622.
   PubMedGoogle Scholar
• Li, Z., Q. Ling, J. Wu, Z. Wang, and Z. Lin. 2020. “A Constrained Sparse-Representation-Based Spatio-Temporal Anomaly Detector for Moving Targets in Hyperspectral Imagery Sequences.” Remote Sensing 12 (17): 2783. https://doi.org/10.3390/rs12172783.
   Web of Science ®Google Scholar
• Li, X., and H. Ning. 2020. “Deep Pyramid Convolutional Neural Network Integrated with Self-attention Mechanism and Highway Network for Text Classification.” Journal of Physics: Conference Series, 1642.
   Google Scholar
• Li, W., G. Wu, and F. Zhang. 2017. “Hyperspectral Image Classification Using Deep Pixel-Pair Features.” IEEE Transactions on Geoscience and Remote Sensing 55 (2): 844–853. https://doi.org/10.1109/TGRS.2016.2616355.
   Web of Science ®Google Scholar
• Liu, T., A. Abd-EIrahman, J. Morton, and V. L. Wilhelm. 2018a. “Comparing Fully Convolutional Networks, Random Forest, Support Vector Machine, and Patch-Based Deep Convolutional Neural Networks for Object-Based Wetland Mapping Using Images from Small Unmanned Aircraft System.” GIScience & Remote Sensing 55 (2): 243–264. https://doi.org/10.1080/15481603.2018.1426091.
   Web of Science ®Google Scholar
• Liu, Y., F. Condessa, J. M. Bioucas-Dias, P. Du, and A. Plaza. 2018b. “Convex Formulation for Multiband Image Classification With Superpixel-Based Spatial Regularization.” IEEE Transactions on Geoscience and Remote Sensing 56: 2704–2721. https://doi.org/10.1109/TGRS.2017.2782005.
   Web of Science ®Google Scholar
• Liu, M., O. Tuzel, S. Ramalingam, and R. Chellappa. 2011. “Entropy Rate Superpixel Segmentation.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs CO USA 20–25 June 2097–2104.
   Google Scholar
• Liu, B., Y. Wei, Y. Zhang, and Q. Yang. 2017. “Deep Neural Networks for High Dimension, low Sample Size Data.” Proceedings of the 21 International Joint Conference on Artificial Intelligence (IJCAI), Melbourne, Australia, 19–25, August, 2287–2293.
   Google Scholar
• Lu, Y., T. James, C. Schillaci, and A. Lipani. 2022. “Snow Detection in Alpine Regions with Convolutional Neural Networks: Discriminating Snow from Cold Clouds and Water Body.” GIScience & Remote Sensing 59 (1): 1321–1343. https://doi.org/10.1080/15481603.2022.2112391.
   Web of Science ®Google Scholar
• Makantasis, K., K. Karantzalos, A. Doulamis, and N. Doulamis. 2015. “Deep Supervised Learning for Hyperspectral Data Classification Through Convolutional Neural Networks.” IEEE International Geoscience And Remote Sensing Symposium (IGARSS), 4959–4962. https://doi.org/10.1109/IGARSS.2015.7326945.
   Google Scholar
• Masolele, R., V. Sy, D. Marcos, J. Verbesselt, F. Gieseke, K. Mulatu, Y. Moges, H. Sebrala, C. Martius, and M. Herold. 2022. “Using High-Resolution Imagery and Deep Learning to Classify Land-use Following Deforestation: A Case Study in Ethiopia.” GIScience & Remote Sensing 59 (1): 1446–1472. https://doi.org/10.1080/15481603.2022.2115619.
   Web of Science ®Google Scholar
• Mei, X., E. Pan, Y. Ma, X. Dai, J. Huang, F. Fan, Q. Du, H. Zheng, and J. Ma. 2019b. “Spectral-Spatial Attention Networks for Hyperspectral Image Classification.” Remote Sensing 11 (8): 963. https://doi.org/10.3390/rs11080963.
   Web of Science ®Google Scholar
• Mei, J., Y. Wang, L. Zhang, B. Zhang, S. Liu, P. Zhu, and Y. Ren. 2019a. “PSASL: Pixel-Level and Superpixel-Level Aware Subspace Learning for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 57 (7): 4278–4293. https://doi.org/10.1109/TGRS.2018.2890508.
   Web of Science ®Google Scholar
• Mukherjee, F., and D. Singh. 2020. “Assessing Land Use-Land Cover Change and Its Impact on Land Surface Temperature Using LANDSAT Data: A Comparison of Two Urban Areas in India.” Earth Systems and Environment 4: 385–407. https://doi.org/10.1007/s41748-020-00155-9.
   Google Scholar
• Nguyen, D., and K. Zettsu. 2021. “Spatially-distributed Federated Learning of Convolutional Recurrent Neural Networks for Air Pollution Prediction.” 2021 IEEE International Conference on Big Data, 3601–3608. https://doi.org/10.1109/BigData52589.2021.9671336.
   Google Scholar
• Otsu, N. 1979. “A Threshold Selection Method from Gray-Level Histograms.” IEEE Transactions on Systems, Man, and Cybernetics 9: 62–66. https://doi.org/10.1109/TSMC.1979.4310076.
   Web of Science ®Google Scholar
• Park, S., and A. Song. 2020. “Discrepancy Analysis for Detecting Candidate Parcels Requiring Update of Land Category in Cadastral Map Using Hyperspectral UAV Images: A Case Study in Jeonju, South Korea.” Remote Sensing 12 (3): 354. https://doi.org/10.3390/rs12030354.
   Web of Science ®Google Scholar
• Qin, A., Z. Shang, J. Tian, Y. Wang, T. Zhang, and Y. Tang. 2019. “Spectral-spatial Graph Convolutional Networks for Semisupervised Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 16: 241–245. https://doi.org/10.1109/LGRS.2018.2869563.
   Web of Science ®Google Scholar
• Rao, M., P. Tang, and Z. Zhang. 2019. “Spatial-Spectral Relation Network for Hyperspectral Image Classification with Limited Training Samples.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (12): 5086–5100. https://doi.org/10.1109/JSTARS.2019.2957047.
   Web of Science ®Google Scholar
• Ruan, K., S. Zhao, X. Jiang, Y. Li, J. Fei, D. Ou, Q. Tang, Z. Lu, T. Liu, and J. Xia. 2022. “A 3D Fluorescence Classification and Component Prediction Method Based on VGG Convolutional Neural Network and PARAFAC Analysis Method.” Applied Sciences 12 (10): 4886. https://doi.org/10.3390/app12104886.
   Google Scholar
• Shahraki, F. F., and S. Prasad. 2018. “Graph Convolutional Neural Networks for Hyperspectral Data Classification.” IEEE Global Conference on Signal and Information Processing 968-972.
   Google Scholar
• Sun, X., P. Wang, Z. Yan, F. Xu, R. Wang, W. Diao, J. Chen, et al. 2022. “FAIR1M: A Benchmark Dataset for Fine-Grained Object Recognition in High-Resolution Remote Sensing Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 184: 116–130. https://doi.org/10.1016/j.isprsjprs.2021.12.004.
   Web of Science ®Google Scholar
• Vincent, L., and P. Soille. 1991. “Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations.” IEEE Transactions on Pattern Analysis and Machine Intelligence 13 (6): 583–598. https://doi.org/10.1109/34.87344.
   Web of Science ®Google Scholar
• Wan, S., C. Gong, P. Zhong, B. Du, L. Zhang, and J. Yang. 2020. “Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (5): 3162–3177. https://doi.org/10.1109/TGRS.2019.2949180.
   Web of Science ®Google Scholar
• Wang, H., Y. Cheng, C. Chen, and X. Wang. 2021. “Semisupervised Classification of Hyperspectral Image Based on Graph Convolutional Broad Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14: 2995–3005. https://doi.org/10.1109/JSTARS.2021.3062642.
   Web of Science ®Google Scholar
• Wold, S., K. Esbensen, and P. Geladi. 1987. “Principal Component Analysis.” Chemometrics and Intelligent Laboratory Systems 2: 37–52. https://doi.org/10.1016/0169-7439(87)80084-9.
   Web of Science ®Google Scholar
• Xie, F., Q. Gao, C. Jin, and F. Zhao. 2021. “Hyperspectral Image Classification Based on Superpixel Pooling Convolutional Neural Network with Transfer Learning.” Remote Sensing 13 (5): 930. https://doi.org/10.3390/rs13050930.
   Web of Science ®Google Scholar
• Xie, F., C. Lei, C. Jin, and A. An. 2020. “A Novel Spectral-Spatial Classification Method for Hyperspectral Image at Superpixel Level.” Applied Sciences 10 (2): 463. https://doi.org/10.3390/app10020463.
   Google Scholar
• Xu, H., H. Zhang, W. He, and L. Zhang. 2019. “Superpixel-based Spatial-Spectral Dimension Reduction for Hyperspectral Imagery Classification.” Neurocomputing 360: 138–150. https://doi.org/10.1016/j.neucom.2019.06.023.
   Web of Science ®Google Scholar
• Yang, J., H. Li, W. Hu, L. Pan, and Q. Du. 2022. “Adaptive Cross-Attention-Driven Spatial–Spectral Graph Convolutional Network for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19: 1–5.
   Google Scholar
• Ye, M., R. Ni, C. Zhang, H. Gong, T. Hu, S. Li, Y. Sun, T. Zhang, and Y. Guo. 2021. “A Lightweight Model of VGG-16 for Remote Sensing Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14: 6916–6922. https://doi.org/10.1109/JSTARS.2021.3090085.
   Google Scholar
• Zhang, X., S. Chen, P. Zhu, X. Tang, J. Feng, and L. Jiao. 2022. “Spatial Pooling Graph Convolutional Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–15.
   Google Scholar
• Zhang, Y., X. Jiang, X. Wang, and Z. Cai. 2019. “Spectral-Spatial Hyperspectral Image Classification with Superpixel Pattern and Extreme Learning Machine.” Remote Sensing 11 (17): 1983.
   Web of Science ®Google Scholar
• Zhang, H., Y. Li, Y. Zhang, and Q. Shen. 2017. “Spectral-spatial Classification of Hyperspectral Imagery Using a Dual-Channel Convolutional Neural Network.” Remote Sensing Letters 8 (5): 438–447. https://doi.org/10.1080/2150704X.2017.1280200.
   Web of Science ®Google Scholar
• Zhang, M., H. Luo, W. Song, H. Mei, and C. Su. 2021. “Spectral-Spatial Offset Graph Convolutional Networks for Hyperspectral Image Classification.” Remote Sensing 13 (21): 4342–4364. https://doi.org/10.3390/rs13214342.
   Web of Science ®Google Scholar
• Zhang, L., H. Su, and J. Shen. 2019. “Hyperspectral Dimensionality Reduction Based on Multiscale Superpixelwise Kernel Principal Component Analysis.” Remote Sensing 11 (10): 1219. https://doi.org/10.3390/rs11101219.
   Web of Science ®Google Scholar
• Zhao, Y., F. Su, and F. Yan. 2020. “Novel Semi-Supervised Hyperspectral Image Classification Based on a Superpixel Graph and Discrete Potential Method.” Remote Sensing 12 (9): 15280.
   Web of Science ®Google Scholar
• Zheng, Z., Y. Zhong, A. Ma, and L. Zhang. 2020. “FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 58 (8): 5612–5626. https://doi.org/10.1109/TGRS.2020.2967821.
   Web of Science ®Google Scholar
• Zhong, Y., X. Hu, C. Luo, X. Wang, J. Zhao, and L. Zhang. 2020. “WHU-Hi: Uav-Borne Hyperspectral with High Spatial Resolution (H2) Benchmark Datasets and Classifier for Precise Crop Identification Based on Deep Convolutional Neural Network with CRF.” Remote Sensing of Environment 250: 112012. https://doi.org/10.1016/j.rse.2020.112012.
   Web of Science ®Google Scholar
• Zhong, Z., J. Li, Z. Luo, and M. Chapman. 2018b. “Spectral-spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework.” IEEE Transactions on Geoscience and Remote Sensing 56 (2): 847–858. https://doi.org/10.1109/TGRS.2017.2755542.
   Web of Science ®Google Scholar
• Zhong, Y., X. Wang, Y. Xu, S. Wang, T. Jia, X. Hu, J. Zhao, L. Wei, and L. Zhang. 2018a. “Mini-UAV-borne Hyperspectral Remote Sensing: From Observation and Processing to Applications.” IEEE Geoscience and Remote Sensing Magazine 6 (4): 46–62. https://doi.org/10.1109/MGRS.2018.2867592.
   Web of Science ®Google Scholar
• Zhou, B., X. Zhang, X. Chen, M. Ren, and Z. Feng. 2023. “HyperRefiner: A Refined Hyperspectral Pansharpening Network Based on the Autoencoder and Self-Attention.” International Journal of Digital Earth 16 (1): 3268–3294. https://doi.org/10.1080/17538947.2023.2246944.
   Web of Science ®Google Scholar