Dual convolutional network based on hypergraph and multilevel feature fusion for road extraction from high-resolution remote sensing images

References

• Abdollahi, Abolfazl, Biswajeet Pradhan, Nagesh Shukla, Subrata Chakraborty, and Abdullah Alamri. 2020. “Deep Learning Approaches Applied to Remote Sensing Datasets for Road Extraction: A State-of-the-Art Review.” Remote Sensing 12 (9): 1444. https://doi.org/10.3390/rs12091444.
   Web of Science ®Google Scholar
• Achanta, Radhakrishna, Appu Shaji, Kevin Smith, Aurelien Lucchi, Pascal Fua, and Sabine Süsstrunk. 2012. “SLIC Superpixels Compared to State-of-the-Art Superpixel Methods.” IEEE Transactions on Pattern Analysis and Machine Intelligence 34 (11): 2274–2282. https://doi.org/10.1109/TPAMI.2012.120.
   PubMed Web of Science ®Google Scholar
• Badrinarayanan, Vijay, Alex Kendall, and Roberto Cipolla. 2017. “Segnet: A Deep Convolutional Encoder–Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. https://doi.org/10.1109/TPAMI.34.
   PubMed Web of Science ®Google Scholar
• Bai, Song, Feihu Zhang, and Philip H. S. Torr. 2021. “Hypergraph Convolution and Hypergraph Attention.” Pattern Recognition 110:107637. https://doi.org/10.1016/j.patcog.2020.107637.
   Web of Science ®Google Scholar
• Bandara, Wele Gedara Chaminda, Jeya Maria Jose Valanarasu, and Vishal M. Patel. 2022. “SPIN Road Mapper: Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Driving.” In 2022 International Conference on Robotics and Automation (ICRA), 343–350.
   Google Scholar
• Barrile, Vincenzo, Giuliana Bilotta, Antonino Fotia, and Ernesto Bernardo. 2020. “Road Extraction for Emergencies from Satellite Imagery.” In Computational Science and Its Applications – ICCSA 2020, 767–781. Springer International Publishing.
   Google Scholar
• Bastani, Favyen, and Samuel Madden. 2021. “Beyond Road Extraction: A Dataset for Map Update Using Aerial Images.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 11905–11914.
   Google Scholar
• Chai, Junyi, Hao Zeng, Anming Li, and Eric W. T. Ngai. 2021. “Deep Learning in Computer Vision: A Critical Review of Emerging Techniques and Application Scenarios.” Machine Learning with Applications 6:100134. https://doi.org/10.1016/j.mlwa.2021.100134.
   Google Scholar
• Chen, Liang-Chieh, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. 2014. “Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected crfs.” arXiv preprint arXiv:1412.7062.
   Google Scholar
• Chen, Liang-Chieh, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 834–848. https://doi.org/10.1109/TPAMI.2017.2699184.
   PubMed Web of Science ®Google Scholar
• Chen, Liang-Chieh, George Papandreou, Florian Schroff, and Hartwig Adam. 2017. “Rethinking Atrous Convolution for Semantic Image Segmentation.” arXiv preprint arXiv:1706.05587.
   Google Scholar
• Chen, Yunpeng, Marcus Rohrbach, Zhicheng Yan, Yan Shuicheng, Jiashi Feng, and Yannis Kalantidis. 2019. “Graph-Based Global Reasoning Networks.” In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 433–442. IEEE.
   Google Scholar
• Chen, Liang-Chieh, Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. 2018. “Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation.” In Proceedings of the European Conference on Computer Vision (ECCV), 801–818.
   Google Scholar
• Cui, Fumin, Yichang Shi, Ruyi Feng, Lizhe Wang, and Tieyong Zeng. 2022. “A Graph-Based Dual Convolutional Network for Automatic Road Extraction from High Resolution Remote Sensing Images.” In IGARSS 2022 -- 2022 IEEE International Geoscience and Remote Sensing Symposium, 3015–3018.
   Google Scholar
• Dai, Ling, Guangyun Zhang, and Rongting Zhang. 2023. “RADANet: Road Augmented Deformable Attention Network for Road Extraction From Complex High-Resolution Remote-Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 61:1–13.
   Web of Science ®Google Scholar
• Guo, Meng-Hao, Tian-Xing Xu, Jiang-Jiang Liu, Zheng-Ning Liu, Peng-Tao Jiang, Tai-Jiang Mu, Song-Hai Zhang, et al. 2022. “Attention Mechanisms in Computer Vision: A Survey.” Computational Visual Media 8 (3): 331–368. https://doi.org/10.1007/s41095-022-0271-y.
   Google Scholar
• He, Kaiming, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. “Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778.
   Google Scholar
• Huang, Bo, Bei Zhao, and Yimeng Song. 2018. “Urban Land-Use Mapping Using a Deep Convolutional Neural Network with High Spatial Resolution Multispectral Remote Sensing Imagery.” Remote Sensing of Environment 214:73–86. https://doi.org/10.1016/j.rse.2018.04.050.
   Web of Science ®Google Scholar
• Kipf, Thomas N., and Max Welling. 2016. “Semi-Supervised Classification with Graph Convolutional Networks.” arXiv preprint arXiv:1609.02907.
   Google Scholar
• Kumar, V. Suresh, Ahmed Alemran, Dimitrios A. Karras, Shashi Kant Gupta, Chandra Kumar Dixit, and Bhadrappa Haralayya. 2022. “Natural Language Processing Using Graph Neural Network for Text Classification.” In 2022 International Conference on Knowledge Engineering and Communication Systems (ICKES), 1–5. IEEE.
   Google Scholar
• Li, Weijia, Haohuan Fu, Le Yu, and Arthur Cracknell. 2016. “Deep Learning Based Oil Palm Tree Detection and Counting for High-resolution Remote Sensing Images.” Remote Sensing 9 (1): 22. https://doi.org/10.3390/rs9010022.
   Web of Science ®Google Scholar
• Liu, Ze, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 10012–10022.
   Google Scholar
• Liu, Xiangzeng, Ziyao Wang, Jinting Wan, Juli Zhang, Yue Xi, Ruyi Liu, and Qiguang Miao. 2023. “RoadFormer: Road Extraction Using a Swin Transformer Combined with a Spatial and Channel Separable Convolution.” Remote Sensing 15 (4): 1049. https://doi.org/10.3390/rs15041049.
   Web of Science ®Google Scholar
• Liu, Pengfei, Qing Wang, Gaochao Yang, Lu Li, and Huan Zhang. 2022. “Survey of Road Extraction Methods in Remote Sensing Images Based on Deep Learning.” PFG–Journal of Photogrammetry, Remote Sensing and Geoinformation Science 90 (2): 135–159. https://doi.org/10.1007/s41064-022-00194-z.
   Web of Science ®Google Scholar
• Liu, Bo, Huayi Wu, Yandong Wang, and Wenming Liu. 2015. “Main Road Extraction From ZY-3 Grayscale Imagery Based on Directional Mathematical Morphology and VGI Prior Knowledge in Urban Areas.” PLoS One 10 (9): e0138071. https://doi.org/10.1371/journal.pone.0138071.
   PubMed Web of Science ®Google Scholar
• Liu, Sicong, Yongjie Zheng, Qian Du, Lorenzo Bruzzone, Alim Samat, Xiaohua Tong, Yanmin Jin, and Chao Wang. 2022. “A Shallow-to-Deep Feature Fusion Network for VHR Remote Sensing Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–13.
   Google Scholar
• Long, Jonathan, Evan Shelhamer, and Trevor Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3431–3440.
   Google Scholar
• Luo, Xiaoyi, Jiaheng Peng, and Jun Liang. 2022. “Directed Hypergraph Attention Network for Traffic Forecasting.” IET Intelligent Transport Systems 16 (1): 85–98. https://doi.org/10.1049/itr2.v16.1.
   Web of Science ®Google Scholar
• Maurya, Rohit, P. R. Gupta, and Ajay Shankar Shukla. 2011. “Road Extraction Using K-Means Clustering and Morphological Operations.” In 2011 International Conference on Image Information Processing, 1–6. IEEE.
   Google Scholar
• Meyer, Eivind, Maurice Brenner, Bowen Zhang, Max Schickert, Bilal Musani, and Matthias Althoff. 2023. “Geometric Deep Learning for Autonomous Driving: Unlocking the Power of Graph Neural Networks With CommonRoad-Geometric.”
   Google Scholar
• Mnih, Volodymyr. 2013. “Machine Learning for Aerial Image Labeling.” PhD diss., University of Toronto.
   Google Scholar
• Movaghati, Sahar, Alireza Moghaddamjoo, and Ahad Tavakoli. 2010. “Road Extraction From Satellite Images Using Particle Filtering and Extended Kalman Filtering.” IEEE Transactions on Geoscience and Remote Sensing 48 (7): 2807–2817. https://doi.org/10.1109/TGRS.36.
   Web of Science ®Google Scholar
• Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18, 234–241. Springer.
   Google Scholar
• Senthilnath, J., M. Rajeshwari, and S. N. Omkar. 2009. “Automatic Road Extraction Using High Resolution Satellite Image Based on Texture Progressive Analysis and Normalized Cut Method.” Journal of the Indian Society of Remote Sensing 37 (3): 351–361. https://doi.org/10.1007/s12524-009-0043-5.
   Web of Science ®Google Scholar
• Sghaier, Moslem Ouled, and Richard Lepage. 2015. “Road Extraction From Very High Resolution Remote Sensing Optical Images Based on Texture Analysis and Beamlet Transform.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9 (5): 1946–1958. https://doi.org/10.1109/JSTARS.4609443.
   Web of Science ®Google Scholar
• Sun, Le, Guangrui Zhao, Yuhui Zheng, and Zebin Wu. 2022. “Spectral Spatial Feature Tokenization Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–14.
   Google Scholar
• Szegedy, Christian, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. “Going Deeper with Convolutions.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–9.
   Google Scholar
• Tong, Xin-Yi, Gui-Song Xia, Qikai Lu, Huanfeng Shen, Shengyang Li, Shucheng You, and Liangpei Zhang. 2020. “Land-cover Classification with High-resolution Remote Sensing Images Using Transferable Deep Models.” Remote Sensing of Environment 237:111322. https://doi.org/10.1016/j.rse.2019.111322.
   Web of Science ®Google Scholar
• Wan, Jie, Zhong Xie, Yongyang Xu, Siqiong Chen, and Qinjun Qiu. 2021. “DA-RoadNet: A Dual-Attention Network for Road Extraction From High Resolution Satellite Imagery.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14:6302–6315. https://doi.org/10.1109/JSTARS.2021.3083055.
   Web of Science ®Google Scholar
• Wang, Panqu, Pengfei Chen, Ye Yuan, Ding Liu, Zehua Huang, Xiaodi Hou, and Garrison Cottrell. 2018. “Understanding Convolution for Semantic Segmentation.” In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 1451–1460. IEEE.
   Google Scholar
• Wang, Junjie, Wei Li, Yunhao Gao, Mengmeng Zhang, Ran Tao, and Qian Du. 2023. “Hyperspectral and SAR Image Classification Via Multiscale Interactive Fusion Network.” IEEE Transactions on Neural Networks and Learning Systems 34: 10823–10837.
   PubMed Web of Science ®Google Scholar
• Wang, Ying, Yuexing Peng, Wei Li, George C. Alexandropoulos, Junchuan Yu, Daqing Ge, and Wei Xiang. 2022. “DDU-Net: Dual-Decoder-U-Net for Road Extraction Using High-Resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 60:1–12.
   Web of Science ®Google Scholar
• Wang, Xianghai, Keyun Zhao, Xiaoyang Zhao, and Siyao Li. 2022. “CSDBF: Dual-Branch Framework Based on Temporal–Spatial Joint Graph Attention With Complement Strategy for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience and Remote Sensing 60:1–18.
   Web of Science ®Google Scholar
• Xie, Yan, Fang Miao, Kai Zhou, and Jing Peng. 2019. “HsgNet: A Road Extraction Network Based on Global Perception of High-Order Spatial Information.” ISPRS International Journal of Geo-Information8 (12): 571. https://doi.org/10.3390/ijgi8120571.
   Web of Science ®Google Scholar
• Xu, Yingxiao, Hao Chen, Chun Du, and Jun Li. 2021. “MSACon: Mining Spatial Attention-Based Contextual Information for Road Extraction.” IEEE Transactions on Geoscience and Remote Sensing60:1–17.
   Web of Science ®Google Scholar
• Xu, Zhenhua, Yuxiang Sun, and Ming Liu. 2021. “icurb: Imitation Learning-based Detection of Road Curbs Using Aerial Images for Autonomous Driving.” IEEE Robotics and Automation Letters 6 (2): 1097–1104. https://doi.org/10.1109/LSP.2016..
   Web of Science ®Google Scholar
• Yang, Liangwei, Zhiwei Liu, Yingtong Dou, Jing Ma, and Philip S. Yu. 2021. “ConsisRec: Enhancing GNN for Social Recommendation via Consistent Neighbor Aggregation.” In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2141–2145.
   Google Scholar
• Yang, Zhigang, Daoxiang Zhou, Ying Yang, Jiapeng Zhang, and Zehua Chen. 2022. “TransRoadNet: A Novel Road Extraction Method for Remote Sensing Images Via Combining High-Level Semantic Feature and Context.” IEEE Geoscience and Remote Sensing Letters 19:1–5.
   Web of Science ®Google Scholar
• Yang, Zhigang, Daoxiang Zhou, Ying Yang, Jiapeng Zhang, and Zehua Chen. 2023. “Road Extraction From Satellite Imagery by Road Context and Full-Stage Feature.” IEEE Geoscience and Remote Sensing Letters 20:1–5.
   Web of Science ®Google Scholar
• Zhang, Xinyu, Yu Jiang, Lizhe Wang, Wei Han, Ruyi Feng, Runyu Fan, and Sheng Wang. 2022. “Complex Mountain Road Extraction in High-Resolution Remote Sensing Images Via a Light Roadformer and a New Benchmark.” Remote Sensing 14 (19): 4729. https://doi.org/10.3390/rs14194729.
   Web of Science ®Google Scholar
• Zhang, Mengmeng, Wei Li, Yuxiang Zhang, Ran Tao, and Qian Du. 2023. “Hyperspectral and LiDAR Data Classification Based on Structural Optimization Transmission.” IEEE Transactions on Cybernetics53 (5): 3153–3164. https://doi.org/10.1109/TCYB.2022.3169773.
   PubMed Web of Science ®Google Scholar
• Zhang, Zhengxin, Qingjie Liu, and Yunhong Wang. 2018. “Road Extraction by Deep Residual U-Net.” IEEE Geoscience and Remote Sensing Letters 15 (5): 749–753. https://doi.org/10.1109/LGRS.2018.2802944.
   Web of Science ®Google Scholar
• Zhang, Xiangrong, Wenkang Ma, Chen Li, Jie Wu, Xu Tang, and Licheng Jiao. 2019. “Fully Convolutional Network-Based Ensemble Method for Road Extraction From Aerial Images.” IEEE Geoscience and Remote Sensing Letters 17 (10): 1777–1781. https://doi.org/10.1109/LGRS.8859.
   Web of Science ®Google Scholar
• Zhang, Yingying, Junping Zhang, Tong Li, and Ke Sun. 2016. “Road Extraction and Intersection Detection Based on Tensor Voting.” In 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 1587–1590. IEEE.
   Google Scholar
• Zhong, Zilong, Jonathan Li, Weihong Cui, and Han Jiang. 2016. “Fully Convolutional Networks for Building and Road Extraction: Preliminary Results.” In 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 1591–1594. IEEE.
   Google Scholar
• Zhou, Gaodian, Weitao Chen, Qianshan Gui, Xianju Li, and Lizhe Wang. 2022. “Split Depth-Wise Separable Graph-Convolution Network for Road Extraction in Complex Environments From High-Resolution Remote-Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing60:1–15.
   Web of Science ®Google Scholar
• Zhou, Lichen, Chuang Zhang, and Ming Wu. 2018. “D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 182–186.
   Google Scholar
• Zhu, Qiqi, Yanan Zhang, Lizeng Wang, Yanfei Zhong, Qingfeng Guan, Xiaoyan Lu, Liangpei Zhang, and Deren Li. 2021. “A Global Context-Aware and Batch-Independent Network for Road Extraction From VHR Satellite Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 175:353–365. https://doi.org/10.1016/j.isprsjprs.2021.03.016.
   Web of Science ®Google Scholar