Vectorizing planar roof structure from very high resolution remote sensing images using transformers

References

• Biljecki, Filip, Hugo Ledoux, Jantien Stoter, and George Vosselman. 2016. “The Variants of an LOD of a 3D Building Model and Their Influence on Spatial Analyses.” ISPRS Journal of Photogrammetry and Remote Sensing 116:42–54. https://doi.org/10.1016/j.isprsjprs.2016.03.003.
   Web of Science ®Google Scholar
• Carion, Nicolas, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020. “End-to-End Object Detection with Transformers.” In European Conference on Computer Vision, 213–229. Springer.
   Google Scholar
• Chen, Jiacheng, Yiming Qian, and Yasutaka Furukawa. 2022. “HEAT: Holistic Edge Attention Transformer for Structured Reconstruction.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3866–3875, New Orleans, Louisiana, USA.
   Google Scholar
• Chen, Qi, Lei Wang, Steven L. Waslander, and Xiuguo Liu. 2020. “An End-to-End Shape Modeling Framework for Vectorized Building Outline Generation From Aerial Images.” ISPRS Journal of Photogrammetry and Remote Sensing 170:114–126. https://doi.org/10.1016/j.isprsjprs.2020.10.008.
   Web of Science ®Google Scholar
• Chen, Liang-Chieh, Yi Yang, Jiang Wang, Wei Xu, and Alan L Yuille. 2016. “Attention to Scale: Scale-Aware Semantic Image Segmentation.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3640–3649, Las Vegas, Nevada, USA.
   Google Scholar
• Esmaeily, Zahra, and Mehdi Rezaeian. 2023. “Building Roof Wireframe Extraction From Aerial Images Using a Three-Stream Deep Neural Network.” Journal of Electronic Imaging 32 (1): 013001–013001. https://doi.org/10.1117/1.JEI.32.1.013001.
   Web of Science ®Google Scholar
• Fu, Jun, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019. “Dual Attention Network for Scene Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3146–3154, Long Beach Convention & Entertainment Center, Los Angeles CA, USA.
   Google Scholar
• Hu, Jie, Li Shen, and Gang Sun. 2018. “Squeeze-and-Excitation Networks.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 7132–7141, Salt Lake City, UT, USA.
   Google Scholar
• Ji, Shunping, Shiqing Wei, and Meng Lu. 2018. “Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set.” IEEE Transactions on Geoscience and Remote Sensing 57 (1): 574–586. https://doi.org/10.1109/TGRS.2018.2858817.
   Web of Science ®Google Scholar
• Konishi, Scott, Alan L. Yuille, James M. Coughlan, and Song Chun Zhu. 2003. “Statistical Edge Detection: Learning and Evaluating Edge Cues.” IEEE Transactions on Pattern Analysis and Machine Intelligence25 (1): 57–74. https://doi.org/10.1109/TPAMI.2003.1159946.
   Web of Science ®Google Scholar
• Le, Khoa N., Kishor P. Dabke, and Gregory K. Egan. 2006. “On Mathematical Derivations of Auto-Term Functions and Signal-to-Noise Ratios of the Choi–Williams, First-and Nth-order Hyperbolic Kernels.” Digital Signal Processing 16 (1): 84–104. https://doi.org/10.1016/j.dsp.2005.04.006.
   Web of Science ®Google Scholar
• Lin, Tsung-Yi, Piotr Dollár, Ross Girshick, Kaiming He, Bharath Hariharan, and Serge Belongie. 2017. “Feature Pyramid Networks for Object Detection.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2117–2125, Honolulu, Hawaii, USA.
   Google Scholar
• Lin, Moule, Weipeng Jing, Chao Li, and András Jung. 2023. “Optimized Vectorizing of Building Structures with Swap: High-Efficiency Convolutional Channel-Swap Hybridization Strategy.” arXiv preprint arXiv:2306.15035.
   Google Scholar
• Lin, Yancong, Silvia L. Pintea, and Jan C. van Gemert. 2020. “Deep Hough-Transform Line Priors.” In European Conference on Computer Vision, 323–340. Springer.
   Google Scholar
• Liu, Zhengyu, Qian Shi, and Jinpei Ou. 2022. “LCS: A Collaborative Optimization Framework of Vector Extraction and Semantic Segmentation for Building Extraction.” IEEE Transactions on Geoscience and Remote Sensing 60:1–15.
   Web of Science ®Google Scholar
• Lu, Ziqiong, Linxi Huan, Qiyuan Ma, and Xianwei Zheng. 2023. “Holistic Geometric Feature Learning for Structured Reconstruction.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 21807–21817, Paris, France.
   Google Scholar
• Lv, Xianwei, Zhenfeng Shao, Xiao Huang, Wen Zhou, Dongping Ming, Jiaming Wang, and Chengzhuo Tong. 2022. “BTS: A Binary Tree Sampling Strategy for Object Identification Based on Deep Learning.” International Journal of Geographical Information Science 36 (4): 822–848. https://doi.org/10.1080/13658816.2021.1980883.
   Web of Science ®Google Scholar
• Lv, Xianwei, Zhenfeng Shao, Dongping Ming, Chunyuan Diao, Keqi Zhou, and Chengzhuo Tong. 2021. “Improved Object-Based Convolutional Neural Network (IOCNN) to Classify Very High-Resolution Remote Sensing Images.” International Journal of Remote Sensing 42 (21): 8318–8344. https://doi.org/10.1080/01431161.2021.1951879.
   Web of Science ®Google Scholar
• Nauata, Nelson, and Yasutaka Furukawa. 2020. “Vectorizing World Buildings: Planar Graph Reconstruction by Primitive Detection and Relationship Inference.” In European Conference on Computer Vision, 711–726. Springer.
   Google Scholar
• Peters, Ravi, Balázs Dukai, Stelios Vitalis, Jordi van Liempt, and Jantien Stoter. 2021. “Automated 3D Reconstruction of LoD2 and LoD1 Models for all 10 Million Buildings of the Netherlands.” arXiv preprint arXiv:2201.01191.
   Google Scholar
• Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. “Attention is All You Need.” Advances in Neural Information Processing Systems 30.
   Google Scholar
• Von Gioi, Rafael Grompone, Jeremie Jakubowicz, Jean-Michel Morel, and Gregory Randall. 2008. “LSD: A Fast Line Segment Detector with a False Detection Control.” IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (4): 722–732. https://doi.org/10.1109/TPAMI.2008.300.
   Web of Science ®Google Scholar
• Wang, Jianing, Hanjiang Xiong, Jianya Gong, and Xianwei Zheng. 2021. “Structured Building Extraction from High-Resolution Satellite Images with a Hybrid Convolutional Neural Network.” In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, 2417–2420. IEEE.
   Google Scholar
• Xiong, Biao, S. Oude Elberink, and G. Vosselman. 2014. “A Graph Edit Dictionary for Correcting Errors in Roof Topology Graphs Reconstructed From Point Clouds.” ISPRS Journal of Photogrammetry and Remote Sensing 93:227–242. https://doi.org/10.1016/j.isprsjprs.2014.01.007.
   Web of Science ®Google Scholar
• Xu, Yifan, Weijian Xu, David Cheung, and Zhuowen Tu. 2021. “Line Segment Detection Using Transformers Without Edges.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4257–4266, (Virtual).
   Google Scholar
• Xue, Nan, Tianfu Wu, Song Bai, Fudong Wang, Gui-Song Xia, Liangpei Zhang, and Philip H. S. Torr. 2020. “Holistically-Attracted Wireframe Parsing.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2788–2797.
   Google Scholar
• Zhang, Fuyang, Nelson Nauata, and Yasutaka Furukawa. 2020. “Conv-mpn: Convolutional Message Passing Neural Network for Structured Outdoor Architecture Reconstruction.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2798–2807, (Virtual).
   Google Scholar
• Zhao, Wufan, Claudio Persello, and Alfred Stein. 2021. “Building Outline Delineation: From Aerial Images to Polygons with an Improved End-to-End Learning Framework.” ISPRS Journal of Photogrammetry and Remote Sensing 175:119–131. https://doi.org/10.1016/j.isprsjprs.2021.02.014.
   Web of Science ®Google Scholar
• Zhao, Wufan, Claudio Persello, and Alfred Stein. 2022. “Extracting Planar Roof Structures From Very High Resolution Images Using Graph Neural Networks.” ISPRS Journal of Photogrammetry and Remote Sensing 187:34–45. https://doi.org/10.1016/j.isprsjprs.2022.02.022.
   Web of Science ®Google Scholar
• Zhao, Wufan, Claudio Persello, and Alfred Stein. 2023. “Semantic-Aware Unsupervised Domain Adaptation for Height Estimation From Single-view Aerial Images.” ISPRS Journal of Photogrammetry and Remote Sensing 196:372–385. https://doi.org/10.1016/j.isprsjprs.2023.01.003.
   Web of Science ®Google Scholar
• Zhou, Wen, Dongping Ming, Xianwei Lv, Keqi Zhou, Hanqing Bao, and Zhaoli Hong. 2020. “SO–CNN Based Urban Functional Zone Fine Division with VHR Remote Sensing Image.” Remote Sensing of Environment 236:111458. https://doi.org/10.1016/j.rse.2019.111458.
   Web of Science ®Google Scholar
• Zhou, Yichao, Haozhi Qi, and Yi Ma. 2019. “End-to-End Wireframe Parsing.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 962–971, Seoul, South Korea.
   Google Scholar
• Zhu, Xizhou, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, and Jifeng Dai. 2020. “Deformable Detr: Deformable Transformers for End-to-End Object Detection.” arXiv preprint arXiv:2010.04159.
   Google Scholar
• Zou, Chuhang, Alex Colburn, Qi Shan, and Derek Hoiem. 2018. “Layoutnet: Reconstructing the 3D Room Layout from a Single RGB Image.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2051–2059, Salt Lake City, UT, USA.
   Google Scholar