387
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Vegetation segmentation using oblique photogrammetry point clouds based on RSPT network

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Article: 2310083 | Received 10 Oct 2023, Accepted 19 Jan 2024, Published online: 05 Feb 2024

References

  • Alonzo, M., B. Bookhagen, and D. Roberts. 2014. “Urban Tree Species Mapping Using Hyperspectral and Lidar Data Fusion.” Remote Sensing of Environment 148: 70–83. https://doi.org/10.1016/j.rse.2014.03.018.
  • Armeni, I., S. Sax, A. R. Zamir, and S. Savarese. 2017. Joint 2D-3D-Semantic Data for Indoor Scene Understanding. https://arxiv.org/abs/1702.01105.
  • Behley, J., M. Garbade, A. Milioto, J. Quenzel, S. Behnke, C. Stachniss, and J. Gall. 2019. “SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences.” Paper present at the Proceedings of the International Conference on Computer Vision, Seoul, Korea, October 2019.
  • Bridson, R. 2019. “Fast Poisson Disk Sampling in Arbitrary Dimensions.” Paper present at the Conference of Association for Computing Machinery. New Orleans, USA, May 2019.
  • Chen, Y., J. Li, H. Xiao, X. Jin, S. Yan, and J. Feng. 2017. “Dual Path Networks.” Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1707.01629.
  • Chen, Y., R. Wu, C. Yang, and Y. Lin. 2021. “Urban Vegetation Segmentation Using Terrestrial LiDAR Point Clouds Based on Point non-Local Means Network.” International Journal of Applied Earth Observation and Geoinformation 105: 102580. https://doi.org/10.1016/j.jag.2021.102580.
  • Dai, A., A. X. Chang, M. Savva, M. Halber, T. Funkhouser, and M. Niener. 2017. “ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes.” Paper present at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii, USA, July 2017.
  • Du, J., G. Cai, Z. Wang, S. Huang, J. Su, J. M. Junior, J. Smit, and J. Li. 2021. “ResDLPS-Net: Joint Residual-Dense Optimization for Large-Scale Point Cloud Semantic Segmentation.” Isprs Journal of Photogrammetry and Remote Sensing 182: 37–51. https://doi.org/10.1016/j.isprsjprs.2021.09.024.
  • Fan, S., Q. Dong, F. Zhu, Y. Lv, P. Ye, and F.-Y. Wang. 2021. “SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14504–14513. https://doi.org/10.1109/cvpr46437.2021.01427.
  • Firman, M. 2016. “RGBD Datasets: Past, Present and Future.” Paper present at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, USA, June 2016.
  • Frahm, J. M., P. Fite-Georgel, D. Gallup, T. Johnson, and M. Pollefeys. 2010. “Building Rome on a Cloudless Day.” Paper present at the European Conference on Computer Vision, HeraKlion, Greece, September, 2010.
  • Gong, J., J. Xu, X. Tan, H. Song, Y. Qu, Y. Xie, and L. Ma. 2021. Omni-supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. Paper present at the Proceedings of the Conference on Computer Vision and Pattern Recognition. Napa, USA, June 2021.
  • Groh, F., P. Wieschollek, and H. Lensch. 2019. “Flex-Convolution: Million-Scale Point-Cloud Learning Beyond Grid-Worlds.” Paper present at the Asian Conference on Computer Vision. Munich, Germany, September 2019.
  • Guan, H., J. Li, S. Cao, and Y. Yu. 2016. “Use of Mobile LiDAR in Road Information Inventory: A Review.” International Journal of Image and Data Fusion 7 (3): 219–242. https://doi.org/10.1080/19479832.2016.1188860.
  • Guo, M.-H., J.-X. Cai, Z.-N. Liu, T.-J. Mu, R. R. Martin, and S.-M. Hu. 2021. “PCT: Point Cloud Transformer.” Computational Visual Media 7: 187–199. https://doi.org/10.1007/s41095-021-0229-5.
  • Guo, S., J. Li, Z. Lai, and S. Han. 2022. “CTpoint: A Novel Local and Global Features Extractor for Point Cloud.” Neurocomputing 511: 273–289. https://doi.org/10.1016/j.neucom.2022.09.056.
  • Guo, Y., H. Wang, Q. Hu, H. Liu, L. Liu, and M. Bennamoun. 2020. “Deep Learning for 3d Point Clouds: A Survey.” Transactions on Pattern Analysis and Machine Intelligence 43: 4338–4364. https://doi.org/10.1109/tpami.2020.3005434.
  • Hackel, T., N. Savinov, L. Ladicky, J. D. Wegner, K. Schindler, and M. Pollefeys. 2017. “Semantic3D.net: A new Large-Scale Point Cloud Classification Benchmark.” ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, 91–98. https://doi.org/10.5194/isprs-annals-iv-1-w1-91-2017.
  • Hu, Q., B. Yang, L. Xie, S. Rosa, Y. Guo, Z. Wang, N. Trigoni, and A. Markham. 2020. “Randla-net: Efficient Semantic Segmentation of Large-Scale Point Clouds.” Paper present at Proceedings of the conference on computer vision and pattern recognition. Seattle, USA, June 2020.
  • Huo, L., E. Lindberg, and J. Holmgren. 2022. “To Towards Low Vegetation Identification: A New Method for Tree Crown Segmentation from LiDAR Data Based on a Symmetrical Structure Detection Algorithm (SSD).” Remote Sensing of Environment 270: 112857. https://doi.org/10.1016/j.rse.2021.112857.
  • Lawin, F. J., M. Danelljan, P. Tosteberg, G. Bhat, F. S. Khan, and M. Felsberg. 2017. “Deep Projective 3D Semantic Segmentation.” Paper present at the International Conference on Computer Analysis of Images and Patterns. Faro, Portugal, August 2017.
  • Li, X., C. Li, Z. Tong, et al. 2020. “Campus3d: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene.” Paper present at the Proceedings of the 28th ACM International Conference on Multimedia. Beijing, People’s Republic of China, October 2020.
  • Li, M., L. Nan, N. Smith, and P. Wonka. 2016. “Reconstructing Building Mass Models from UAV Images.” Computers & Graphics 54: 84–93. https://doi.org/10.1016/j.cag.2015.07.004.
  • Liang, X., V. Kankara, J. Hyyppa, Y. Wang, A. Kukko, H. Haggren, X. Yu, et al. 2016. “Terrestrial Laser Scanning in Forest Inventories.” ISPRS Journal of Photogrammetry and Remote Sensing 115: 63–77. https://doi.org/10.1016/j.isprsjprs.2016.01.006.
  • Lin, Y.i., and J. Hyyppa. 2012. “Multiecho-recording Mobile Laser Scanning for Enhancing Individual Tree Crown Reconstruction.” IEEE Transactions on Geoscience and Remote Sensing 50 (11): 4323–4332. https://doi.org/10.1109/TGRS.2012.2194503.
  • Liu, Z., H. Tang, Y. Lin, and S. Han. 2019. “Point-voxel cnn for Efficient 3d Deep Learning.” Advances in Neural Information Processing Systems, 32. https://doi.org/10.1109/access.2020.3023423.
  • Luo, Z., J. Li, Z. Xiao, Z. G. Mou, X. Cai, and C. Wang. 2019. “Learning High-Level Features by Fusing Multi-View Representation of MLS Point Clouds for 3D Object Recognition in Road Environment.” Journal of Photogrammetry and Remote Sensing 150: 44–58. https://doi.org/10.1016/j.isprsjprs.2019.01.024.
  • Luo, H., C. Wang, C. Wen, Z. Chen, D. Zai, Y. Yu, and J. Li. 2018. “Semantic Labeling of Mobile LiDAR Point Clouds via Active Learning and Higher Order MRF.” Transactions on Geoscience and Remote Sensing 56 (7): 3631–3644. https://doi.org/10.1109/TGRS.2018.2802935.
  • Ma, L., Y. Li, J. Li, Y. Yu, J. Marcato, W. N. Goncalves, and M. A. Chapman. 2020. “Capsule-based Networks for Road Marking Extraction and Classification from Mobile LiDAR Point Clouds.” Transactions on Intelligent Transportation Systems. https://doi.org/10.1109/TITS.2020.2990120.
  • Maturana, D., and S. Scherer. 2015. “Voxnet: A 3d Convolutional Neural Network for Real-Time Object Recognition.” Paper present at the International Conference on Intelligent Robots and Systems (IROS). Hamburg, Germany, September 2015.
  • Pang, Y., W. Wang, L. Du, Z. Zhang, X. Liang, Y. Li, and Z. Wang. 2021. “Nyström-based Spectral Clustering Using Airborne LiDAR Point Cloud Data for Individual Tree Segmentation.” International Journal of Digital Earth 14 (10): 1452–1476. https://doi.org/10.1080/17538947.2021.1943018.
  • Qi, C. R., H. Su, K. Mo, and L. J. Guibas. 2017a. “Pointnet: Deep Learning on Point Sets for 3d Classification and Segmentation.” Paper present at the Proceedings of the Conference on Computer Vision and Pattern Recognition. Hawaii, USA, July 2017.
  • Qi, C. R., L. Yi, H. Su, and L. J. Guibas. 2017b. “Pointnet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space.” Advances in Neural Information Processing Systems, 30. https://doi.org/10.1109/cvpr.2017.16.
  • Qin, H., W. Zhou, Y. Yao, and W. Wang. 2022. “Individual Tree Segmentation and Tree Species Classification in Subtropical Broadleaf Forests Using UAV-Based LiDAR, Hyperspectral, and Ultrahigh-Resolution RGB Data.” Remote Sensing of Environment 280: 113143. https://doi.org/10.1016/j.rse.2022.113143.
  • Ran, H., J. Liu, and C. Wang. 2022. “Surface Representation for Point Clouds.” Paper present at the Conference on Computer Vision and Pattern Recognition. Shenzhen, People’s Republic of China, October 2022.
  • Ren, D., Z. Wu, J. Li, P. Yu, J. Guo, M. Wei, and Y. Guo. 2022. “Point Attention Network for Point Cloud Semantic Segmentation.” Science China Information Sciences 65: 192104. https://doi.org/10.1007/s11432-021-3387-7.
  • Su, H., S. Maji, E. Kalogerakis, and E. Learned-Miller. 2015. “Multi-view Convolutional Neural Networks for 3d Shape Recognition.” Paper present at the Proceedings of the IEEE International Conference on Computer Vision. Santiago, Chile, December 2015.
  • Vallet, B., M. Bredif, A. Serna, B. Marcotegui, and N. Paparoditis. 2015. “TerraMobilita/IQmulus Urban Point Cloud Analysis Benchmark.” Computers & Graphics 49: 126–133. https://doi.org/10.1016/j.cag.2015.03.004.
  • Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł Kaiser, and I. Polosukhin. 2017. “Attention is all you Need.” Advances in Neural Information Processing Systems 30. https://doi.org/10.5040/9781350101272.00000005.
  • Wang, R., J. Peethambaran, and D. Chen. 2018. “LiDRA Point Clouds to 3-D Urban Models: A Review.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (2): 606–627. https://doi.org/10.1109/JSTARS.2017.2781132.
  • Westoby, M. J., J. Brasington, N. F. Glasser, M. J. Hambrey, and J. M. Reynolds. 2012. “Structure-from-Motion’photogrammetry: “a low-Cost, Effective Tool for Geoscience Applications.”.” Geomorphology 179: 300–314. https://doi.org/10.1016/j.geomorph.2012.08.021.
  • Wu, C., S. Agarwal, B. Curless, and S. M. Seitz. 2011. “Multicore Bundle Adjustment.” Paper present at the Conference on Computer Vision and Pattern Recognition, Colorado Springs, USA, June 2011.
  • Wu, B., B. Yu, Q. Wu, S. Yao, F. Zhao, W. Mao, and J. Wu. 2017. “A Graph-Based Approach for 3D Building Model Reconstruction from Airborne LiDAR Point Clouds.” Remote Sensing 9: 92. https://doi.org/10.3390/rs9010092.
  • Xu, S., S. Xu, N. Ye, and F.a. Zhu. 2018a. “Individual Stem Detection in Residential Environments with MLS Data.” Remote Sensing Letters 9 (1): 51–60. https://doi.org/10.1080/2150704X.2017.1384588.
  • Xu, S., S. Xu, N. Ye, and F. A. Zhu. 2018b. “Automatic Extraction of Street Trees’ Nonphotosynthetic Components from MLS Data.” International Journal of Applied Earth Observation and Geoinformation 69: 64–77. https://doi.org/10.1016/j.jag.2018.02.016.
  • Zeng, Z., Y. Xu, Z. Xie, W. Tang, J. Wan, and W. Wu. 2022. “LEARD-Net: Semantic Segmentation for Large-Scale Point Cloud Scene.” International Journal of Applied Earth Observation and Geoinformation 112: 102953. https://doi.org/10.1016/j.jag.2022.102953.
  • Zhang, Z., Y. Fan, Z. Jiao, B. Fan, J. Zhou, and Z. Li. 2023. “Vegetation Ecological Benefits Index (VEBI): A 3D Spatial Model for Evaluating the Ecological Benefits of Vegetation.” International Journal of Digital Earth 16 (1): 1108–1123. https://doi.org/10.1080/17538947.2023.2192527.
  • Zhao, H., J. Jia, and V. Koltun. 2020. “Exploring Self-Attention for Image Recognition.” Paper present at the Proceedings of the Conference on Computer Vision and Pattern Recognition. Seattle, USA, June 2020.
  • Zhao, H., L. Jiang, J. Jia, P. H. Torr, and V. Koltun. 2021. “Point Transformer.” Paper present at the International Conference on Computer Vision, Sanya, People’s Republic of China, February 2021.
  • Zhou, Q.-Y., and U. Neumann. 2008. “Fast and Extensible Building Modeling from Airborne LiDAR data.” Paper present at the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, Portsmouth, UK, January 2020.
  • Zou, X., M. Cheng, C. Wang, Y. Xia, and J. Li. 2017. “Tree Classification in Complex Forest Point Clouds Based on Deep Learning.” Geoscience and Remote Sensing Letters 14 (12). https://doi.org/10.1109/LGRS.2017.2764938.