Vegetation segmentation using oblique photogrammetry point clouds based on RSPT network

ABSTRACT

Vegetation segmentation via point cloud data can provide important information for urban planning and environmental protection. The point cloud dataset is obtained using light detection and ranging (LiDAR) or RGB-D images. Oblique photogrammetry has received little attention as another important source of point cloud data. We present a pointwise annotated oblique photogrammetry point-cloud dataset that contains rich RGB information, texture, and structural features. This dataset contains five regions of Bengbu, China, with more than twenty thousand samples in this paper. Obviously, previous indoor point cloud semantic segmentation models are no longer applicable to oblique photogrammetry point clouds. A random sampling point transformer (RSPT) network is proposed to enhance vegetation segmentation accuracy. The RSPT model offers both efficient and lightweight architecture. In RSPT, random point sampling is utilized to downsample point clouds, and a local feature aggregation module based on self-attention is designed to extract additional representation features. The network also incorporated residual and dense connections (ResiDense) to capture both local and comprehensive features. Compared to state-of-the-art models, RSPT achieves notable improvements. The intersection over union (IoU) metric increased from 96.0% to 96.5%, the F1-score increased from 90.8% to 97.0%, and the overall accuracy (OA) increased from 91.9% to 96.9%.

KEYWORDS:

• Oblique photogrammetry
• point cloud
• self-attention
• vegetation segmentation
• RSPT

Acknowledgments

We would like to express our great appreciation to the editors and two anonymous reviewers for constructive comments that helped improve the manuscript.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The data supporting the findings of this study are available from the Bengbu Geotechnical Engineering and Surveying Institute. Restrictions apply to the availability of these data, which were used under the license for this study. Data are available from the author/[email protected]. cn, with permission from the Bengbu Geotechnical Engineering and Surveying Institute.

Additional information

Funding

This study was supported by the National Natural Science Foundation of China. This research was funded by the National Natural Science Foundation of China (grant number 41971311).