Full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation and mesh optimization for UAV images

References

• Barnes, Connelly, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. “PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing.” ACM Trans. Graph 28 (3): 24.
   Web of Science ®Google Scholar
• Bleyer, Michael, Christoph Rhemann, and Carsten Rother. 2011. “PatchMatch Stereo - Stereo Matching with Slanted Support Windows.” Paper Presented at the Bmvc, https://doi.org/10.5244/C.25.14.
   Google Scholar
• Chen, Zhihao, Lei Zhu, Liang Wan, Song Wang, Wei Feng, and Pheng-Ann Heng. 2020. “A Multi-Task Mean Teacher for Semi-Supervised Shadow Detection.” Paper Presented at the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, https://doi.org/10.1109/CVPR42600.2020.00565.
   Google Scholar
• Craglia, Max, Kees de Bie, Davina Jackson, Martino Pesaresi, Gábor Remetey-Fülöpp, Changlin Wang, Alessandro Annoni, Ling Bian, Fred Campbell, and Manfred Ehlers. 2012. “Digital Earth 2020: Towards the Vision for the Next Decade.” International Journal of Digital Earth 5 (1): 4–21. https://doi.org/10.1080/17538947.2011.638500.
   Web of Science ®Google Scholar
• Creswell, Antonia, Tom White, Vincent Dumoulin, Kai Arulkumaran, Biswa Sengupta, and Anil A Bharath. 2018. “Generative Adversarial Networks: An Overview.” IEEE Signal Processing Magazine 35 (1): 53–65. https://doi.org/10.1109/MSP.2017.2765202.
   Web of Science ®Google Scholar
• Dou, S. Q., and S. Y. Ding. 2020. “Construction of Smart Community Based on GIS and Tilt Photogrammetry.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, https://doi.org/10.5194/isprs-archives-XLII-3-W10-547-2020.
   Google Scholar
• Duan, Ping, Mingguo Wang, Yayuan Lei, and Jia Li. 2021. “Research on Estimating Water Storage of Small Lake Based on Unmanned Aerial Vehicle 3D Model.” Water Resources 48: 690–700. https://doi.org/10.1134/S0097807821050109.
   Web of Science ®Google Scholar
• Fuhrmann, Simon, and Michael Goesele. 2011. “Fusion of Depth Maps with Multiple Scales.” ACM Transactions on Graphics 30 (6): 1–8. https://doi.org/10.1145/2070781.2024182.
   Web of Science ®Google Scholar
• Gallup, David, Jan-Michael Frahm, and Marc Pollefeys. 2010. “Piecewise Planar and non-Planar Stereo for Urban Scene Reconstruction.” Paper Presented at the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2010.5539804
   Google Scholar
• Goodfellow, Ian, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. “Generative Adversarial Networks.” Communications of the ACM 63 (11): 139–144. https://doi.org/10.1145/3422622.
   Web of Science ®Google Scholar
• Guo, Huadong, Zhen Liu, Hao Jiang, Changlin Wang, Jie Liu, and Dong Liang. 2017. “Big Earth Data: A new Challenge and Opportunity for Digital Earth’s Development.” International Journal of Digital Earth 10 (1): 1–12. https://doi.org/10.1080/17538947.2016.1264490.
   Web of Science ®Google Scholar
• Jancosek, Michal, and Tomas Pajdla. 2011. “Multi-View Reconstruction Preserving Weakly-Supported Surfaces.” Paper Presented at the CVPR 2011. https://doi.org/10.1109/CVPR.2011.5995693
   Google Scholar
• Jiang, San, Wanshou Jiang, and Bingxuan Guo. 2022aa. “Leveraging Vocabulary Tree for Simultaneous Match Pair Selection and Guided Feature Matching of UAV Images.” ISPRS Journal of Photogrammetry and Remote Sensing 187: 273–293. https://doi.org/10.1016/j.isprsjprs.2022.03.006.
   Web of Science ®Google Scholar
• Jiang, San, Wanshou Jiang, and Lizhe Wang. 2022ba. “Unmanned Aerial Vehicle-Based Photogrammetric 3d Mapping: A Survey of Techniques, Applications, and Challenges.” IEEE Geoscience and Remote Sensing Magazine 10 (2): 135–171. https://doi.org/10.1109/MGRS.2021.3122248.
   Web of Science ®Google Scholar
• Jiang, San, Qingquan Li, Wanshou Jiang, and Wu Chen. 2022bb. “Parallel Structure from Motion for UAV Images via Weighted Connected Dominating set.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–13. https://doi.org/10.1109/TGRS.2022.3222776.
   Web of Science ®Google Scholar
• Kang, Jihun, Sewon Lee, Yeon Sunghyun, and Seongjin Park. 2019. “Improving 3d Mesh Quality Using Multi-Directional UAV Images.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, https://doi.org/10.5194/isprs-archives-XLII-2-W13-419-2019.
   Google Scholar
• Kerstein, Thomas, Martin Laurowski, Philipp Klein, Michael Weyrich, Hubert Roth, and Jürgen Wahrburg. 2011. “Optical 3d-Surface Reconstruction of Weak Textured Objects Based on an Approach of Disparity Stereo Inspection.” Paper Presented at the Proceedings of International Conference on Pattern Recognition and Computer Vision (ICPRCV 2011).
   Google Scholar
• Li, Yunsong, Yinlin Hu, Rui Song, Peng Rao, and Yangli Wang. 2018a. “Coarse-to-fine PatchMatch for Dense Correspondence.” IEEE Transactions on Circuits and Systems for Video Technology 28 (9): 2233–2245. https://doi.org/10.1109/TCSVT.2017.2720175.
   Web of Science ®Google Scholar
• Li, Ziyao, Rui Wang, Wen Zhang, Fengmin Hu, and Lingkui Meng. 2019. “Multiscale Features Supported DeepLabV3+ Optimization Scheme for Accurate Water Semantic Segmentation.” IEEE Access 7: 155787–155804. https://doi.org/10.1109/ACCESS.2019.2949635.
   Web of Science ®Google Scholar
• Li, Deren, Xiongwu Xiao, Bingxuan Guo, Wanshou Jiang, and Yueru Shi. 2016. “Oblique Image Based Automatic Aerotriangulation and Its Application in 3D City Model Reconstruction.” Geomatics and Information Science of Wuhan University 41 (6): 711–721. https://doi.org/10.13203/j.whugis20160099.
   Google Scholar
• Li, Shenhong, Xiongwu Xiao, Bingxuan Guo, and Lin Zhang. 2020. “A Novel OpenMVS-Based Texture Reconstruction Method Based on the Fully Automatic Plane Segmentation for 3D Mesh Models.” Remote Sensing 12 (23): 3908. https://doi.org/10.3390/rs12233908.
   Web of Science ®Google Scholar
• Li, Lincheng, Shunli Zhang, Xin Yu, and Li Zhang. 2018b. “PMSC: PatchMatch-Based Superpixel cut for Accurate Stereo Matching.” IEEE Transactions on Circuits and Systems for Video Technology 28 (3): 679–692. https://doi.org/10.1109/TCSVT.2016.2628782.
   Web of Science ®Google Scholar
• Lin, Guosheng, Anton Milan, Chunhua Shen, and Ian Reid. 2017. “Refinenet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation.” Paper Presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, https://doi.org/10.48550/arXiv.1611.06612.
   Google Scholar
• Liu, Fangfang, and Ming Fang. 2020. “Semantic Segmentation of Underwater Images Based on Improved Deeplab.” Journal of Marine Science and Engineering 8 (3): 188. https://doi.org/10.3390/jmse8030188.
   Web of Science ®Google Scholar
• Liu, Fayao, Guosheng Lin, and Chunhua Shen. 2015. “CRF Learning with CNN Features for Image Segmentation.” Pattern Recognition 48 (10): 2983–2992. https://doi.org/10.1016/j.patcog.2015.04.019.
   Web of Science ®Google Scholar
• Liu, Xiaoxia, Fengbao Yang, Hong Wei, and Min Gao. 2022. “Shadow Removal from UAV Images Based on Color and Texture Equalization Compensation of Local Homogeneous Regions.” Remote Sensing 14 (11), https://doi.org/10.3390/rs14112616.
   Web of Science ®Google Scholar
• Lu, Dengsheng, Guiying Li, Wenhui Kuang, and Emilio Moran. 2014. “Methods to Extract Impervious Surface Areas from Satellite Images.” International Journal of Digital Earth 7 (2): 93–112. https://doi.org/10.1080/17538947.2013.866173.
   Web of Science ®Google Scholar
• Mishra, Vishal, Ram Avtar, A. P. Prathiba, Prabuddh Kumar Mishra, Anuj Tiwari, Surendra Kumar Sharma, Chandra Has Singh, Bankim Chandra Yadav, and Kamal Jain. 2023. “Uncrewed Aerial Systems in Water Resource Management and Monitoring: A Review of Sensors, Applications, Software, and Issues.” Advances in Civil Engineering, https://doi.org/10.1155/2023/3544724.
   Web of Science ®Google Scholar
• Mo, Nan, Ruixi Zhu, Li Yan, and Zhan Zhao. 2018. “Deshadowing of Urban Airborne Imagery Based on Object-Oriented Automatic Shadow Detection and Regional Matching Compensation.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (2): 585–605. https://doi.org/10.1109/JSTARS.2017.2787116.
   Web of Science ®Google Scholar
• Murali, Saritha, and V. K. Govindan. 2013. “Shadow Detection and Removal from a Single Image Using LAB Color Space.” Cybernetics and Information Technologies 13 (1): 95–103. https://doi.org/10.2478/cait-2013-0009.
   Google Scholar
• Pant, Gaurav, D. P. Yadav, and Ashish Gaur. 2020. “ResNeXt Convolution Neural Network Topology-Based Deep Learning Model for Identification and Classification of Pediastrum.” Algal Research 48: 101932. https://doi.org/10.1016/j.algal.2020.101932.
   Google Scholar
• Park, Haekyung, and Dongkun Lee. 2019. “Comparison Between Point Cloud and Mesh Models Using Images from an Unmanned Aerial Vehicle.” Measurement 138: 461–466. https://doi.org/10.1016/j.measurement.2019.02.023.
   Web of Science ®Google Scholar
• Pinheiro, Pedro O. Tsung-Yi Lin, Ronan Collobert, and Piotr Dollár. 2016. Learning to Refine Object Segments. Paper Presented at the Computer Vision–ECCV 2016, 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14. https://doi.org/10.1007/978-3-319-46448-0_5.
   Google Scholar
• Remondino, Fabio, Luigi Barazzetti, Francesco Nex, Marco Scaioni, and Daniele Sarazzi. 2011. “UAV photogrammetry for mapping and 3d modeling – current status and future perspectives.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXVIII-1/C22: 25–31. https://doi.org/10.5194/isprsarchives-XXXVIII-1-C22-25-2011.
   Google Scholar
• Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional Networks for Biomedical Image Segmentation. Paper Presented at the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. https://doi.org/10.1007/978-3-319-24574-4_28.
   Google Scholar
• Sabri, My Abdelouahed, Siham Aqel, and Abdellah Aarab. 2019. “A Multiscale Based Approach for Automatic Shadow Detection and Removal in Natural Images.” Multimedia Tools and Applications 78 (9): 11263–11275. https://doi.org/10.1007/s11042-018-6678-x.
   Web of Science ®Google Scholar
• Schonberger, Johannes L. and Jan-Michael Frahm. 2016. “Structure-from-motion Revisited.” Paper Presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, https://doi.org/10.1109/CVPR.2016.445.
   Google Scholar
• Tian, Mao, Bisheng Yang, Chi Chen, Ronggang Huang, and Liang Huo. 2019. “HPM-TDP: An Efficient Hierarchical PatchMatch Depth Estimation Approach Using Tree Dynamic Programming.” ISPRS Journal of Photogrammetry and Remote Sensing 155: 37–57. https://doi.org/10.1016/j.isprsjprs.2019.06.015.
   Web of Science ®Google Scholar
• Toschi, Isabella, M. M. Ramos, Erica Nocerino, F. Menna, F. Remondino, K. Moe, D. Poli, K. Legat, and Francesco Fassi. 2017. “Oblique Photogrammetry Supporting 3D Urban Reconstruction of Complex Scenarios.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-1/W1: 519–526. https://doi.org/10.5194/isprs-archives-XLII-1-W1-519-2017.
   Google Scholar
• Wang, Ruoqi, Guiying Li, Yagang Lu, and Dengsheng Lu. 2023. “A comparative analysis of grid-based and object-based modeling approaches for poplar forest growing stock volume estimation in plain regions using airborne LIDAR data.” Geo-spatial Information Science, 1–19. https://doi.org/10.1080/10095020.2023.2169199.
   Web of Science ®Google Scholar
• Xiao, Yong, Cheng Wang, Jing Li, Wuming Zhang, Xiaohuan Xi, Changlin Wang, and Pinliang Dong. 2015. “Building Segmentation and Modeling from Airborne LiDAR Data.” International Journal of Digital Earth 8 (9): 694–709. https://doi.org/10.1080/17538947.2014.914252.
   Web of Science ®Google Scholar
• Yanmei, Yang, Wang Ying, Shi Lei, Tao Sirong, and Li Hong. Construction of Refined 3D Model Based on DP-Modeler.” Bulletin of Surveying and Mapping 5: 106. https://doi.org/10.13474/j.cnki.11-2246.2021.0152.
   Google Scholar
• Zhang, Chi, and A. Murat Maga. 2023. “An Open-Source Photogrammetry Workflow for Reconstructing 3D Models.” Integrative Organismal Biology 5 (1): obad024. https://doi.org/10.1093/iob/obad024.
   PubMedGoogle Scholar