How well do the volunteers label land cover types in manual interpretation of remote sensing imagery?

References

• AbdelRahman, Mohamed AE. 2023. “An Overview of Land Degradation, Desertification and Sustainable Land Management Using GIS and Remote Sensing Applications.” Rendiconti Lincei. Scienze Fisiche e Naturali 34 (3): 767–808.
   Google Scholar
• Bah, Mamadou Dian, Adel Hafiane, and Raphael Canals. 2023. “Hierarchical Graph Representation for Unsupervised Crop row Detection in Images.” Expert Systems with Applications 216: 119478. https://doi.org/10.1016/j.eswa.2022.119478.
   Web of Science ®Google Scholar
• Bai, Ruyue, Zegen Wang, Heng Lu, Chen Chen, Xiuju Liu, Guohao Deng, Qiang He, Zhiming Ren, Bin Ding, and Xin Ye. 2023. “Earthquake-Triggered Landslide Interpretation Model of High Resolution Remote Sensing Imageries Based on Bag of Visual Word.” Earthquake Research Advances 3 (2): 100196. https://doi.org/10.1016/j.eqrea.2022.100196.
   Google Scholar
• Cengiz, A. V. C. I., Muhammed Budak, Nur Yağmur, and Filiz Balçik. 2023. “Comparison Between Random Forest and Support Vector Machine Algorithms for LULC Classification.” International Journal of Engineering and Geosciences 8 (1): 1–10. https://doi.org/10.26833/ijeg.987605.
   Web of Science ®Google Scholar
• Das, Niladri, Prolay Mondal, Subhasish Sutradhar, and Ranajit Ghosh. 2021. “Assessment of Variation of Land use/Land Cover and its Impact on Land Surface Temperature of Asansol Subdivision.” The Egyptian Journal of Remote Sensing and Space Science 24 (1): 131–149. https://doi.org/10.1016/j.ejrs.2020.05.001.
   Web of Science ®Google Scholar
• Dimitrovski, Ivica, Ivan Kitanovski, Dragi Kocev, and Nikola Simidjievski. 2023. “Current Trends in Deep Learning for Earth Observation: An Open-Source Benchmark Arena for Image Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 197: 18–35. https://doi.org/10.1016/j.isprsjprs.2023.01.014.
   Web of Science ®Google Scholar
• Foody, Giles M. 2009. “The Impact of Imperfect Ground Reference Data on the Accuracy of Land Cover Change Estimation.” International Journal of Remote Sensing 30 (12): 3275–3281. https://doi.org/10.1080/01431160902755346.
   Web of Science ®Google Scholar
• Foody, Giles, Gavin Long, Michael Schultz, and Ana-Maria Olteanu-Raimond. 2022. “Assuring the Quality of VGI on Land Use and Land Cover: Experiences and Learnings from the LandSense Project.” Geo-spatial Information Science 27 (1): 16–37. https://doi.org/10.1080/10095020.2022.2100285.
   Web of Science ®Google Scholar
• Fraisl, Dilek, Gerid Hager, Baptiste Bedessem, Margaret Gold, Pen-Yuan Hsing, Finn Danielsen, Colleen B. Hitchcock, et al. 2022. “Citizen Science in Environmental and Ecological Sciences.” Nature Reviews Methods Primers 2 (1): 64. https://doi.org/10.1038/s43586-022-00144-4.
   Google Scholar
• Hussain, Sajjad, Muhammad Mubeen, Ashfaq Ahmad, Hamid Majeed, Saeed Ahmad Qaisrani, Hafiz Mohkum Hammad, Muhammad Amjad, Iftikhar Ahmad, Shah Fahad, and Naveed Ahmad. 2023. “Assessment of Land Use/Land Cover Changes and Its Effect on Land Surface Temperature Using Remote Sensing Techniques in Southern Punjab, Pakistan.” Environmental Science and Pollution Research 30 (44): 99202–99218. https://doi.org/10.1007/s11356-022-21650-8.
   PubMed Web of Science ®Google Scholar
• Janowicz, Krzysztof, Song Gao, Grant McKenzie, Yingjie Hu, and Budhendra Bhaduri. 2020. “GeoAI: Spatially Explicit Artificial Intelligence Techniques for Geographic Knowledge Discovery and Beyond.” International Journal of Geographical Information Science 34 (4): 625–636.
   Web of Science ®Google Scholar
• Jiao, Licheng, Zhongjian Huang, Xu Liu, Yuting Yang, Mengru Ma, Jiaxuan Zhao, Chao You, et al. 2023. “Brain-Inspired Remote Sensing Interpretation: A Comprehensive Survey.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 16: 2992–3033. https://doi.org/10.1109/JSTARS.2023.3247455.
   Web of Science ®Google Scholar
• Kim, Wonjik, Asako Kanezaki, and Masayuki Tanaka. 2020. “Unsupervised Learning of Image Segmentation Based on Differentiable Feature Clustering.” IEEE Transactions on Image Processing 29: 8055–8068. https://doi.org/10.1109/TIP.2020.3011269.
   Web of Science ®Google Scholar
• Kohli, Divyani, Alfred Stein, and Richard Sliuzas. 2016. “Uncertainty Analysis for Image Interpretations of Urban Slums.” Computers, Environment and Urban Systems 60: 37–49. https://doi.org/10.1016/j.compenvurbsys.2016.07.010.
   Web of Science ®Google Scholar
• Krabina, Bernhard. 2023. “Building a Knowledge Graph for the History of Vienna with Semantic MediaWiki.” Journal of Web Semantics 76: 100771. https://doi.org/10.1016/j.websem.2022.100771.
   Web of Science ®Google Scholar
• Kraff, N. J., M. Wurm, and H. Taubenbck. 2020. “Uncertainties of Human Perception in Visual Image Interpretation in Complex Urban Environments.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13 (PP): 4229–4241. https://doi.org/10.1109/JSTARS.2020.3011543.
   Google Scholar
• Latifovic, Rasim, Darren Pouliot, and Ian Olthof. 2017. “Circa 2010 Land Cover of Canada: Local Optimization Methodology and Product Development.” Remote Sensing 9: 1098. https://doi.org/10.3390/rs9111098.
   Web of Science ®Google Scholar
• Lesiv, Myroslava, Linda See, Juan Carlos Laso Bayas, Tobias Sturn, Dmitry Schepaschenko, Mathias Karner, Inian Moorthy, Ian McCallum, and Steffen Fritz. 2018. “Characterizing the Spatial and Temporal Availability of Very High Resolution Satellite Imagery in Google Earth and Microsoft Bing Maps as a Source of Reference Data.” Land 7 (4): 118.
   Web of Science ®Google Scholar
• Li, Chenxi, Zaiying Ma, Liuyue Wang, Weijian Yu, Donglin Tan, Bingbo Gao, Quanlong Feng, Hao Guo, and Yuanyuan Zhao. 2021. “Improving the Accuracy of Land Cover Mapping by Distributing Training Samples.” Remote Sensing 13 (22): 4594. https://doi.org/10.3390/rs13224594.
   Web of Science ®Google Scholar
• Li, Wenwen, Sizhe Wang, Xiao Chen, Yuanyuan Tian, Zhining Gu, Anna Lopez-Carr, Andrew Schroeder, Kitty Currier, Mark Schildhauer, and Rui Zhu. 2023. “Geographvis: A Knowledge Graph and Geovisualization Empowered Cyberinfrastructure to Support Disaster Response and Humanitarian aid.” ISPRS International Journal of Geo-Information 12 (3): 112. https://doi.org/10.3390/ijgi12030112.
   Web of Science ®Google Scholar
• Li, Linhui, Wenjun Zhang, Xiaoyan Zhang, Mahmoud Emam, and Weipeng Jing. 2023. “Semi-supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning.” Electronics 12 (2): 348. https://doi.org/10.3390/electronics12020348.
   Web of Science ®Google Scholar
• Liu, Yu, Jingtao Ding, Yanjie Fu, and Yong Li. 2023. “UrbanKG: An Urban Knowledge Graph System.” ACM Transactions on Intelligent Systems and Technology 14 (4): 1–25.
   Web of Science ®Google Scholar
• Lv, Ning, Zenghui Zhang, Cong Li, Jiaxuan Deng, Tao Su, Chen Chen, and Yang Zhou. 2023. “A Hybrid-Attention Semantic Segmentation Network for Remote Sensing Interpretation in Land-Use Surveillance.” International Journal of Machine Learning and Cybernetics 14 (2): 395–406. https://doi.org/10.1007/s13042-022-01517-7.
   Web of Science ®Google Scholar
• Maxwell, Aaron E., Timothy A. Warner, and Fang Fang. 2018. “Implementation of Machine-Learning Classification in Remote Sensing: An Applied Review.” International Journal of Remote Sensing 39 (9): 2784–2817. https://doi.org/10.1080/01431161.2018.1433343.
   Web of Science ®Google Scholar
• McRoberts, Ronald E., Stephen V. Stehman, Greg C. Liknes, Erik Næsset, Christophe Sannier, and Brian F. Walters. 2018. “The Effects of Imperfect Reference Data on Remote Sensing-Assisted Estimators of Land Cover Class Proportions.” ISPRS Journal of Photogrammetry and Remote Sensing 142: 292–300. https://doi.org/10.1016/j.isprsjprs.2018.06.002.
   Web of Science ®Google Scholar
• Papoutsis, Ioannis, Nikolaos Ioannis Bountos, Angelos Zavras, Dimitrios Michail, and Christos Tryfonopoulos. 2023. “Benchmarking and Scaling of Deep Learning Models for Land Cover Image Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 195: 250–268. https://doi.org/10.1016/j.isprsjprs.2022.11.012.
   Web of Science ®Google Scholar
• Raja, Piyush, Santosh Kumar, Digvijay Singh Yadav, Amit Kumar, and Ram Krishna Kumar. 2023. “Intelligent Remote Sensing: Applications and Techniques.” Journal of Image Processing and Intelligent Remote Sensing (JIPIRS) ISSN 2815-0953 3 (02): 46–53.
   Google Scholar
• Ramezan, Christopher A., Timothy A. Warner, Aaron E. Maxwell, and Bradley S. Price. 2021. “Effects of Training Set Size on Supervised Machine-Learning Land-Cover Classification of Large-Area High-Resolution Remotely Sensed Data.” Remote Sensing 13 (3): 368. https://doi.org/10.3390/rs13030368.
   Web of Science ®Google Scholar
• Roy, David P., Haiyan Huang, Rasmus Houborg, and Vitor S. Martins. 2021. “A Global Analysis of the Temporal Availability of PlanetScope High Spatial Resolution Multi-Spectral Imagery.” Remote Sensing of Environment 264: 112586. https://doi.org/10.1016/j.rse.2021.112586.
   Web of Science ®Google Scholar
• Sadeghi, Fatemeh, Ata Larijani, Omid Rostami, Diego Martín, and Parisa Hajirahimi. 2023. “A Novel Multi-Objective Binary Chimp Optimization Algorithm for Optimal Feature Selection: Application of Deep-Learning-Based Approaches for SAR Image Classification.” Sensors 23 (3): 1180. https://doi.org/10.3390/s23031180.
   PubMed Web of Science ®Google Scholar
• Schepaschenko, Dmitry, Linda See, Myroslava Lesiv, Jean-François Bastin, Danilo Mollicone, Nandin-Erdene Tsendbazar, Lucy Bastin, Ian McCallum, Juan Carlos Laso Bayas, and Artem Baklanov. 2019. “Recent Advances in Forest Observation with Visual Interpretation of Very High-Resolution Imagery.” Surveys in Geophysics 40: 839–862.
   Web of Science ®Google Scholar
• Seyam, Md Mahadi Hasan, Md Rashedul Haque, and Md Mostafizur Rahman. 2023. “Identifying the Land use Land Cover (LULC) Changes Using Remote Sensing and GIS Approach: A Case Study at Bhaluka in Mymensingh, Bangladesh.” Case Studies in Chemical and Environmental Engineering 7: 100293. https://doi.org/10.1016/j.cscee.2022.100293.
   Google Scholar
• Stehman, Stephen. V, and Giles. M Foody. 2019. “Key Issues in Rigorous Accuracy Assessment of Land Cover Products.” Remote Sensing of Environment 231: 111199. https://doi.org/10.1016/j.rse.2019.05.018.
   Web of Science ®Google Scholar
• Tariq, Aqil, Jianguo Yan, Alexandre. S Gagnon, Mobushir Riaz Khan, and Faisal Mumtaz. 2023. “Mapping of Cropland, Cropping Patterns and Crop Types by Combining Optical Remote Sensing Images with Decision Tree Classifier and Random Forest.” Geo-spatial Information Science 26 (3): 302–320. https://doi.org/10.1080/10095020.2022.2100287.
   Web of Science ®Google Scholar
• Tarko, A., N. E. Tsendbazar, S. de Bruin, and A. K. Bregt. 2020. “Influence of Image Availability and Change Processes on Consistency of Land Transformation Interpretations.” International Journal of Applied Earth Observation and Geoinformation 86: 102005. https://doi.org/10.1016/j.jag.2019.102005.
   Web of Science ®Google Scholar
• Tarko, Agnieszka, Nandin-Erdene Tsendbazar, Sytze de Bruin, and Arnold K. Bregt. 2021. “Producing Consistent Visually Interpreted Land Cover Reference Data: Learning from Feedback.” International Journal of Digital Earth 14 (1): 52–70. https://doi.org/10.1080/17538947.2020.1729878.
   Web of Science ®Google Scholar
• Tavra, Marina, Ivan Racetin, and Josip Peroš. 2021. “The Role of Crowdsourcing and Social Media in Crisis Mapping: A Case Study of a Wildfire Reaching Croatian City of Split.” Geoenvironmental Disasters 8 (1): 10. https://doi.org/10.1186/s40677-021-00181-3.
   Google Scholar
• Van Coillie, Frieke M. B., Soetkin Gardin, Frederik Anseel, Wouter Duyck, Lieven P. C. Verbeke, and Robert R. De Wulf. 2014. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” International Journal of Remote Sensing 35 (2): 754–778. https://doi.org/10.1080/01431161.2013.873152.
   Web of Science ®Google Scholar
• Waldner, François, Anne Schucknecht, Myroslava Lesiv, Javier Gallego, Linda See, Ana Pérez-Hoyos, Raphaël d'Andrimont, Thomas De Maet, Juan Carlos Laso Bayas, and Steffen Fritz. 2019. “Conflation of Expert and Crowd Reference Data to Validate Global Binary Thematic Maps.” Remote Sensing of Environment 221: 235–246.
   Web of Science ®Google Scholar
• Wang, Zhipan, Di Liu, Zhongwu Wang, Xiang Liao, and Qingling Zhang. 2023. “A New Remote Sensing Change Detection Data Augmentation Method Based on Mosaic Simulation and Haze Image Simulation.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 16: 4579–4590.
   Google Scholar
• Watkinson, Kirsty, Jonathan J. Huck, and Angela Harris. 2023. “Using Gamification to Increase map Data Production During Humanitarian Volunteered Geographic Information (VGI) Campaigns.” Cartography and Geographic Information Science 50 (1): 79–95. https://doi.org/10.1080/15230406.2022.2156389.
   Web of Science ®Google Scholar
• Wickham, James, Stephen. V Stehman, Daniel G Sorenson, Leila Gass, and Jon A Dewitz. 2021. “Thematic Accuracy Assessment of the NLCD 2016 Land Cover for the Conterminous United States.” Remote Sensing of Environment 257: 112357. https://doi.org/10.1016/j.rse.2021.112357.
   Web of Science ®Google Scholar
• Xu, Rongtao, Changwei Wang, Jiguang Zhang, Shibiao Xu, Weiliang Meng, and Xiaopeng Zhang. 2023. “Rssformer: Foreground Saliency Enhancement for Remote Sensing Land-Cover Segmentation.” IEEE Transactions on Image Processing 32: 1052–1064. https://doi.org/10.1109/TIP.2023.3238648.
   Web of Science ®Google Scholar
• Zhang, Ce, Isabel Sargent, Xin Pan, Huapeng Li, Andy Gardiner, Jonathon Hare, and Peter M. Atkinson. 2018. “An Object-Based Convolutional Neural Network (OCNN) for Urban Land Use Classification.” Remote Sensing of Environment 216: 57–70. https://doi.org/10.1016/j.rse.2018.06.034.
   Web of Science ®Google Scholar
• Zhang, Zhan, Mi Zhang, Jianya Gong, Xiangyun Hu, Hanjiang Xiong, Huan Zhou, and Zhipeng Cao. 2023. “LuoJiaAI: A Cloud-Based Artificial Intelligence Platform for Remote Sensing Image Interpretation.” Geo-spatial Information Science 26 (2): 218–241.
   Web of Science ®Google Scholar
• Zhao, Yuanyuan, Duole Feng, Durai Jayaraman, Daniel Belay, Heiru Sebrala, John Ngugi, Eunice Maina, et al. 2018. “Bamboo Mapping of Ethiopia, Kenya and Uganda for the Year 2016 Using Multi-Temporal Landsat Imagery.” International Journal of Applied Earth Observation and Geoinformation 66: 116–125. https://doi.org/10.1016/j.jag.2017.11.008.
   Web of Science ®Google Scholar
• Zhao, Yuanyuan, Duole Feng, Le Yu, Linda See, Steffen Fritz, Christoph Perger, and Peng Gong. 2017. “Assessing and Improving the Reliability of Volunteered Land Cover Reference Data.” Remote Sensing 9: 10. https://doi.org/10.3390/rs9101034.
   Web of Science ®Google Scholar
• Zhao, Yuanyuan, Duole Feng, Le Yu, Xiaoyi Wang, Yanlei Chen, Yuqi Bai, H. Jaime Hernández, et al. 2016. “Detailed Dynamic Land Cover Mapping of Chile: Accuracy Improvement by Integrating Multi-Temporal Data.” Remote Sensing of Environment 183: 170–185. https://doi.org/10.1016/j.rse.2016.05.016.
   Web of Science ®Google Scholar