1,415
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Deep learning-based super-resolution for harmful algal bloom monitoring of inland water

, , , , , , , , & show all
Article: 2249753 | Received 07 Feb 2023, Accepted 13 Aug 2023, Published online: 01 Sep 2023

References

  • Ahn, N., B. Kang, and K. A. Sohn. 2018. “Fast, accurate, and lightweight super-resolution with cascading residual network.“ In Proceedings of the European conference on computer vision (ECCV) (pp. 252–21). https://doi.org/10.1007/978-3-030-01249-6_16
  • Baek, S.-S., E.-Y. Jung, J. Pyo, Y. Pachepsky, H. Son, and K. Hwa Cho. 2022. “Hierarchical Deep Learning Model to Simulate Phytoplankton at Phylum/Class and Genus Levels and Zooplankton at the Genus Level.” Water Research 218:118494. https://doi.org/10.1016/j.watres.2022.118494.
  • Cai, J., Z. Meng, and C. M. Ho. 2020. “Residual channel attention generative adversarial network for image super-resolution and noise reduction.“ In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (pp. 454–455). https://doi.org/10.1109/CVPRW50498.2020.00235
  • Chang, Y., and B. Luo. 2019. “Bidirectional Convolutional LSTM Neural Network for Remote Sensing Image Super-Resolution.” Remote Sensing 11 (20): 2333. https://doi.org/10.3390/rs11202333.
  • Chen, Y., H. Jiang, C. Li, X. Jia, and P. Ghamisi. 2016. “Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 54 (10): 6232–6251. https://doi.org/10.1109/TGRS.2016.2584107.
  • Choi, H., C.-M. Lee, D. Chan Koh, and Y. Yeol Yoon. 2021. “Recharge and Spatial Distribution of Groundwater Hydrochemistry in the Geum River Basin, South Korea.” Journal of Radioanalytical and Nuclear Chemistry 330 (2): 397–412. https://doi.org/10.1007/s10967-021-07807-8.
  • Dong, C., C. Change Loy, H. Kaiming, and X. Tang. 2015. “Image Super-Resolution Using Deep Convolutional Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 38 (2): 295–307. https://doi.org/10.1109/TPAMI.2015.2439281.
  • Dou, X., C. Li, Q. Shi, and M. Liu. 2020. “Super-Resolution for Hyperspectral Remote Sensing Images Based on the 3D Attention-SRGAN Network.” Remote Sensing 12 (7): 1204. https://doi.org/10.3390/rs12071204.
  • Galar, M., R. Sesma, C. Ayala, L. Albizua, and C. Aranda. 2020. “Super-Resolution of Sentinel-2 Images Using Convolutional Neural Networks and Real Ground Truth Data.” Remote Sensing 12 (18): 2941. https://doi.org/10.3390/rs12182941.
  • Galar, M., R. Sesma, C. Ayala, and C. Aranda. 2019. “SUPER-RESOLUTION for SENTINEL-2 IMAGES.” International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences XLII-2/W16:95–102. https://doi.org/10.5194/isprs-archives-XLII-2-W16-95-2019.
  • Gargiulo, M., A. Mazza, R. Gaetano, G. Ruello, and G. Scarpa. 2019. “Fast Super-Resolution of 20 M Sentinel-2 Bands Using Convolutional Neural Networks.” Remote Sensing 11 (22): 2635. https://doi.org/10.3390/rs11222635.
  • Gerber, N. N. 1977. “Three Highly Odorous Metabolites from an Actinomycete: 2-Isopropyl-3-Methoxy-Pyrazine, Methylisoborneol, and Geosmin.” Journal of Chemical Ecology 3 (4): 475–482. https://doi.org/10.1007/BF00988190.
  • Gitelson, A. A., D. Gurlin, W. J. Moses, and T. Barrow. 2009. “A Bio-Optical Algorithm for the Remote Estimation of the Chlorophyll-A Concentration in Case 2 Waters.” Environmental Research Letters 4 (4): 045003. https://doi.org/10.1088/1748-9326/4/4/045003.
  • Goodfellow, I., J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. 2014. “Generative Adversarial Nets.” Advances in Neural Information Processing Systems 27. https://proceedings.neurips.cc/paper_files/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf.
  • Hong, S. M., S.-S. Baek, D. Yun, Y.-H. Kwon, H. Duan, J. Pyo, and K. Hwa Cho. 2021. “Monitoring the Vertical Distribution of HABs Using Hyperspectral Imagery and Deep Learning Models.” Science of the Total Environment 794:148592. https://doi.org/10.1016/j.scitotenv.2021.148592.
  • Honggang, C., X. He, L. Qing, Y. Wu, C. Ren, R. E. Sheriff, and C. Zhu. 2022. “Real-World Single Image Super-Resolution: A Brief Review.” Information Fusion 79:124–145. https://doi.org/10.1016/j.inffus.2021.09.005.
  • Hong, S. M., K. Hwa Cho, S. Park, T. Kang, M. Sung Kim, G. Nam, and J. Pyo. 2022. “Estimation of Cyanobacteria Pigments in the Main Rivers of South Korea Using Spatial Attention Convolutional Neural Network with Hyperspectral Imagery.” GIScience & Remote Sensing 59 (1): 547–567. https://doi.org/10.1080/15481603.2022.2037887.
  • Huang, N., Y. Yang, J. Liu, X. Gu, and H. Cai. 2017. “Single-Image Super-Resolution for Remote Sensing Data Using Deep Residual-Learning Neural Network.“ Neural Information Processing 622–30. https://doi.org/10.1007/978-3-319-70096-0_64.
  • Hua, S., A. Wang, T. Zhang, T. Qin, X. Du, and X.-H. Yan. 2021. “Super-Resolution of Subsurface Temperature Field from Remote Sensing Observations Based on Machine Learning.” International Journal of Applied Earth Observation and Geoinformation 102:102440. https://doi.org/10.1016/j.jag.2021.102440.
  • Jang, W., Y. Park, J. Pyo, S. Park, J. Kim, J. H. Kim, K. H. Cho, J.-K. Shin, and S. Kim. 2022. “Optimal Band Selection for Airborne Hyperspectral Imagery to Retrieve a Wide Range of Cyanobacterial Pigment Concentration Using a Data-Driven Approach.” Remote Sensing 14 (7): 1754. https://doi.org/10.3390/rs14071754.
  • Junyu, H., Y. Chen, J. Wu, D. A. Stow, and G. Christakos. 2020. “Space-Time Chlorophyll-A Retrieval in Optically Complex Waters That Accounts for Remote Sensing and Modeling Uncertainties and Improves Remote Estimation Accuracy.” Water Research 171:115403. https://doi.org/10.1016/j.watres.2019.115403.
  • Kaiming, H., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, 27-30 June 2016. IEEE. Las Vegas, NV, USA. https://doi.org/10.1109/CVPR.2016.90
  • Keys, R. 1981. “Cubic Convolution Interpolation for Digital Image Processing.” IEEE Transactions on Acoustics, Speech, and Signal Processing 29 (6): 1153–1160. https://doi.org/10.1109/TASSP.1981.1163711.
  • Kim, S., M. Kim, H. Kim, S.-S. Baek, W. Kim, S. D. Kim, and K. Hwa Cho. 2022. “Chemical Accidents in Freshwater: Development of Forecasting System for Drinking Water Resources.” Journal of Hazardous Materials 432:128714. https://doi.org/10.1016/j.jhazmat.2022.128714.
  • Kim, J., J. Kwon Lee, and K. Mu Lee. 2016. “Accurate Image Super-Resolution Using Very Deep Convolutional Networks.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, 27-30 June 2016. IEEE: Las Vegas, NV, USA. https://doi.org/10.1109/CVPR.2016.182
  • Kim, G., J. Park, K. Lee, J. Lee, J. Min, B. Lee, D. K. Han, and K. Hanseok 2020. “Unsupervised Real-World Super Resolution with Cycle Generative Adversarial Network and Domain Discriminator.” Paper presented at the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 14-19 June 2020, Seattle, WA, USA. IEEE. https://doi.org/10.1109/CVPRW50498.2020.00236 .
  • Kokhanovsky, A. A. 2008. Aerosol Optics: Light Absorption and Scattering by Particles in the Atmosphere. American Library Association: Springer Science & Business Media.
  • Lanorte, A., G. Cillis, G. Calamita, G. Nolè, A. Pilogallo, B. Tucci, and F. De Santis. 2019. “Integrated Approach of RUSLE, GIS and ESA Sentinel-2 Satellite Data for Post-Fire Soil Erosion Assessment in Basilicata Region (Southern Italy).” Geomatics, Natural Hazards and Risk 10 (1): 1563–1595. Natural Hazards and Risk. https://doi.org/10.1080/19475705.2019.1578271.
  • Ledig, C., L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, and Z. Wang. 2017. “Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, 21-26 July 2017, Honolulu, HI, USA. IEEE. https://doi.org/10.1109/CVPR.2017.19.
  • Lee, J., C.-G. Kim, J. Eun Lee, N. Won Kim, and H. Kim. 2018. “Application of Artificial Neural Networks to Rainfall Forecasting in the Geum River Basin, Korea.” Water 10 (10): 1448. https://doi.org/10.3390/w10101448.
  • Lee, J., J. Yoon, I. Choi, H. Joo, B. Lim, and S. Lee. 2016. “Vertical Distribution of Harmful Cyanobacterial in the Daechung Reservoir.” Journal of Korean Society on Water Environment 1:464–465.
  • Leibe, B., J. Matas, N. Sebe, and M. Welling. 2016. “Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, the Netherlands.” Proceedings, Part IV, Amsterdam, Netherland, October 11–14, 2016, 9908. Springer.
  • Lei, S., Z. Shi, and Z. Zou. 2019. “Coupled Adversarial Training for Remote Sensing Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 58 (5): 3633–3643. https://doi.org/10.1109/TGRS.2019.2959020.
  • Lin, Q., C. Hu, P. M. Visser, and R. Ma. 2018. “Diurnal Changes of Cyanobacteria Blooms in Taihu Lake as Derived from GOCI Observations.” Limnology and Oceanography 63 (4): 1711–1726. https://doi.org/10.1002/lno.10802.
  • Louis, J., V. Debaecker, B. Pflug, M. Main-Knorn, J. Bieniarz, U. Mueller-Wilm, E. Cadau, and F. Gascon. 2016. “Sentinel-2 Sen2Cor: L2A Processor for Users.” Paper presented at the Proceedings Living Planet Symposium 2016, Prague, Czech Republic.
  • Luan, K., X. Tong, M. Yanhua, R. Shu, X. Weiming, and X. Liu. 2014. “Geometric Correction of PHI Hyperspectral Image without Ground Control Points.” Paper presented at the IOP Conference Series: Earth and Environmental Science, 22-26 April, 2013, Beijing China. https://doi.org/10.1088/1755-1315/17/1/012193.
  • Main-Knorn, M., B. Pflug, J. Louis, V. Debaecker, U. Müller-Wilm, and F. Gascon. 2017. Sen2Cor for Sentinel-2. Paper presented at the Image and Signal Processing for Remote Sensing XXIII.
  • Mishra, D. R., B. A. Schaeffer, and D. Keith. 2014. “Performance Evaluation of Normalized Difference Chlorophyll Index in Northern Gulf of Mexico Estuaries Using the Hyperspectral Imager for the Coastal Ocean.” GIScience & Remote Sensing 51 (2): 175–198. https://doi.org/10.1080/15481603.2014.895581.
  • Mondejar, J. P., and A. F. Tongco. 2019. “Near Infrared Band of Landsat 8 as Water Index: A Case Study Around Cordova and Lapu-Lapu City, Cebu, Philippines.” Sustainable Environment Research 29 (1): 1–15. https://doi.org/10.1186/s42834-019-0016-5.
  • Moses, W. J., A. A. Gitelson, S. Berdnikov, and V. Povazhnyy. 2009. “Satellite Estimation of Chlorophyll-$ a $ Concentration Using the Red and NIR Bands of MERIS—The Azov Sea Case Study.” IEEE Geoscience and Remote Sensing Letters 6 (4): 845–849. https://doi.org/10.1109/LGRS.2009.2026657.
  • Mueller-Wilm, U., O. Devignot, and L. Pessiot. 2019. “Sen2Cor Software Release Note.” ESA, January S2-PDGS-MPC-L2A-SRN-V2.8.0 (2).
  • Müller, M. U., N. Ekhtiari, R. M. Almeida, and C. Rieke. 2020. “Super-Resolution of Multispectral Satellite Images Using Convolutional Neural Networks.” arXiv Preprint arXiv V-1 (2020): 33–40.
  • Naranjo-Torres, J., M. Mora, R. Hernández-García, R. J. Barrientos, C. Fredes, and A. Valenzuela. 2020. “A Review of Convolutional Neural Network Applied to Fruit Image Processing.” Applied Sciences 10 (10): 3443. https://doi.org/10.3390/app10103443.
  • Nazeer, M., C. Olayinka Ilori, M. Bilal, J. Elizabeth Nichol, W. Wu, Z. Qiu, and B. Krishna Gayene. 2021. “Evaluation of Atmospheric Correction Methods for Low to High Resolutions Satellite Remote Sensing Data.” Atmospheric Research 249:105308. https://doi.org/10.1016/j.atmosres.2020.105308.
  • O’Neil, J. M., T. W. Davis, M. A. Burford, and C. J. Gobler. 2012. “The Rise of Harmful Cyanobacteria Blooms: The Potential Roles of Eutrophication and Climate Change.” Harmful Algae 14:313–334. https://doi.org/10.1016/j.hal.2011.10.027.
  • Park, J., K. Tae Kim, and W. Hyoung Lee. 2020. “Recent Advances in Information and Communications Technology (ICT) and Sensor Technology for Monitoring Water Quality.” Water 12 (2): 510. https://doi.org/10.3390/w12020510.
  • Pianosi, F., and K. Beven, Jim J. Freer, J. W. Hall W , J. Rougier, D. B. Stephenson, and T. Wagener. 2016. “Sensitivity analysis of environmental models: A systematic review with practical workflow.” Environmental Modelling & Software 79: 214–232.
  • Pyo, J., S. H. Ha, Y. A. Pachepsky, H. Lee, R. Ha, G. Nam, M. S. Kim, J. Im, and K. Hwa Cho. 2016. “Chlorophyll-A Concentration Estimation Using Three Difference Bio-Optical Algorithms, Including a Correction for the Low-Concentration Range: The Case of the Yiam Reservoir, Korea.” Remote Sensing Letters 7 (5): 407–416. https://doi.org/10.1080/2150704X.2016.1142680.
  • Pyo, J., S. Min Hong, J. Jang, S. Park, J. Park, J. Hoon Noh, and K. Hwa Cho. 2022. “Drone-Borne Sensing of Major and Accessory Pigments in Algae Using Deep Learning Modeling.” GIScience & Remote Sensing 59 (1): 310–332. https://doi.org/10.1080/15481603.2022.2027120.
  • Richter, R., and D. Schläpfer. 2002. “Geo-Atmospheric Processing of Airborne Imaging Spectrometry Data. Part 2: Atmospheric/Topographic Correction.” International Journal of Remote Sensing 23 (13): 2631–2649. https://doi.org/10.1080/01431160110115834.
  • Romero, S., J. M. Luis, and V. Vilaplana. 2020. “Super-Resolution of Sentinel-2 Imagery Using Generative Adversarial Networks.” Remote Sensing 12 (15): 2424. https://doi.org/10.3390/rs12152424.
  • Sara, U., M. Akter, and M. Shorif Uddin. 2019. “Image Quality Assessment Through FSIM, SSIM, MSE and PSNR—A Comparative Study.” Journal of Computer and Communications 7 (3): 8–18. https://doi.org/10.4236/jcc.2019.73002.
  • Tao, L., J. Wang, Y. Zhang, Z. Wang, and J. Jiang. 2019. “Satellite Image Super-Resolution via Multi-Scale Residual Deep Neural Network.” Remote Sensing 11 (13): 1588. https://doi.org/10.3390/rs11131588.
  • Tuominen, J., and T. Lipping. 2011. Atmospheric Correction of Hyperspectral Data Using Combined Empirical and Model Based Method. Paper presented at the Proceedings of the 7th European association of remote sensing laboratories SIG-imaging spectroscopy workshop, Edinburgh, Scotland, UK.
  • Viaña-Borja, S. P., and M. Ortega-Sánchez. 2019. “Automatic Methodology to Detect the Coastline from Landsat Images with a New Water Index Assessed on Three Different Spanish Mediterranean Deltas.” Remote Sensing 11 (18): 2186. https://doi.org/10.3390/rs11182186.
  • Wang, P., B. Bayram, and E. Sertel. 2022. “A Comprehensive Review on Deep Learning Based Remote Sensing Image Super-Resolution Methods.” Earth-Science Reviews 232:104110. https://doi.org/10.1016/j.earscirev.2022.104110.
  • Wang, Z., J. Chen, and S. C. Hoi. 2020. “Deep Learning for Image Super-Resolution: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (10): 3365–3387. https://doi.org/10.1109/TPAMI.2020.2982166.
  • Wang, H., E. Galbraith, and M. Convertino. 2023. “Algal Bloom Ties: Spreading Network Inference and Extreme Eco-Environmental Feedback.” Entropy 25 (4): 636.
  • Wang, C., Z. Ruifei, Y. Bai, P. Zhang, and H. Fan. 2021. “Single-Frame Super-Resolution for High Resolution Optical Remote-Sensing Data Products.” International Journal of Remote Sensing 42 (21): 8099–8123. https://doi.org/10.1080/01431161.2021.1971790.
  • Xia, H., L. Chu, J. Pei, W. Liu, and J. Bian. 2021. “Model Complexity of Deep Learning: A Survey.” Knowledge and Information Systems 63 (10): 2585–2619. https://doi.org/10.1007/s10115-021-01605-0.
  • Yang, D., Z. Li, Y. Xia, and Z. Chen. 2015. Remote Sensing Image Super-Resolution: Challenges and Approaches. Paper presented at the 2015 IEEE International Conference on Digital Signal Processing (DSP), 21-24 July 2015, Singapore, 21-24 July 2015. https://doi.org/10.1109/ICDSP.2015.7251858.
  • Yang, W., X. Zhang, Y. Tian, W. Wang, J.-H. Xue, and Q. Liao. 2019. “Deep Learning for Single Image Super-Resolution: A Brief Review.” IEEE Transactions on Multimedia 21 (12): 3106–3121. https://doi.org/10.1109/TMM.2019.2919431.
  • Zhang, H., and B. Huang. 2011. Scale Conversion of Multi Sensor Remote Sensing Image Using Single Frame Super Resolution Technology. Paper presented at the 2011 19th International Conference on Geoinformatics, 24-26 June 2011, Shanghai, China. IEEE. https://doi.org/10.1109/GeoInformatics.2011.5980856.
  • Zhao, G., M. Zhang, J. Liu, and J.-R. Wen. 2019. “Unsupervised Adversarial Attacks on Deep Feature-Based Retrieval with GAN.” arXiv Preprint arXiv 1907:05793.