Multi-class multi-label classification of social media texts for typhoon damage assessment: a two-stage model fully integrating the outputs of the hidden layers of BERT

References

• Cai, Ren, Bin Qin, Yangken Chen, Liang Zhang, Ruijiang Yang, Shiwei Chen, and Wei Wang. 2020. “Sentiment Analysis About Investors and Consumers in Energy Market Based on BERT-BiLSTM.” IEEE Access 8:171408–171415. https://doi.org/10.1109/Access.6287639.
   Web of Science ®Google Scholar
• Cimellaro, Gian Paolo, Andrei M. Reinhorn, and Michel Bruneau. 2010. “Framework for Analytical Quantification of Disaster Resilience.” Engineering Structures 32 (11): 3639–3649. https://doi.org/10.1016/j.engstruct.2010.08.008.
   Web of Science ®Google Scholar
• Clark, Kevin, Minh-Thang Luong, Quoc V. Le, and Christopher D. Manning. 2020. “Electra: Pre-Training Text Encoders as Discriminators Rather Than Generators.” arXiv preprint arXiv:2003.10555: 1–18.
   Google Scholar
• Dai, Zhenjin, Xutao Wang, Pin Ni, Yuming Li, Gangmin Li, and Xuming Bai. 2019. “Named Entity Recognition Using BERT BiLSTM CRF for Chinese Electronic Health Records.” In 2019 12th International Congress on Image and Signal Processing, Biomedical Engineering and Informatics (CISP-BMEI), 1–5. IEEE.
   Google Scholar
• Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. “BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding.” arXiv preprint arXiv:1810.04805: 1–16.
   Google Scholar
• El-Alami, Fatima-Zahra, Said Ouatik El Alaoui, and Noureddine En Nahnahi. 2022. “A Multilingual Offensive Language Detection Method Based on Transfer Learning from Transformer Fine-Tuning Model.” Journal of King Saud University-Computer and Information Sciences 34 (8): 6048–6056. https://doi.org/10.1016/j.jksuci.2021.07.013.
   Web of Science ®Google Scholar
• Goodchild, Michael F., and J. Alan Glennon. 2010. “Crowdsourcing Geographic Information for Disaster Response: A Research Frontier.” International Journal of Digital Earth 3 (3): 231–241. https://doi.org/10.1080/17538941003759255.
   Web of Science ®Google Scholar
• Huang, Xiao, Zhenlong Li, Cuizhen Wang, and Huan Ning. 2019. “Identifying Disaster Related Social Media for Rapid Response: A Visual-Textual Fused CNN Architecture.” International Journal of Digital Earth 13 (9): 1017–1039. https://doi.org/10.1080/17538947.2019.1633425.
   Web of Science ®Google Scholar
• Imran, Muhammad, Shady Elbassuoni, Carlos Castillo, Fernando Diaz, and Patrick Meier. 2013. “Practical Extraction of Disaster-Relevant Information From Social Media.” In Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil, 1021–1024.
   Google Scholar
• Joshi, Mandar, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, and Omer Levy. 2020. “Spanbert: Improving Pre-Training by Representing and Predicting Spans.” Transactions of the Association for Computational Linguistics 8:64–77. https://doi.org/10.1162/tacl_a_00300.
   Google Scholar
• Kumar, Abhinav, Jyoti Prakash Singh, and Sunil Saumya. 2019. “A Comparative Analysis of Machine Learning Techniques for Disaster-Related Tweet Classification.” In 2019 IEEE R10 Humanitarian Technology Conference (R10-HTC)(47129), 222–227. IEEE.
   Google Scholar
• Lam, Nina S. N., Michelle Meyer, Margaret Reams, Seungwon Yang, Kisung Lee, Lei Zou, Volodymyr Mihunov, et al. 2023. “Improving Social Media Use for Disaster Resilience: Challenges and Strategies.” International Journal of Digital Earth 16 (1): 3023–3044. https://doi.org/10.1080/17538947.2023.2239768.
   Web of Science ®Google Scholar
• Lamsal, Rabindra, Aaron Harwood, and Maria Rodriguez Read. 2022. “Socially Enhanced Situation Awareness From Microblogs Using Artificial Intelligence: A Survey.” ACM Computing Surveys 55 (4): 1–38. https://doi.org/10.1145/3524498.
   Web of Science ®Google Scholar
• Lan, Zhenzhong, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. “Albert: A Lite BERT for Self-Supervised Learning of Language Representations.” arXiv preprint arXiv:1909.11942: 1–17.
   Google Scholar
• Li, Zhenlong, Qunying Huang, and Christopher T. Emrich. 2020. “Introduction to Social Sensing and Big Data Computing for Disaster Management.” In Social Sensing and Big Data Computing for Disaster Management, 1–7. Routledge.
   Google Scholar
• Li, Shaopan, Yan Wang, Hong Huang, Lida Huang, and Yang Chen. 2023. “Study on Typhoon Disaster Assessment by Mining Data from Social Media Based on Artificial Neural Network.” Natural Hazards 116 (2): 2069–2089. https://doi.org/10.1007/s11069-022-05754-5.
   Web of Science ®Google Scholar
• Liu, Nelson F., Matt Gardner, Yonatan Belinkov, Matthew E. Peters, and Noah A. Smith. 2019. “Linguistic Knowledge and Transferability of Contextual Representations.” arXiv preprint arXiv:1903.08855: 1–22.
   Google Scholar
• Liu, Yinhan, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, et al. 2019. “Roberta: A Robustly Optimized Bert Pretraining Approach.” arXiv preprint arXiv:1907.11692: 1–13.
   Google Scholar
• Mehta, Meet, Dhruv Gada, Riddhi Sharma, Khushi Chavan, and Pratik Kanani. 2022. “Offense Detection Using BERT and CNN.” In 2022 IEEE 3rd Global Conference for Advancement in Technology (GCAT), 1–5. IEEE.
   Google Scholar
• Ngamassi, Louis, Hesam Shahriari, Thiagarajan Ramakrishnan, and Shahedur Rahman. 2022. “Text Mining Hurricane Harvey Tweet Data: Lessons Learned and Policy Recommendations.” International Journal of Disaster Risk Reduction 70:102753. https://doi.org/10.1016/j.ijdrr.2021.102753.
   Web of Science ®Google Scholar
• Ogie, R. I., S. James, A. Moore, T. Dilworth, M. Amirghasemi, and J. Whittaker. 2022. “Social Media Use in Disaster Recovery: A Systematic Literature Review.” International Journal of Disaster Risk Reduction 70:102783. https://doi.org/10.1016/j.ijdrr.2022.102783.
   Web of Science ®Google Scholar
• Rodríguez, Oriol, Joan Bech, Juan de Dios Soriano, Delia Gutiérrez, and Salvador Castán. 2020. “A Methodology to Conduct Wind Damage Field Surveys for High-Impact Weather Events of Convective Origin.” Natural Hazards and Earth System Sciences 20 (5): 1513–1531. https://doi.org/10.5194/nhess-20-1513-2020.
   Web of Science ®Google Scholar
• Sanh, Victor, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. “DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter.” arXiv preprint arXiv:1910.01108: 1–5.
   Google Scholar
• Saroj, Anita, and Sukomal Pal. 2020. “Use of Social Media in Crisis Management: A Survey.” International Journal of Disaster Risk Reduction 48:101584. https://doi.org/10.1016/j.ijdrr.2020.101584.
   Web of Science ®Google Scholar
• Senaratne, Hansi, Martin Mühlbauer, Stephan Götzer, Torsten Riedlinger, and Hannes Taubenböck. 2023. “Detecting Crisis Events From Unstructured Text Data Using Signal Words As Crisis Determinants.” International Journal of Digital Earth 16 (2): 4601–4620. https://doi.org/10.1080/17538947.2023.2278714.
   Web of Science ®Google Scholar
• Tim, Yenni, Shan L. Pan, Peter Ractham, and Laddawan Kaewkitipong. 2017. “Digitally Enabled Disaster Response: The Emergence of Social Media As Boundary Objects in a Flooding Disaster.” Information Systems Journal 27 (2): 197–232. https://doi.org/10.1111/isj.v27.2.
   Web of Science ®Google Scholar
• Vongkusolkit, Jirapa, and Qunying Huang. 2021. “Situational Awareness Extraction: A Comprehensive Review of Social Media Data Classification During Natural Hazards.” Annals of GIS 27 (1): 5–28. https://doi.org/10.1080/19475683.2020.1817146.
   Web of Science ®Google Scholar
• Wan, Chang-Xuan, and Bo Li. 2022. “Financial Causal Sentence Recognition Based on BERT-CNN Text Classification.” The Journal of Supercomputing 78: 6503–6527. https://doi.org/10.1007/s11227-021-04097-5.
   Web of Science ®Google Scholar
• Wu, Desheng, and Yiwen Cui. 2018. “Disaster Early Warning and Damage Assessment Analysis Using Social Media Data and Geo-Location Information.” Decision Support Systems 111:48–59. https://doi.org/10.1016/j.dss.2018.04.005.
   Web of Science ®Google Scholar
• Yang, Tengfei, Jibo Xie, Guoqing Li, Naixia Mou, Zhenyu Li, Chuanzhao Tian, and Jing Zhao. 2019. “Social Media Big Data Mining and Spatio-Temporal Analysis on Public Emotions for Disaster Mitigation.” ISPRS International Journal of Geo-Information 8 (1): 29. https://doi.org/10.3390/ijgi8010029.
   Web of Science ®Google Scholar
• Yu, Manzhu, Qunying Huang, Han Qin, Chris Scheele, and Chaowei Yang. 2020. “Deep Learning for Real-Time Social Media Text Classification for Situation Awareness–Using Hurricanes Sandy, Harvey, and Irma as Case Studies.” In Social Sensing and Big Data Computing for Disaster Management, 33–50. Routledge.
   Google Scholar
• Zhang, Ting, Shi Shen, Changxiu Cheng, Kai Su, and Xiangxue Zhang. 2021. “A Topic Model Based Framework for Identifying the Distribution of Demand for Relief Supplies Using Social Media Data.” International Journal of Geographical Information Science 35 (11): 2216–2237. https://doi.org/10.1080/13658816.2020.1869746.
   Web of Science ®Google Scholar
• Zhou, Chengle, Zhi He, Anjun Lou, and Antonio Plaza. 2024. “RGB-to-HSV: A Frequency-Spectrum Unfolding Network for Spectral Super-Resolution of RGB Videos.” IEEE Transactions on Geoscience and Remote Sensing 62: 1–18.
   Web of Science ®Google Scholar
• Zhou, Bing, Lei Zou, Ali Mostafavi, Binbin Lin, Mingzheng Yang, Nasir Gharaibeh, Heng Cai, Joynal Abedin, and Debayan Mandal. 2022. “VictimFinder: Harvesting Rescue Requests in Disaster Response from Social Media with BERT.” Computers, Environment and Urban Systems 95:101824.
   Web of Science ®Google Scholar
• Zou, Lei, Nina S. N. Lam, Shayan Shams, Heng Cai, Michelle A. Meyer, Seungwon Yang, Kisung Lee, Seung-Jong Park, and Margaret A. Reams. 2018. “Social and Geographical Disparities in Twitter Use During Hurricane Harvey.” International Journal of Digital Earth 12 (11): 1300–1318. https://doi.org/10.1080/17538947.2018.1545878.
   Web of Science ®Google Scholar