Message Deletion on Telegram: Affected Data Types and Implications for Computational Analysis

References

• Akbari, A., & Gabdulhakov, R. (2019). Platform surveillance and resistance in Iran and Russia: The case of Telegram. Surveillance & Society, 17(1/2), 223–231. https://doi.org/10.24908/ss.v17i1/2.12928
   Web of Science ®Google Scholar
• Almuhimedi, H., Wilson, S., Liu, B., Sadeh, N., & Acquisti, A. (2013). Tweets are forever: A large-scale quantitative analysis of deleted tweets. Proceedings of the 2013 Conference on Computer Supported Cooperative Work, 897–908. https://doi.org/10.1145/2441776.2441878
   Google Scholar
• Amarasingam, A., Maher, S., & Winter, C. (2021). How Telegram disruption impacts Jihadist platform migration. Centre for Research and Evidence on Security Threats.
   Google Scholar
• Bachl, M. (2018). An evaluation of retrospective Facebook content collection. In Dynamische Prozesse der öffentlichen Kommunikation: Methodische Herausforderungen (pp. 57–72). Halem. Preprint. https://doi.org/10.31219/osf.io/6txge
   Google Scholar
• Bamman, D., O’connor, B., & Smith, N. (2012). Censorship and deletion practices in Chinese social media. First Monday, https://doi.org/10.5210/fm.v17i3.3943
   Google Scholar
• Bastos, M. (2021). This account doesn’t exist: Tweet decay and the politics of deletion in the brexit debate. The American Behavioral Scientist, 65(5), 757–773. https://doi.org/10.1177/0002764221989772
   Web of Science ®Google Scholar
• Baumgartner, J., Zannettou, S., Squire, M., & Blackburn, J. (2020). The pushshift Telegram dataset. Proceedings of the International AAAI Conference on Web and Social Media, Atlanta, GA, USA, 14, 840–847. https://doi.org/10.1609/icwsm.v14i1.7348
   Google Scholar
• Bennett, W. L., & Segerberg, A. (2012). The logic of connective action. Information, Communication & Society, 15(5), 739–768. https://doi.org/10.1080/1369118X.2012.670661
   Web of Science ®Google Scholar
• Benoit, K., Watanabe, K., Wang, H., Nulty, P., Obeng, A., Müller, S., & Matsuo, A. (2018). quanteda: An R package for the quantitative analysis of textual data. Journal of Open Source Software, 3(30), 30. https://doi.org/10.21105/joss.00774
   Google Scholar
• Blei, D. M., & Lafferty, J. D. (2007). A correlated topic model of Science. The Annals of Applied Statistics, 1(1), 1. https://doi.org/10.1214/07-AOAS114
   Web of Science ®Google Scholar
• Bovet, A., & Grindrod, P. (2020). The activity of the far right on Telegram v2.11. https://doi.org/10.13140/RG.2.2.16700.05764
   Google Scholar
• Bruns, A. (2008). Life beyond the public sphere: Towards a networked model for political deliberation. Information Polity, 13(1–2), 71–85. https://doi.org/10.3233/IP-2008-0141
   Google Scholar
• Bryanov, K., Vasina, D., Pankova, Y., & Pakholkov, V. (2022). The other side of deplatforming: Right-wing Telegram in the wake of trump’s Twitter ouster. In D. A. Alexandrov, A. V. Boukhanovsky, A. V. Chugunov, Y. Kabanov, O. Koltsova, I. Musabirov, & S. Pashakhin (Eds.), Digital transformation and global society (pp. 417–428). Springer International Publishing. https://doi.org/10.1007/978-3-030-93715-7_30
   Google Scholar
• Bundesamt für Verfassungsschutz. (2021). Neuer Phänomenbereich “Verfassungsschutzrelevante Delegitimierung des Staates” (Accessed: April 04 2022). https://web.archive.org/web/20220318174618/https://www.verfassungsschutz.de/SharedDocs/kurzmeldungen/DE/2021/2021-04-29-querdenker.html
   Google Scholar
• Bykov, I. A., Medvedeva, M. V., & Hradziushka, A. A. (2021). Anonymous communication strategy in Telegram: Toward comparative analysis of Russia and Belarus. Communication Strategies in Digital Society Seminar (ComSds), 14–17. https://doi.org/10.1109/ComSDS52473.2021.9422858
   Google Scholar
• Chen, K., Kim, S. J., Gao, Q., & Raschka, S. (2022). Visual framing of science conspiracy videos. Computational Communication Research, 4(1), 1. https://doi.org/10.5117/CCR2022.1.003.CHEN
   Google Scholar
• Collier, K., Schecter, A., & Kaplan, E. (2021, January 14). Telegram, a recent haven for the far right, purges extremist content. NBC News, https://web.archive.org/web/20220326070323/
   Google Scholar
• Conway, M., Khawaja, M., Lakhani, S., Reffin, J., Robertson, A., & Weir, D. (2019). Disrupting daesh: Measuring takedown of online terrorist material and its impacts. Studies in Conflict & Terrorism, 42(1–2), 141–160. https://doi.org/10.1080/1057610X.2018.1513984
   Web of Science ®Google Scholar
• Daffalla, A., Simko, L., Kohno, T., & Bardas, A. G. (2021). Defensive technology use by political activists during the Sudanese revolution. 2021 IEEE Symposium on Security and Privacy (SP), 372–390. https://doi.org/10.1109/SP40001.2021.00055
   Google Scholar
• Dahlgren, P. (2005). The internet, public spheres, and political communication: Dispersion and deliberation. Political Communication, 22(2), 147–162. https://doi.org/10.1080/10584600590933160
   Web of Science ®Google Scholar
• Ermoshina, K., & Musiani, F. (2021). The Telegram ban: How censorship “made in Russia” faces a global internet. First Monday, 26(5). https://doi.org/10.5210/fm.v26i5.11704
   Google Scholar
• Fang, Z., Dudek, J., & Costas, R. (2020). The stability of Twitter metrics: A study on unavailable Twitter mentions of scientific publications. Journal of the Association for Information Science and Technology, 71(12), 1455–1469. https://doi.org/10.1002/asi.24344
   Web of Science ®Google Scholar
• Fang, Z., Dudek, J., & Costas, R. (2022). Facing the volatility of tweets in altmetric research. Journal of the Association for Information Science and Technology, 73(8), 1192–1195. n/a(n/a). https://doi.org/10.1002/asi.24624
   Web of Science ®Google Scholar
• Frischlich, L., Schatto-Eckrodt, T., & Völker, J. (2022). Withdrawal to the shadows: Dark social media as opportunity structures for extremism. CoRE NRW Forschungspapier, 3, 39.
   Google Scholar
• Fu, K., Chan, C., & Chau, M. (2013). Assessing censorship on microblogs in China: Discriminatory keyword analysis and the real-name registration policy. IEEE Internet Computing, 17(3), 42–50. https://doi.org/10.1109/MIC.2013.28
   Web of Science ®Google Scholar
• Gagrčin, E. (2022). Your social ties, your personal public sphere, your responsibility: How users construe a sense of personal responsibility for intervention against uncivil comments on Facebook. New Media & Society, 146144482211174. https://doi.org/10.1177/14614448221117499
   Web of Science ®Google Scholar
• Garry, A., Walther, S., Rukaya, R., & Mohammed, A. (2021). Qanon conspiracy theory: Examining its evolution and mechanisms of radicalization. Journal for Deradicalization, 26(1).
   Google Scholar
• Garten, J., Hoover, J., Johnson, K. M., Boghrati, R., Iskiwitch, C., & Dehghani, M. (2018). Dictionaries and distributions: Combining expert knowledge and large scale textual data content analysis: Distributed dictionary representation. Behavior Research Methods, 50(1), 344–361. https://doi.org/10.3758/s13428-017-0875-9
   PubMed Web of Science ®Google Scholar
• Gerster, L., Kuchta, R., Hammer, D., & Schwieter, C. (2021). Stützpfeiler Telegram. Wie Rechtsextreme und Verschwörungsideolog:innen auf Telegram ihre Infrastruktur ausbauen. https://www.isdglobal.org/isd-publications/stutzpfeiler-telegram-wie-rechtsextreme-und-verschworungsideologinnen-auf-telegram-ihre-infrastruktur-ausbauen/
   Google Scholar
• Gill, G. (2021). Fascist cross-pollination of Australian conspiracist Telegram channels. First Monday, 26(12). https://doi.org/10.5210/fm.v26i12.11830
   Google Scholar
• Gorwa, R. (2019). What is platform governance? Information, Communication & Society, 22(6), 854–871. https://doi.org/10.1080/1369118X.2019.1573914
   Web of Science ®Google Scholar
• Granovetter, M. S. (1973). The strength of weak ties. The American Journal of Sociology, 78(6), 1360–1380. https://doi.org/10.1086/225469
   Web of Science ®Google Scholar
• Guhl, J., & Davey, J. (2020). A safe space to hate: White supremacist mobilisation on Telegram. Institute for Strategic Dialogue, 26. https://www.isdglobal.org/isd-publications/a-safe-space-to-hate-white-supremacist-mobilisation-on-telegram/
   Google Scholar
• Heft, A., & Buehling, K. (2022). Measuring the diffusion of conspiracy theories in digital information ecologies. Convergence: The International Journal of Research into New Media Technologies, 28(4), 940–961. https://doi.org/10.1177/13548565221091809
   Web of Science ®Google Scholar
• Ho, J.C.-T. (2020). How biased is the sample? reverse engineering the ranking algorithm of Facebook’s Graph application programming interface. Big Data & Society, 7(1), 2053951720905874. https://doi.org/10.1177/2053951720905874
   Web of Science ®Google Scholar
• Holzer, B. (2021). Zwischen Protest und Parodie: Strukturen der “Querdenken”-Kommunikation auf Telegram (und anderswo). Die Misstrauensgemeinschaft der ”Querdenker”. Die Corona-Proteste aus kultur- und sozialwissenschaftlicher Perspektive (pp. 125–157). Frankfurt am Main: Campus Verlag.
   Google Scholar
• Hong, L., & Davison, B. D. (2010). Empirical study of topic modeling in Twitter. Proceedings of the First Workshop on Social Media Analytics - SOMA’ 10, 80–88. https://doi.org/10.1145/1964858.1964870
   Google Scholar
• Hoseini, M., Melo, P., Benevenuto, F., Feldmann, A., & Zannettou, S. (2021). On the globalization of the qanon conspiracy theory through Telegram. arXiv preprint arXiv:2105.13020.
   Google Scholar
• Hunger, S., Völker, T., & Gonzatti, D. S. (2021). Der Verlust der Vielfalt: Die Corona-Proteste in Deutschland werden durch eine radikale Minderheit geprägt. WZB-Mitteilungen, 172, 30–32.
   Google Scholar
• Jalilvand, A., & Neshati, M. (2020). Channel retrieval: Finding relevant broadcasters on Telegram. Social Network Analysis and Mining, 10(1), 23. https://doi.org/10.1007/s13278-020-0629-z
   Web of Science ®Google Scholar
• Jigsaw. (2022). Perspective API - Attributes and Languages. https://developers.perspectiveapi.com/s/about-the-api-attributes-and-languages
   Google Scholar
• Kaiser, J., & Rauchfleisch, A. (2019). Integrating concepts of counterpublics into generalised public sphere frameworks: Contemporary transformations in radical forms. Javnost - the Public, 26(3), 3. https://doi.org/10.1080/13183222.2018.1558676
   Web of Science ®Google Scholar
• Kargar, S., & Mcmanamen, k. (2018). censorship and collateral damage: Analyzing the Telegram ban in Iran (SSRN Scholarly Paper ID3244046). Social Science Research Network. https://doi.org/10.2139/ssrn.3244046
   Google Scholar
• Kendall, M. G. (1945). The treatment of ties in ranking problems. Biometrika, 33(3), 239–251. https://doi.org/10.1093/biomet/33.3.239
   PubMed Web of Science ®Google Scholar
• King, G., Pan, J., & Roberts, M. E. (2014). Reverse-engineering censorship in China: Randomized experimentation and participant observation. Science, 345(6199), 1251722. https://doi.org/10.1126/science.1251722
   PubMed Web of Science ®Google Scholar
• Kurdi, M., Albadi, N., & Mishra, S. (2020). “Video unavailable”: Analysis and prediction of deleted and moderated youtube videos. 2020 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), 166–173. https://doi.org/10.1109/ASONAM49781.2020.9381310
   Google Scholar
• La Morgia, M., Mei, A., Mongardini, A. M., & Wu, J. (2021). uncovering the dark side of telegram: Fakes, clones, scams, and conspiracy movements. (arXiv:211113530) arXiv, https://doi.org/10.48550/arXiv.2111.13530
   Google Scholar
• Little, R. J. A., & Schenker, N. (1995). Missing Data. In G. Arminger, C. C. Clogg, & M. E. Sobel (Eds.), Handbook of statistical modeling for the social and behavioral sciences (pp. 39–75). Springer US. https://doi.org/10.1007/978-1-4899-1292-3_2
   Google Scholar
• Loucaides, D., Perrone, A., & Holnburger, J. (2021, March 31). How Germany became ground zero for the COVID infodemic. OpenDemocracy. https://www.opendemocracy.net/en/germany-ground-zero-covid-infodemic-russia-far-right/
   Google Scholar
• Macklin, G. (2022). The extreme right, climate change and terrorism. Terrorism and Political Violence, 34(5), 979–996. https://doi.org/10.1080/09546553.2022.2069928
   Web of Science ®Google Scholar
• Maier, D., Niekler, A., Wiedemann, G., & Stoltenberg, D. (2020). How document sampling and vocabulary pruning affect the results of topic models. Computational Communication Research, 2(2), 2. https://doi.org/10.5117/CCR2020.2.001.MAIE
   Google Scholar
• Maier, D., Waldherr, A., Miltner, P., Wiedemann, G., Niekler, A., Keinert, A., Pfetsch, B., Heyer, G., Reber, U., Häussler, T., Schmid-Petri, H., & Adam, S. (2018). Applying LDA topic modeling in communication research: Toward a valid and reliable methodology. Communication Methods and Measures, 12(2–3), 93–118. https://doi.org/10.1080/19312458.2018.1430754
   Web of Science ®Google Scholar
• Maréchal, N. (2018). From Russia with crypto: A political history of Telegram. 8th {USENIX} Workshop on Free and Open Communications on the Internet ({FOCI} 18), Baltimore, MD, USA.
   Google Scholar
• Marwick, A. E., & Boyd, D. (2014). Networked privacy: How teenagers negotiate context in social media. New Media & Society, 16(7), 1051–1067. https://doi.org/10.1177/1461444814543995
   Web of Science ®Google Scholar
• McSwiney, J., Vaughan, M., Heft, A., & Hoffmann, M. (2021). Sharing the hate? memes and transnationality in the far right’s digital visual culture. Information, Communication & Society, 24(16), 2502–2521. https://doi.org/10.1080/1369118X.2021.1961006
   Web of Science ®Google Scholar
• Morstatter, F., Pfeffer, J., Liu, H., & Carley, K. (2013). Is the sample good enough? comparing data from Twitter’s streaming API with Twitter’s firehose. Proceedings of the International AAAI Conference on Web and Social Media, Cambridge, MA, USA, 7(1), 400–408. https://doi.org/10.1609/icwsm.v7i1.14401.
   Google Scholar
• Nachtwey, O., Schäfer, R., & Frei, N. (2020). Politische Soziologie der Corona-Proteste Preprint. SocArXiv. https://doi.org/10.31235/osf.io/zyp3f
   Google Scholar
• Neubaum, G., & Weeks, B. (2022). Computer-mediated political expression: A conceptual framework of technological affordances and individual tradeoffs. Journal of Information Technology & Politics, 0(0). https://doi.org/10.1080/19331681.2022.2028694
   Google Scholar
• Neumayer, C., & Stald, G. (2014). The mobile phone in street protest: Texting, tweeting, tracking, and tracing. Mobile Media & Communication, 2(2), 117–133. https://doi.org/10.1177/2050157913513255
   Web of Science ®Google Scholar
• Niekler, A., & Jähnichen, P. (2012). Matching results of latent Dirichlet allocation for text. Proceedings of the 11th International Conference on Cognitive Modeling, Berlin, Germany. N. Rußwinkel, U. Drewitz & H. van Rijn (eds.), 317–322. Berlin: Universitaetsverlag der TU Berlin.
   Google Scholar
• Nobari, A. D., Reshadatmand, N., & Neshati, M. (2017). Analysis of Telegram, an instant messaging service. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2035–2038. https://doi.org/10.1145/3132847.3133132
   Google Scholar
• Peeters, S., & Willaert, T. (2022). Telegram and digital methods: Mapping networked conspiracy theories through platform affordances. M/C Journal, 25(1), 1. https://doi.org/10.5204/mcj.2878
   Google Scholar
• Pfeffer, J., Mooseder, A., Hammer, L., Stritzel, O., & Garcia, D. (2022). This sample seems to be good enough! assessing coverage and temporal reliability of Twitter’s academic API. ArXiv: 2204 02290 [Cs], http://arxiv.org/abs/2204.02290
   Google Scholar
• Puschmann, C., Karakurt, H., Amlinger, C., Gess, N., & Nachtwey, O. (2022). RPC-lex: A dictionary to measure German right-wing populist conspiracy discourse online. Convergence: The International Journal of Research into New Media Technologies, 28(4), 1144–1171. https://doi.org/10.1177/13548565221109440
   Web of Science ®Google Scholar
• Rajkumar, K., Saint-Jacques, G., Bojinov, I., Brynjolfsson, E., & Aral, S. (2022). A causal test of the strength of weak ties. Science, 377(6612), 1304–1310. https://doi.org/10.1126/science.abl4476
   PubMed Web of Science ®Google Scholar
• Ringel, S., & Davidson, R. (2022). Proactive ephemerality: How journalists use automated and manual tweet deletion to minimize risk and its consequences for social media as a public archive. New Media & Society, 24(5), 1216–1233. https://doi.org/10.1177/1461444820972389
   Web of Science ®Google Scholar
• Roberts, M. E., Stewart, B. M., & Tingley, D. (2019). Stm: An R package for structural topic models. Journal of Statistical Software, 91(1), 1. https://doi.org/10.18637/jss.v091.i02
   Google Scholar
• Rogers, R. (2020). Deplatforming: Following extreme internet celebrities to Telegram and alternative social media. European Journal of Communication, 35(3), 213–229. https://doi.org/10.1177/0267323120922066
   Web of Science ®Google Scholar
• Schatto-Eckrodt, T. (2022). Hidden biases – the effects of unavailable content on Twitter on sampling quality. In J. Jünger, U. Gochermann, C. Peter & M. Bachl (eds.), Grenzen, Probleme und Lösungen bei der Stichprobenziehung (pp. 178–195). Herbert von Halem Verlag.
   Google Scholar
• Scheffler, T., Solopova, V., & Popa-Wyatt, M. (2021). The Telegram chronicles of online harm. Journal of Open Humanities Data, 7(0), 0. https://doi.org/10.5334/johd.31
   Google Scholar
• Schulze, H. (2020). Zur Bedeutung von Dark Social & Deplatforming. Eine quantitative Exploration der deutschsprachigen Rechtsaußenszene auf Telegram. [Dark social & deplatforming. A quantitative exploration of the German-speaking far-right scene on Telegram.]. Zeitschrift Für Semiotik, 42(3–4), 61–86.
   Web of Science ®Google Scholar
• Schulze, H., Hohner, J., Greipl, S., Girgnhuber, M., Desta, I. & Rieger, D. (2022). Far-right conspiracy groups on fringe platforms: a longitudinal analysis of radicalization dynamics on Telegram. Convergence: The International Journal of Research into New Media Technologies, 28(4), 1103–1126. https://doi.org/10.1177/13548565221104977
   Web of Science ®Google Scholar
• Sear, R., Restrepo, N. J., Lupu, Y., & Johnson, N. F. (2022). Dynamic topic modeling reveals variations in online hate narratives. In K. Arai (Ed.), Intelligent Computing (pp. 564–578). Springer International Publishing. https://doi.org/10.1007/978-3-031-10464-0_38
   Google Scholar
• Šipka, A., Hannák, A., & Urman, A. (2022). Comparing the language of qanon-related content on parler, gab, and Twitter. 14th ACM Web Science Conference 2022, 411–421. https://doi.org/10.1145/3501247.3531550
   Google Scholar
• Sosa, J., & Sharoff, S. (2022). Multimodal pipeline for collection of misinformation data from Telegram. (arXiv: 220412690) arXiv, https://doi.org/10.48550/arXiv.2204.12690
   Google Scholar
• Telegram. (2022, April 2). Terms of Service. https://web.archive.org/web/20220402050604/https://telegram.org/tos
   Google Scholar
• Thiele, D. (2022). dictvectoR (version v0.0.1). [Computer software]. Zenodo. https://doi.org/10.5281/zenodo.7079600
   Google Scholar
• Thiele, D. (2023). Contagious comments? How the pandemic has affected populist user comments in seven Western-European countries (in press). Computational Communication Research.
   Google Scholar
• Urman, A., Ho, J. C., & Katz, S. (2021). Analyzing protest mobilization on Telegram: The case of 2019 anti-extradition bill movement in Hong Kong. Plos One, 16(10), e0256675. https://doi.org/10.1371/journal.pone.0256675
   PubMed Web of Science ®Google Scholar
• Urman, A., & Katz, S. (2022). What they do in the shadows: Examining the far-right networks on Telegram. Information, Communication & Society, 25(7), 904–923. https://doi.org/10.1080/1369118X.2020.1803946
   Web of Science ®Google Scholar
• Urman, A., & Katz, S. (2022). Online publicity and outcomes of individual politically salient criminal cases in an authoritarian regime: Evidence from Russia. Political Research Exchange, 4(1), 2095920. https://doi.org/10.1080/2474736X.2022.2095920
   Google Scholar
• van Atteveldt, W., & Peng, T.-Q. (2018). When communication meets computation: opportunities, challenges, and pitfalls in computational communication science. Communication Methods and Measures, 12(2–3), 81–92. https://doi.org/10.1080/19312458.2018.1458084
   Web of Science ®Google Scholar
• Volkova, S., & Bell, E. (2017). Identifying effective signals to predict deleted and suspended accounts on Twitter across languages. Proceedings of the International AAAI Conference on Web and Social Media, Montreal, Canada, 11(1), 290–298.
   Google Scholar
• Walker, S. (2017). The Complexity of Collecting Digital and Social Media Data in Ephemeral Contexts [ Thesis]. https://digital.lib.washington.edu:443/researchworks/handle/1773/40612
   Google Scholar
• Wang, Y., Norcie, G., Komanduri, S., Acquisti, A., Leon, P. G., & Cranor, L. F. (2011). “I regretted the minute I pressed share”: A qualitative study of regrets on Facebook. Proceedings of the Seventh Symposium on Usable Privacy and Security, 1–16. https://doi.org/10.1145/2078827.2078841
   Google Scholar
• Wijermars, M., & Lokot, T. (2022). Is Telegram a “harbinger of freedom”? the performance, practices, and perception of platforms as political actors in authoritarian states. Post-Soviet Affairs, 38(1–2), 1–21. https://doi.org/10.1080/1060586X.2022.2030645
   Web of Science ®Google Scholar
• Xu, J.-M., Burchfiel, B., Zhu, X., & Bellmore, A. (2013). An examination of regret in bullying Tweets. Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 697–702. https://aclanthology.org/N13-1082
   Google Scholar
• Zannettou, S., Caulfield, T., Blackburn, J., De Cristofaro, E., Sirivianos, M., Stringhini, G., & Suarez-Tangil, G. (2018). On the origins of memes by means of fringe Web communities. Proceedings of the Internet Measurement Conference 2018, 188–202. https://doi.org/10.1145/3278532.3278550
   Google Scholar
• Zehring, M. & Domahidi, E. (2023). German Corona Protest Mobilizers on Telegram and Their Relations to the Far Right: A Network and Topic Analysis. Social Media + Society, 9(1). https://doi.org/10.1177/20563051231155106
   Web of Science ®Google Scholar