Weathering and weaponizing the #TwitterPurge: Digital content moderation and the dimensions of deplatforming

Bibliography

• Alan Turing Institute staff. 2020. “Detecting East Asian Prejudice on Social Media.” Alan Turing Institute.
   Google Scholar
• Alterman, E. What Liberal Media?: The Truth About Bias and the News. New York, NY: Basic Books, 2003.
   Google Scholar
• Anderson, B. Imagined Communities: Reflections on the Origin and Spread of Nationalism. New York City, NY: Verso Books, 1983.
   Google Scholar
• Andrews, L. Facebook, the Media and Democracy: Big Tech, Small State?. New York City, NY: Routledge, 2020. doi:10.4324/9780429466410.
   Google Scholar
• Asenas, J. J., and B. Hubble. “Trolling Free Speech Rallies: Social Media Practices and the (Un)democratic Spectacle of Dissent.” Taboo: The Journal of Culture and Education 17, no. 2 (2018): 36–53. doi:10.31390/taboo.17.2.06.
   Google Scholar
• Bannerman, S., and B. Haggart. “Historical Institutionalism in Communication Studies.” Communication Theory 25, no. 1 (2015): 1–22. doi:10.1111/comt.12051.
   Web of Science ®Google Scholar
• Benjamin, R. Race After Technology. Cambridge, UK: Polity Press, 2019.
   Google Scholar
• Benkler, Y., R. Faris, and H. Roberts. Network Propaganda: Manipulation, Disinformation, and Radicalization in American Politics. Oxford, UK: Oxford University Press, 2018. doi:10.1093/oso/9780190923624.001.0001.
   Google Scholar
• Boyd, D. “Social Network Sites as Networked Publics: Affordances, Dynamics, and Implications.” In Networked Self: Identity, Community, and Culture on Social Network Sites, edited by Z. Papacharissi, 39–58. Abingdon, UK: Routledge, 2010.
   Google Scholar
• Bromwich, J. E. “Everyone is Cancelled.” The New York Times, June 28, 2018.
   Google Scholar
• Brown, É. “Free Speech and the Legal Prohibition of Fake News.” Social Theory and Practice 49, no. 1 (2023): 29–55. doi:10.5840/soctheorpract202333179.
   Google Scholar
• Chandrasekharan, E., U. Pavalanathan, A. Srinivasan, A. Glynn, J. Eisenstein, and E. Gilbert. “You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech.” Proceedings of the ACM on Human-Computer Interaction, Denver, CO, United States of America, Vol. 31, 2017.
   Google Scholar
• Citron, D. K., and M. A. Franks. “The Internet as a Speech Machine and Other Myths Confounding Section 230 Speech Reform.” University of Chicago Legal Forum (2020): 45. doi:10.2139/ssrn.3532691.
   Google Scholar
• Coaston, J. “Gab, the Social Media Platform Favored by the Alleged Pittsburgh Shooter, Explained.” Vox (2018). Accessed October 6, 2023. https://www.vox.com/policy-and-politics/2018/10/29/18033006/gab-social-media-antisemitism-neo-nazis-twitter-facebook.
   Google Scholar
• Coates, T.-N. 2019. “The Cancellation of Colin Kaepernick.” The New York Times, November 22, 2019.
   Google Scholar
• Coe, P. “The Draft Online Safety Bill and the Regulation of Hate Speech: Have We Opened Pandora’s Box?” Journal of Media Law 14, no. 1 (2022): 50–75. doi:10.1080/17577632.2022.2083870.
   Google Scholar
• Cohen, J. N. “Exploring Echo-Systems: How Algorithms Shape Immersive Media Environments.” Journal of Media Literacy Education 10, no. 2 (2018): 139–151. doi:10.23860/JMLE-2018-10-2-8.
   Google Scholar
• Congressional Digest staff. What Congress is Doing on Content Moderation: The Two Parties Can’t Agree How to Reform Section 230. Washington, DC: Congressional Digest, 2022.
   Google Scholar
• Daniels, J. “The Algorithmic Rise of the ‘Alt-Right.’.” Contexts 17, no. 1 (2018): 60–65. doi:10.1177/1536504218766547.
   Google Scholar
• De Kosnik, A. Rogue Archives: Digital Cultural Memory and Media Fandom. Cambridge, MA: MIT Press, 2016. doi:10.7551/mitpress/10248.001.0001.
   Google Scholar
• Department for Digital Culture, Media and Sport staff. 2020. “Full Government Response to the Consultation.” CP 354 Online Harms White Paper.
   Google Scholar
• Donovan, J. “After the #keyword: Eliciting, Sustaining, and Coordinating Participation Across the Occupy Movement.” Social Media + Society 4, no. 1 (2018): 1–12. doi:10.1177/2056305117750720.
   Web of Science ®Google Scholar
• Donovan, J. “Navigating the Tech Stack: When, Where and How Should We Moderate Content?” Centre for International Governance Innovation (2019).Accessed 28 October, 2019. https://www.cigionline.org/articles/navigating-tech-stackwhen-where-and-how-should-we-moderate-content/.
   Google Scholar
• Donovan, J., B. Lewis, and B. Friedberg. “Parallel Ports: Sociotechnical Change for the Alt-Right to Alt-Tech.” In Post-Digital Cultures of the Far Right: Online Actions and Offline Consequences in Europe and the US, edited by M. Fielitz and N. Thurston, 49–65. Bielefeld, DE: Philipps Universität Marburg, 2019. doi:10.1515/9783839446706-004.
   Google Scholar
• Douek, E. “What Kind of Oversight Board Have You Given Us?” University of Chicago Law Review Online (2020). Accessed11 May, 2020. https://lawreviewblog.uchicago.edu/2020/05/11/fb-oversight-boardedouek/.
   Google Scholar
• Douek, E. “Governing Online Speech: From ‘Posts-As-Trumps’ to Proportionality and Probability.” Columbia Law Review 121, no. 3 (2021): 759–834. doi:10.2139/ssrn.3679607.
   Web of Science ®Google Scholar
• Dworkin, R. “A New Map of Censorship.” Index on Censorship 23, no. 1–2 (1994): 1–2. doi:10.1080/03064229408535633.
   Web of Science ®Google Scholar
• Edwards, P. N., S. J. Jackson, M. K. Chalmers, G. C. Bowker, C. L. Borgman, D. Ribes, M. Burton, and S. Calvert. “Knowledge Infrastructures: Intellectual Frameworks and Research Challenges”. (2013)Accessed 25-28, May 2012. https://hdl.handle.net/2027.42/97552.
   Google Scholar
• Engels, J. “The Politics of Resentment and the Tyranny of the Minority: Re-Thinking Victimage for Resentful Times.” Rhetoric Society Quarterly 40, no. 4 (2010): 303–325. doi:10.1080/02773941003785652.
   Web of Science ®Google Scholar
• European Commission. “Tackling Illegal Content Online: Towards an Enhanced Responsibility of Online Platforms.” COM 2017, (2017): 1–20.
   Google Scholar
• Farkas, J., and J. Schou. “Fake News as a Floating Signifier: Hegemony, Antagonism and the Politics of Falsehood.” Javnost - the Public 25, no. 3 (2018): 298–314. doi:10.1080/13183222.2018.1463047.
   Web of Science ®Google Scholar
• Flew, T., and D. Wilding. “The Turn to Regulation in Digital Communication: The Accc’s Digital Platforms Inquiry and Australian Media Policy.” Media, Culture & Society 43, no. 1 (2021): 48–65. doi:10.1177/0163443720926044.
   Web of Science ®Google Scholar
• Gillespie, T. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. New Haven, CT: Yale University Press, 2018. doi:10.12987/9780300235029.
   Google Scholar
• Gitelman, L. Raw Data is an Oxymoron. Cambridge, MA: MIT Press, 2013. doi:10.7551/mitpress/9302.001.0001.
   Google Scholar
• Gorwa, R. “The Platform Governance Triangle: Conceptualising the Informal Regulation of Online Content.” Internet Policy Review 8, no. 2 (2019): 11–18. doi:10.14763/2019.2.1407.
   Web of Science ®Google Scholar
• Gorwa, R. “What is Platform Governance?” Information, Communication & Society 22, no. 6 (2019): 854–871. doi:10.1080/1369118X.2019.1573914.
   Web of Science ®Google Scholar
• Gorwa, R. “Elections, Institutions, and the Regulatory Politics of Platform Governance: The Case of the German NetzDg.” Telecommunication Policy 45, no. 6 (2021): 1–14. doi:10.1016/j.telpol.2021.102145.
   Web of Science ®Google Scholar
• Henry, F., and A. L. Newman. “Making Global Markets: Historical Institutionalism in International Political Economy.” Review of International Political Economy 17, no. 4 (2010): 609–638. doi:10.1080/09692291003723672.
   Web of Science ®Google Scholar
• Ingram, M. “First It Was Milo and Alex Jones, Now Platforms are Being De-Platformed.” Columbia Journalism Review (2018). Accessed, October 30, 2018. https://www.cjr.org/the_new_gatekeepers/gab-godaddydeplatforming.php.
   Google Scholar
• Jardine, E. “Online Content Moderation and the Dark Web: Policy Responses to Radicalizing Hate Speech and Malicious Content on the Darknet.” First Monday 24, no. 12 (2019). doi:10.5210/fm.v24i12.10266.
   Google Scholar
• Jeremy, B., R. W. Gehl, and U. Etudo. “Does ‘Deplatforming’ Work to Curb Hate Speech and Calls for Violence? 3 Experts in Online Communications Weigh in” The Conversation (2021). Accessed, January 15, 2021. https://theconversation.com/does-deplatforming-work-to-curb-hate-speech-and-calls-forviolence-3-experts-in-online-communications-weigh-in-153177.
   Google Scholar
• Kang, C., and D. McCabe 2021. “House Lawmakers are Considering 6 Bills Aimed at Big Tech.” New York Times, June 23, 2021.
   Google Scholar
• Kaye, D. 2019. Speech Police: The Global Struggle to Govern the Internet. New York, NY: Columbia Global Reports.
   Google Scholar
• Klonick, K. “The New Governors: The People, Rules, and Processes Governing Online Speech.” Harvard Law Review 131, no. 6 (2018): 1599–1669.
   Web of Science ®Google Scholar
• Koebler, J. “Deplatforming Works.” Vice (2018). Accessed August 11, 2018. https://www.vice.com/en/article/bjbp9d/do-social-media-bans-work.
   Google Scholar
• Laclau, E. Emancipation(s). London, UK: Verso, 1996.
   Google Scholar
• Laclau, E. On Populist Reason. London, UK: Verso, 2005.
   Google Scholar
• Lee Timothy, B. “Google Explains Why It Banned the App for Gab, a Right-Wing Twitter Rival” Ars Technica (2017). Accessed August 18, 2017. https://arstechnica.com/tech-policy/2017/08/gabthe-right-wing-twitter-rival-just-got-its-app-banned-by-google/.
   Google Scholar
• Leticia, B., and E. K. Vraga. “In Related News, That Was Wrong: The Correction of Misinformation Through Related Stories Functionality in Social Media.” Journal of Communication 65, no. 4 (2015): 619–638. doi:10.1111/jcom.12166.
   Web of Science ®Google Scholar
• Lin, H., and Y. Kim. “Learning from Disagreement on Social Media: The Mediating Role of Like-Minded and Cross-Cutting Discussion and the Moderating Role of Fact-Checking.” Computers in Human Behavior 139 (2023): 139. doi:10.1016/j.chb.2022.107558.
   Web of Science ®Google Scholar
• Liptak, A. “Two More Platforms Have Suspended Gab in the Wake of Pittsburgh Shooting” The Verge 2018 Accessed October 28, 2018. https://www.theverge.com/2018/10/28/18034126/gab-social-networkstripe-joyent-deplatforming-hate-speech-pittsburgh-shooting.
   Google Scholar
• Lorenz, T. 2018. “The Pittsburgh Suspect Lived in the Web’s Darkest Corners.” The Atlantic, October 27, 2018.
   Google Scholar
• Lupu, Y., R. Sear, N. Velásquez, R. Leahy, J. Restrepo, G. Nicholas, Beth, and N. F. Johnson. “Offline Events and Online Hate.” PLoS ONE 18, no. 1 (2023). doi:10.1371/journal.pone.0278511.
   Web of Science ®Google Scholar
• Martineau, P. “Facebook Bans Alex Jones, Other Extremists – but Not as Planned.” Wired (2019). Accessed May 2, 2019. https://www.wired.com/story/facebook-bans-alex-jones-extremists/.
   Google Scholar
• Marwick, A., and R. Lewis. Media Manipulation and Disinformation Online. New York City, NY, United States of America: Data & Society, 2017.
   Google Scholar
• Mathiesen, K. “Fake News and the Limits of Freedom of Speech.” In Media Ethics, Free Speech and the Requirements of Democracy, edited by C. Fox and J. Saunders, 161–179. London, UK: Routledge, 2018. doi:10.4324/9780203702444-10.
   Google Scholar
• McDermott, J. “Those People We Tried to Cancel? They’re All Hanging Out Together.” The New York Times, November 2, 2019.
   Google Scholar
• Mcfarlane, E. “Beyond the Hate Speech Law Debate: A Charter Values Approach to Free Expression.” Review of Constitutional Studies 27, no. 1 (2022): 145–168.
   Google Scholar
• Meiklejohn, A. “The First Amendment is an Absolute” The Supreme Court Review 1961 (1961):245–266. 10.1086/scr.1961.3108719.
   Google Scholar
• Michael, H., V. der Meer, and T. G. L. A. “Misinformation and Polarization in a High-Choice Media Environment: How Effective are Political Fact-Checkers?” Communication Research 47, no. 2 (2020): 227–250. doi:10.1177/0093650218819671.
   Web of Science ®Google Scholar
• Milo, T., M. Gruppi, B. Cody, and B. D. Horne 2020. “What is Bitchute?” Proceedings of the 31st ACM conference on hypertext and social media. Orlando, FL, United States of America.
   Google Scholar
• Morar, D., and B. Martins dos Santos. “The Push for Content Moderation Legislation Around the World” Brookings (2020). Accessed September 21, 2020. https://www.brookings.edu/articles/the-push-for-content-moderation-legislation-around-theworld/.
   Google Scholar
• Mosseri, A. “Introducing New Ways to Protect Our Community from Abuse.” Instagram (2021). Accessed 10 August, 2021. https://about.instagram.com/blog/announcements/introducing-newways-to-protect-our-community-from-abuse.
   Google Scholar
• Mulhall, J. Deplatforming Works: Let’s Get on with It. Ctrl Alt-Right Delete, 2019. Accessed 4 October, 2019. https://hopenothate.org.uk/2019/10/04/deplatformingworks-lets-get-on-with-it/.
   Google Scholar
• Mutz, D. C. Hearing the Other Side: Deliberative versus Participatory Democracy. Cambridge, UK: Cambridge University Press, 2006.
   Google Scholar
• Neiwert, D. Alt-America: The Rise of the Radical Right in the Age of Trump. London, UK: Verso, 2017.
   Google Scholar
• Neubaum, G., M. Cargnino, and J. Maleszka. “How Facebook Users Experience Political Disagreements and Make Decisions About the Political Homogenization of Their Online Network.” International Journal of Communication 15 (2021): 187–206.
   Web of Science ®Google Scholar
• O’Connor, C. “Google Drops Alt-Right Favorite Gab from Play Store as Internet Hate Speech Purge Continues.” Forbes (2017). Accessed August 18, 2017. https://www.forbes.com/sites/clareoconnor/2017/08/18/google-drops-alt-right-favoritegab-from-play-store-as-internet-hate-speech-purge-continues/?sh=6cfe91f61c53.
   Google Scholar
• Ott, B. L. “The Age of Twitter: Donald J. Trump and the Politics of Debasement.” Critical Studies in Media Communication 34, no. 1 (2016): 59–68. doi:10.1080/15295036.2016.1266686.
   Web of Science ®Google Scholar
• Pearce, M. “Squeezed Out by Silicon Valley, the Far Right is Creating Its Own Corporate World” The Los Angeles Times (2017). Accessed August 12, 2017. https://www.latimes.com/nation/la-na-alt-right-money-20170811-story.html.
   Google Scholar
• Penney, J. A. “Internet Surveillance, Regulation, and Chilling Effects Online: A Comparative Case Study.” Internet Policy Review 6, no. 2 (2017). doi:10.14763/2017.2.692.
   Google Scholar
• Pfister, D. S., and M. Yang. “Five Theses on Technoliberalism and the Networked Public Sphere.” Communication and the Public 3, no. 3 (2018): 1–16. doi:10.1177/2057047318794963.
   Google Scholar
• Pohjonen, M., and S. Udupa. “Extreme Speech Online: An Anthropological Critique of Hate Speech Debates.” International Journal of Communication 11 (2017): 1173–1191.
   Web of Science ®Google Scholar
• Rauchfleisch, A., and J. Kaiser. “Deplatforming the Far-Right: An Analysis of YouTube and Bitchute.” SSRN Electronic Journal (2021). doi:10.2139/ssrn.3867818.
   Google Scholar
• Roberts, S. T. “Digital Detritus: ‘Error’ and the Logic of Opacity in Social Media Content Moderation.” First Monday 23 (2018): 3. doi:10.5210/fm.v23i3.8283.
   Google Scholar
• Roberts, S. T. Behind the Screen: Content Moderation in the Shadows of Social Media. New Haven, CT: Yale University Press, 2019.
   Google Scholar
• Robertson, A. “Neo-Nazi Site Moves to Dark Web After GoDaddy and Google Bans” The Verge (2017). Accessed August 15, 2017. https://www.theverge.com/2017/8/15/16150668/daily-stormer-alt-rightdark-web-site-godaddy-google-ban.
   Google Scholar
• Rogers, R. “Deplatforming: Following Extreme Internet Celebrities to Telegram and Alternative Social Media.” European Journal of Communication 35, no. 3 (2020): 213–229. doi:10.1177/0267323120922066.
   Web of Science ®Google Scholar
• Rohm, R. H. D., G. D. S. Valuano, and S. D. S. F. Xavier. “The Role of Digital Activism within Social Movements to Foster Democratization in the Global South: The Case of Ni Una Meno.” Espacio Abierto: Cuaderno Venezolano de Sociología 32, no. 1 (2023): 29–50.
   Google Scholar
• Romano, A. “Neo-Nazi Site Daily Stormer Resurfaces with Russian Domain Following Google and GoDaddy Bans.” Vox (2017). Accessed April 16, 2017. https://www.vox.com/culture/2017/8/16/16156210/daily-stormer-russian-domaingodaddy-google-ban.
   Google Scholar
• Romm, T. 2019. “Senate Republicans Renew Their Claims That Facebook, Google and Twitter Censor Conservatives.” The Washington Post, April 10, 2019.
   Google Scholar
• Rosenfeld, M. “Hate Speech in Constitutional Jurisprudence: A Comparative Analysis.” Cardozo Law Review 24, no. 4 (2001): 1523–1567. doi:10.2139/ssrn.265939.
   Google Scholar
• Selk, A. 2019. “How ‘Deplatforming’ Became a Rallying Cry for Right-Wing Media Stars.” The Washington Post, July 11, 2019.
   Google Scholar
• Sen, A. Desenvolvimento como Liberdade. São Paulo, BR: Companhia das Letras, 2000.
   Google Scholar
• Shiffrin, S. Speech Matters: On Lying, Morality and the Law. Princeton, NJ: Princeton University Press, 2014. doi:10.1515/9781400852529.
   Google Scholar
• Shiza, A., M. H. Saeed, A. Esraa, B. Jeremy, E. De Cristofaro, Z. Savvas, and G. Stringhini. “Understanding the Effect of Deplatforming on Social Networks.” Proceedings of the ACM Web Science Conference, New York City, NY, United States of America, 2021: 1–9. Accessed 21-25 June, 2021.
   Google Scholar
• Silverman, J. “What’s the Best Way to Keep Incendiary, Violent Content Offline?” The New Republic April 23, 2019 141 (2019):612–620. 10.1016/j.marpolbul.2019.02.070.
   Google Scholar
• Singh, S. “Everything in Moderation: An Analysis of How Internet Platforms are Using Artificial Intelligence to Moderate User-Generated Content.” New America (2019). Accessed 22 July, 2019. https://www.newamerica.org/oti/reports/everything-moderationanalysis-how-internet-platforms-are-using-artificial-intelligencemoderate-user-generated-content/.
   Google Scholar
• Sovryn, S. “Gab: A Cultural Primer.” Medium (2017). Accessed December 18, 2017. https://medium.com/@stonesovryn/gab-a-cultural-primer-cefa5637f203.
   Google Scholar
• SPL Center staff. The Alt-Right is Killing People. Montgomery, AL, United States of America: Southern Poverty Law Center, 2018.
   Google Scholar
• Staff, T. “Permanent Suspension of @realdonaldtrump.” Twitter Blog (2021). Accessed January 8, 2021. https://blog.twitter.com/en_us/topics/company/2020/suspension#:~:text=After%20close%20review%20of%20recent,of%20further%20incitement%20of%20violence.
   Google Scholar
• Swanson, B. Deplatforming and Disinformation Will Degrade Our Democracy. Washington, DC, United States of America: American Enterprise Institute for Public Policy Research, 2019.
   Google Scholar
• Tenove, C., J. Buffie, S. McKay, and D. Moscrop. Digital Threats to Democratic Elections: How Foreign Actors Use Digital Techniques to Undermine Democracy. British Columbia: Centre for the Study of Democratic Institutions, 2018.
   Google Scholar
• Terdiman, D. “After Charlottesville, PayPal Says It Won’t Do Business with Hate Groups.” Fast Company (2017). Accessed August 15, 2017. https://www.fastcompany.com/40454274/after-charlottesville-paypal-saysit-wont-do-business-with-hate-groups.
   Google Scholar
• Trouillot, M.-R. Silencing the Past: Power and the Production of History. Boston, MA: Beacon Press, 2015.
   Google Scholar
• Tsioulcas, A. “Youtube, Apple and Facebook Ban Infowars, Which Decries ‘Mega Purge’.” NPR (2018). Accessed August 6, 2018. https://www.npr.org/2018/08/06/636030043/youtube-apple-and-facebookban-infowars-which-decries-mega-purge.
   Google Scholar
• Waldman, A. E. “Disorderly Content.” Washington Law Review 97 (2022). doi:10.2139/ssrn.3906001.
   Google Scholar
• Waldron, J. “Hate Speech and Political Legitimacy.” In The Content and Context of Hate Speech: Rethinking Regulation and Responses, edited by M. Herz and P. Molnar, 329–340. Cambridge, UK: Cambridge University Press, 2012. doi:10.1017/CBO9781139042871.022.
   Google Scholar
• Weill, K. “The Alt-Right Outlives the Trolls Who Created It” The Daily Beast (2018). Accessed October 4, 2018. https://www.thedailybeast.com/thealt-right-outlives-the-trolls-who-created-it.
   Google Scholar
• West Sarah, M. “Censored, Suspended, Shadowbanned: User Interpretations of Content Moderation on Social Media Platforms.” New Media & Society 20, no. 11 (2018): 4366–4383. doi:10.1177/1461444818773059.
   Web of Science ®Google Scholar
• Yang, J., M. Barnidge, and H. Rojas. “The Politics of ‘Unfriending’: User Filtration in Response to Political Disagreement on Social Media.” Computers in Human Behavior 70 (2017): 22–29. doi:10.1016/j.chb.2016.12.079.
   Web of Science ®Google Scholar
• Yanqin, L., and J. K. Lee. “Determinants of Cross-Cutting Discussion on Facebook: Political Interest, News Consumption, and Strong-Tie Heterogeneity.” New Media & Society 23, no. 1 (2021): 175–192. doi:10.1177/1461444819899879.
   Web of Science ®Google Scholar
• Yuchen, Z., D. Mark, D. A. Broniatowski, and D. Adler William. “Elites and Foreign Actors Among the Alt-Right: The Gab Social Media Platform.” First Monday 24, no. 9 (2019). doi:10.5210/fm.v24i9.10062.
   Google Scholar
• Zannettou, S., B. Bradlyn, E. De Cristofaro, H. Kwak, M. Sirivianos, G. Stringhini, and J. Blackburn. “What is Gab? A Bastion of Free Speech or an Alt-Right Echo Chamber?” (2018). Accessed 23-27 April, 2018. https://dl.acm.org/doi/fullHtml/10.1145/3184558.3191531.
   Google Scholar