428
Views
0
CrossRef citations to date
0
Altmetric
Research Article

‘We have opened a can of worms’: using collaborative ethnography to advance responsible artificial intelligence innovation

ORCID Icon & ORCID Icon
Article: 2331655 | Received 15 Feb 2023, Accepted 13 Mar 2024, Published online: 23 Apr 2024

References

  • AIES. 2023. “Call for Papers.” https://www.aies-conference.com/2023/call-for-papers/.
  • Alvargonzález, D. 2011. “Multidisciplinarity, Interdisciplinarity, Transdisciplinarity, and the Sciences.” International Studies in the Philosophy of Science 25 (4): 387–403. https://doi.org/10.1080/02698595.2011.623366.
  • Balmer, A. S., J. Calvert, C. Marris, S. Molyneux-Hodgson, E. Frow, M. Kearnes, K. Bulpin, P. Schyfter, A. MacKenzie, and P. Martin. 2015. “Taking Roles in Interdisciplinary Collaborations: Reflections on Working in Post-ELSI Spaces in the UK Synthetic Biology Community.” Science & Technology Studies 28 (3): 3–25. https://doi.org/10.23987/sts.55340
  • Balmer, A. S., J. Calvert, C. Marris, S. Molyneux-Hodgson, E. Frow, M. Kearnes, K. Bulpin, P. Schyfter, A. Mackenzie, and P. Martin. 2016. “Five Rules of Thumb for Post-ELSI Interdisciplinary Collaborations.” Journal of Responsible Innovation 3 (1): 73–80. https://doi.org/10.1080/23299460.2016.1177867.
  • Beaulieu, A. 2010. “From Co-Location to Co-Presence: Shifts in the Use of Ethnography for the Study of Knowledge.” Social Studies of Science 40 (3): 453–470. https://doi.org/10.1177/0306312709359219
  • Bieler, P., M. D. Bister, J. Hauer, M. Klausner, J. Niewöhner, C. Schmid, and S. von Peter. 2021. “Distributing Reflexivity Through Co-Laborative Ethnography.” Journal of Contemporary Ethnography 50 (1): 77–98. https://doi.org/10.1177/0891241620968271.
  • Bietti, E. 2021. “From Ethics Washing to Ethics Bashing: A Moral Philosophy View on Tech Ethics.” Journal of Social Computing 2 (3): 266–283. https://doi.org/10.23919/JSC.2021.0031.
  • Binns, R., M. Veale, M. Van Kleek, and N. Shadbolt. 2017. “Like Trainer, Like Bot? Inheritance of Bias in Algorithmic Content Moderation.” In Social Informatics, edited by G. L. Ciampaglia, A. Mashhadi, and T. Yasseri, 405–415. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-67256-4_32
  • Birhane, A. 2021. “Algorithmic Injustice: A Relational Ethics Approach.” Patterns 2 (2): 100205. https://doi.org/10.1016/j.patter.2021.100205.
  • boyd, danah, and K. Crawford. 2012. “Critical Questions for Big Data.” Information, Communication & Society 15 (5): 662–679. https://doi.org/10.1080/1369118X.2012.678878.
  • Brayne, S. 2017. “Big Data Surveillance: The Case of Policing.” American Sociological Review 82 (5): 977–1008. https://doi.org/10.1177/0003122417725865.
  • Bromham, L., R. Dinnage, and X. Hua. 2016. “Interdisciplinary Research Has Consistently Lower Funding Success.” Nature 534 (7609): 684–687. https://doi.org/10.1038/nature18315.
  • CDEI. 2021. “The Role of AI in Addressing Misinformationon Social Media Platforms.” Centre for Data Ethics and Innovation. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1008700/Misinformation_forum_write_up__August_2021__-_web_accessible.pdf.
  • Conley, S. N., B. Tabas, and E. York. 2022. “Futures Labs: A Space for Pedagogies of Responsible Innovation.” Journal of Responsible Innovation 10 (1): 1–20. https://doi.org/10.1080/23299460.2022.2129179.
  • Costanza-Chock, S. 2020. Design Justice: Community-Led Practices to Build the Worlds We Need. Cambridge, MA: The MIT Press. https://library.oapen.org/handle/20.500.12657/43542.
  • Crooks, R., and M. Currie. 2021. “Numbers Will Not Save Us: Agonistic Data Practices.” The Information Society 37 (4): 201–213. https://doi.org/10.1080/01972243.2021.1920081.
  • Delgado, A., and H. Åm. 2018. “Experiments in Interdisciplinarity: Responsible Research and Innovation and the Public Good.” PLoS Biology 16 (3): e2003921. https://doi.org/10.1371/journal.pbio.2003921.
  • Domínguez Hernández, A., and V. Galanos. 2022. “A Toolkit of Dilemmas: Beyond Debiasing and Fairness Formulas for Responsible AI/ML.” IEEE International Symposium on Technology and Society 2022 (ISTAS22). https://doi.org/10.1109/ISTAS55053.2022.10227133.
  • Domínguez Hernández, A., R. Owen, D. S. Nielsen, and R. McConville. 2023. “Ethical, Political and Epistemic Implications of Machine Learning (Mis)Information Classification: Insights from an Interdisciplinary Collaboration Between Social and Data Scientists.” Journal of Responsible Innovation 10 (1): 2222514. https://doi.org/10.1080/23299460.2023.2222514.
  • Downey, G. L., and T. Zuiderent-Jerak. 2016. “8  Making and Doing: Engagement and Reflexive Learning in STS.” In C. A. (30).
  • Downey, G. L., and T. Zuiderent-Jerak, eds. 2021. Making & Doing: Activating STS Through Knowledge Expression and Travel. Cambridge, MA: The MIT Press. https://doi.org/10.7551/mitpress/11310.001.0001
  • EPSRC. 2018. “Framework for Responsible Innovation.” https://www.ukri.org/about-us/epsrc/our-policies-and-standards/framework-for-responsible-innovation/.
  • Eubanks, V. 2017. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. 1st ed. New York, NY: StMartin's Press
  • Evans, S. W., M. Leese, and D. Rychnovská. 2021. “Science, Technology, Security: Towards Critical Collaboration.” Social Studies of Science 51 (2): 189–213. https://doi.org/10.1177/0306312720953515.
  • Feldman, M., S. A. Friedler, J. Moeller, C. Scheidegger, and S. Venkatasubramanian. 2015. “Certifying and Removing Disparate Impact.” In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 259–268. https://doi.org/10.1145/2783258.2783311.
  • Felt, U., J. Igelsböck, A. Schikowitz, and T. Völker. 2016. “Transdisciplinary Sustainability Research in Practice: Between Imaginaries of Collective Experimentation and Entrenched Academic Value Orders.” Science, Technology, & Human Values 41 (4): 732–761. https://doi.org/10.1177/0162243915626989.
  • Fisher, E., R. L. Mahajan, and C. Mitcham. 2006. “Midstream Modulation of Technology: Governance from Within.” Bulletin of Science, Technology & Society 26 (6): 485–496. https://doi.org/10.1177/0270467606295402.
  • Fisher, E., M. O’Rourke, R. Evans, E. B. Kennedy, M. E. Gorman, and T. P. Seager. 2015. “Mapping the Integrative Field: Taking Stock of Socio-Technical Collaborations.” Journal of Responsible Innovation 2 (1): 39–61. https://doi.org/10.1080/23299460.2014.1001671.
  • Floridi, L., J. Cowls, M. Beltrametti, R. Chatila, P. Chazerand, V. Dignum, C. Luetge, et al. 2018. “AI4People—An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations.” Minds and Machines 28 (4): 689–707. https://doi.org/10.1007/s11023-018-9482-5.
  • Geisslinger, M., F. Poszler, J. Betz, C. Lütge, and M. Lienkamp. 2021. “Autonomous Driving Ethics: From Trolley Problem to Ethics of Risk.” Philosophy & Technology 34 (4): 1033–1055. https://doi.org/10.1007/s13347-021-00449-4.
  • Gillespie, T. 2014. “The Relevance of Algorithms.” In Media Technologies, edited by T. Gillespie, P. J. Boczkowski, and K. A. Foot, 167–194. Cambridge, MA: The MIT Press. https://doi.org/10.7551/mitpress/9780262525374.003.0009.
  • Gorwa, R., R. Binns, and C. Katzenbach. 2020. “Algorithmic Content Moderation: Technical and Political Challenges in the Automation of Platform Governance.” Big Data & Society 7 (1): 205395171989794. https://doi.org/10.1177/2053951719897945.
  • Greiffenhagen, C., M. Mair, and W. Sharrock. 2015. “Methodological Troubles as Problems and Phenomena: Ethnomethodology and the Question of ‘Method’ in the Social Sciences.” The British Journal of Sociology 66 (3): 460–485. https://doi.org/10.1111/1468-4446.12136.
  • Griffin, G., K. Hamberg, and B. Lundgren. 2013. The Social Politics of Research Collaboration. London, UK: Taylor & Francis. http://ebookcentral.proquest.com/lib/bristol/detail.action?docID=1211739.
  • Guston, D. H., and D. Sarewitz. 2002. “Real-Time Technology Assessment.” Technology in Society 24 (1-2): 93–109. https://doi.org/10.1016/S0160-791X(01)00047-1.
  • Haraway, D. 2013. “Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective.” In Simians, Cyborgs, and Women. New York: Routledge. https://doi.org/10.4324/9780203873106-18.
  • Harding, S. 1995. “‘Strong Objectivity’: A Response to the New Objectivity Question.” Synthese 104 (3): 331–349. https://doi.org/10.1007/BF01064504
  • Hillersdal, L., A. P. Jespersen, B. Oxlund, and B. Bruun. 2020. “Affect and Effect in Interdisciplinary Research Collaboration.” Science & Technology Studies 33 (2): 66–82. https://doi.org/10.23987/sts.63305.
  • Hu, L. 2021. “Tech Ethics: Speaking Ethics to Power, or Power Speaking Ethics?” Journal of Social Computing 2 (3): 238–248. https://doi.org/10.23919/JSC.2021.0033.
  • Irani, L., J. Vertesi, P. Dourish, K. Philip, and R. E. Grinter. 2010. “Postcolonial Computing: A Lens on Design and Development.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1311–1320. https://doi.org/10.1145/1753326.1753522.
  • Jaton, F. 2021. “Assessing Biases, Relaxing Moralism: On Ground-Truthing Practices in Machine Learning Design and Application.” Big Data & Society 8 (1): 205395172110135. https://doi.org/10.1177/20539517211013569.
  • Jensen, T. E. 2012. “Intervention by Invitation: New Concerns and New Versions of the User in STS.” Science & Technology Studies 25 (1): 13–36. https://doi.org/10.23987/sts.55279.
  • Jönsson, M., and A. Rådström. 2013. “Experiences of Research Collaboration in ‘Soloist’ Disciplines: On the Importance of Not Knowing and Learning from Affects of Shame, Ambivalence and Insecurity.” In The Emotional Politics of Research Collaboration, edited by G. Griffin and A. Bränström-Öhman, 130–143. New York: Routledge. http://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-66761.
  • Kaltenbrunner, W., K. Birch, T. van Leeuwen, and M. Amuchastegui. 2022. “Changing Publication Practices and the Typification of the Journal Article in Science and Technology Studies.” Social Studies of Science 52 (5): 758–782. https://doi.org/10.1177/03063127221110623.
  • Katell, M., M. Young, D. Dailey, B. Herman, V. Guetler, A. Tam, C. Bintz, D. Raz, and P. M. Krafft. 2020. “Toward Situated Interventions for Algorithmic Equity: Lessons from the Field.” In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 45–55. https://doi.org/10.1145/3351095.3372874.
  • Kitchin, R. 2014. “Big Data, New Epistemologies and Paradigm Shifts.” Big Data & Society 1 (1): 205395171452848. https://doi.org/10.1177/2053951714528481.
  • Kleinberg, J., J. Ludwig, S. Mullainathan, and A. Rambachan. 2018. “Algorithmic Fairness.” AEA Papers and Proceedings 108: 22–27. https://doi.org/10.1257/pandp.20181018.
  • Lassiter, L. E. 2005. The Chicago Guide to Collaborative Ethnography. Chicago, IL: University of Chicago Press.
  • Latour, B. 2004. “Why Has Critique Run out of Steam? From Matters of Fact to Matters of Concern.” Critical Inquiry 30 (2): 225–248. https://doi.org/10.1086/421123.
  • Latour, B., and S. Woolgar. 1986. Laboratory Life: The Social Construction of Scientific Facts. Sage Library of Social Research; Vol. 80. Beverly Hills: Sage Publications.
  • Laufer, B., S. Jain, A. F. Cooper, J. Kleinberg, and H. Heidari. 2022. “Four Years of FAccT: A Reflexive, Mixed-Methods Analysis of Research Contributions, Shortcomings, and Future Prospects.” In 2022 ACM Conference on Fairness, Accountability, and Transparency, 401–426. https://doi.org/10.1145/3531146.3533107.
  • Law, J. 2016. “STS as Method.” In The Handbook of Science and Technology Studies, edited by U. Felt, S. Beck, R. Fouché, C. A. Miller, L. Smith-Doerr, M. Alac, S. Amir, M. Arribas-Ayllon, B. Balmer, and J. Barandiarán, 31–57. Cambridge, MA: MIT Press. http://ebookcentral.proquest.com/lib/ed/detail.action?docID=5052910
  • Leonelli, S. 2015. “What Counts as Scientific Data? A Relational Framework.” Philosophy of Science 82 (5): 810–821. https://doi.org/10.1086/684083.
  • Lezaun, J., N. Marres, and M. Tironi. 2017. “7  Experiments in Participation.” In The Handbook of Science and Technology Studies 4th ed., 195–221.
  • Lindvig, K., and L. Hillersdal. 2019. “Strategically Unclear? Organising Interdisciplinarity in an Excellence Programme of Interdisciplinary Research in Denmark.” Minerva 57 (1): 23–46. https://doi.org/10.1007/s11024-018-9361-5.
  • Lippert, I. 2020. “In, with and of STS.” In Locating Media/Situierte Medien, edited by A. Wiedmann, K. Wagenknecht, P. Goll, and A. Wagenknecht, 1st ed., Vol. 19, 301–318. Bielefeld: Transcript Verlag. https://doi.org/10.14361/9783839443798-011.
  • Lippert, I., and J. S. Mewes. 2021. “Data, Methods and Writing: Methodographies of STS Ethnographic Collaboration in Practice.” Science & Technology Studies 34 (3): 2–16. https://doi.org/10.23987/sts.110597.
  • Lyall, C., A. Bruce, W. Marsden, and L. Meagher. 2013. “The Role of Funding Agencies in Creating Interdisciplinary Knowledge.” Science and Public Policy 40 (1): 62–71. https://doi.org/10.1093/scipol/scs121.
  • Lyle, K. 2021. “Interventional STS: A Framework for Developing Workable Technologies.” Sociological Research Online 26 (2): 410–426. https://doi.org/10.1177/1360780420915723.
  • Lynch, M. 2000. “Against Reflexivity as an Academic Virtue and Source of Privileged Knowledge.” Theory, Culture & Society 17 (3): 26–54. https://doi.org/10.1177/02632760022051202.
  • Lynch, M. 2020. “We Have Never Been Anti-Science: Reflections on Science Wars and Post-Truth.” Engaging Science, Technology, and Society 6 (1): 49–57. https://doi.org/10.17351/ests2020.309.
  • Manokha, I. 2018. “Surveillance, Panopticism, and Self-Discipline in the Digital Age.” Surveillance & Society 16 (2): 219–237. https://doi.org/10.24908/ss.v16i2.8346.
  • Martin, K. E. 2015. “Ethical Issues in the Big Data Industry.” MIS Quarterly Executive 14 (2): 67–85.
  • McLeish, T., and V. Strang. 2016. “Evaluating Interdisciplinary Research: The Elephant in the Peer-Reviewers’ Room.” Palgrave Communications 2 (1): Article 1. https://doi.org/10.1057/palcomms.2016.55.
  • Miceli, M., and J. Posada. 2022. “The Data-Production Dispositif.” Proceedings of the ACM on Human-Computer Interaction 6 (CSCW2): 460:1–460:37. https://doi.org/10.1145/3555561.
  • Moats, D. 2021. “Rethinking the ‘Great Divide’: Approaching Interdisciplinary Collaborations Around Digital Data with Humour and Irony.” Science & Technology Studies 34 (1): 19–42. https://doi.org/10.23987/sts.97321.
  • Moats, D., and N. Seaver. 2019. ““You Social Scientists Love Mind Games”: Experimenting in the ‘Divide’ Between Data Science and Critical Algorithm Studies.” Big Data & Society 6 (1): 205395171983340. https://doi.org/10.1177/2053951719833404.
  • Nästesjö, J. 2021. “Navigating Uncertainty: Early Career Academics and Practices of Appraisal Devices.” Minerva 59 (2): 237–259. https://doi.org/10.1007/s11024-020-09425-2.
  • Neff, G., A. Tanweer, B. Fiore-Gartland, and L. Osburn. 2017. “Critique and Contribute: A Practice-Based Framework for Improving Critical Data Studies and Data Science.” Big Data 5 (2): 85–97. https://doi.org/10.1089/big.2016.0050.
  • Nielsen, D. S., and R. McConville. 2022. “MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset.” In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 3141–3153. https://doi.org/10.1145/3477495.3531744
  • Noble, S. U. 2018. Algorithms of Oppression: How Search Engines Reinforce Racism. New York: New York University Press. http://ebookcentral.proquest.com/lib/ed/detail.action?docID=4834260.
  • Owen, R. 2014. “The UK Engineering and Physical Sciences Research Council’s Commitment to a Framework for Responsible Innovation.” Journal of Responsible Innovation 1 (1): 113–117. https://doi.org/10.1080/23299460.2014.882065.
  • Owen, R., J. R. Bessant, and M. Heintz 2013. Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society. Chichester: John Wiley & Sons, Incorporated.
  • Owen, R., and M. Pansera. 2019. “Responsible Innovation and Responsible Research and Innovation.” In Handbook on Science and Public Policy, edited by D. Simon, S. Kuhlmann, J. Stamm, and W. Canzler, 26–48. Cheltenham, UK: Edward Elgar Publishing. https://www.elgaronline.com/edcollchap/edcoll/9781784715939/9781784715939.00010.xml.
  • Owen, R., M. Pansera, P. Macnaghten, and S. Randles. 2021. “Organisational Institutionalisation of Responsible Innovation.” Research Policy 50 (1): 104132. https://doi.org/10.1016/j.respol.2020.104132.
  • Palmer, J., C. Pocock, and L. Burton. 2018. “Waiting, Power and Time in Ethnographic and Community-Based Research.” Qualitative Research 18 (4): 416–432. https://doi.org/10.1177/1468794117728413.
  • Pansera, M., R. Owen, D. Meacham, and V. Kuh. 2020. “Embedding Responsible Innovation Within Synthetic Biology Research and Innovation: Insights from a UK Multi-Disciplinary Research Centre.” Journal of Responsible Innovation 7 (3): 384–409. https://doi.org/10.1080/23299460.2020.1785678.
  • Ratto, M. 2011. “Critical Making: Conceptual and Material Studies in Technology and Social Life.” The Information Society 27 (4): 252–260. https://doi.org/10.1080/01972243.2011.583819.
  • Reinsborough, M. 2020. “Art-Science Collaboration in an EPSRC/BBSRC-Funded Synthetic Biology UK Research Centre.” NanoEthics 14 (1): 93–111. https://doi.org/10.1007/s11569-020-00367-3.
  • Rességuier, A., and R. Rodrigues. 2020. “AI Ethics Should Not Remain Toothless! A Call to Bring Back the Teeth of Ethics.” Big Data & Society 7 (2): 205395172094254. https://doi.org/10.1177/2053951720942541.
  • Rip, A., T. J. Misa, and J. Schot. 1995. Managing Technology in Society: The Approach of Constructive Technology Assessment. London: Pinter.
  • Rosenblat, A., and L. Stark. 2016. “Algorithmic Labor and Information Asymmetries: A Case Study of Uber’s Drivers.” International Journal of Communication, 3758–3785.
  • Ryan, M., J. Antoniou, L. Brooks, T. Jiya, K. Macnish, and B. Stahl. 2021. “Research and Practice of AI Ethics: A Case Study Approach Juxtaposing Academic Discourse with Organisational Reality.” Science and Engineering Ethics 27 (2): 16. https://doi.org/10.1007/s11948-021-00293-x.
  • Schot, J., and A. Rip. 1997. “The Past and Future of Constructive Technology Assessment.” Technological Forecasting and Social Change 54 (2-3): 251–268. https://doi.org/10.1016/S0040-1625(96)00180-1.
  • Schuijff, M., and A. M. Dijkstra. 2020. “Practices of Responsible Research and Innovation: A Review.” Science and Engineering Ethics 26 (2): 533–574. https://doi.org/10.1007/s11948-019-00167-3.
  • Selbst, A. D., D. boyd, S. A. Friedler, S. Venkatasubramanian, and J. Vertesi. 2019. “Fairness and Abstraction in Sociotechnical Systems.” In Proceedings of the Conference on Fairness, Accountability, and Transparency, 59–68. https://doi.org/10.1145/3287560.3287598
  • Sloane, M., and E. Moss. 2019. “AI’s Social Sciences Deficit.” Nature Machine Intelligence 1 (8): 330–331. https://doi.org/10.1038/s42256-019-0084-6.
  • Smolka, M., E. Fisher, and A. Hausstein. 2021. “From Affect to Action: Choices in Attending to Disconcertment in Interdisciplinary Collaborations.” Science, Technology, & Human Values 46 (5): 1076–1103. https://doi.org/10.1177/0162243920974088.
  • Stark, L., D. Greene, and A. L. Hoffmann. 2021. “Critical Perspectives on Governance Mechanisms for AI/ML Systems.” In The Cultural Life of Machine Learning, edited by J. Roberge and M. Castelle, 257–280. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-56286-1_9.
  • Stilgoe, J., R. Owen, and P. Macnaghten. 2013. “Developing a Framework for Responsible Innovation.” Research Policy 42 (9): 1568–1580. https://doi.org/10.1016/j.respol.2013.05.008.
  • Wiklund, M. 2013. “At the Interstices of Disciplines: Early Career Researchers and Research Collaborations Across Boundaries.” In The Social Politics of Research Collaboration. New York: Routledge.
  • Williams, A., M. Miceli, and T. Gebru. 2022. “The Exploited Labor Behind Artificial Intelligence.” Noema, October 13. https://www.noemamag.com/the-exploited-labor-behind-artificial-intelligence.
  • Wu, S. S. 2020. “Autonomous Vehicles, Trolley Problems, and the Law.” Ethics and Information Technology 22 (1): 1–13. https://doi.org/10.1007/s10676-019-09506-1.
  • York, E. 2018. “Doing STS in STEM Spaces: Experiments in Critical Participation.” Engineering Studies 10 (1): 66–84. https://doi.org/10.1080/19378629.2018.1447576.
  • Zuboff, S. 2019. The Age of Surveillance Capitalism: The Fight for the Future at the New Frontier of Power. London: Profile Books.