Moral Engagement and Disengagement in Health Care AI Development

References

• Avolio, B. J., and W. L. Gardner. 2005. Authentic leadership development: Getting to the root of positive forms of leadership. The Leadership Quarterly 16 (3):315–38. doi: 10.1016/j.leaqua.2005.03.001.
   Web of Science ®Google Scholar
• Bandura, A. 1986. Social foundations of thought and action: A social cognitive theory. Upper Saddle River, NJ: Prentice-Hall, Inc.
   Google Scholar
• Bandura, A. 2002. Social cognitive theory in cultural context. Applied Psychology 51 (2):269–90. doi: 10.1111/1464-0597.00092.
   Web of Science ®Google Scholar
• Bandura, A. 2018. Toward a psychology of human agency: Pathways and reflections. Perspectives on Psychological Science: A Journal of the Association for Psychological Science 13 (2):130–6. doi: 10.1177/1745691617699280.
   PubMedGoogle Scholar
• Bandura, A., C. Barbaranelli, G. Vittorio Caprara, and C. Pastorelli. 1996. Mechanisms of moral disengagement in the exercise of moral agency. Journal of Personality and Social Psychology 71 (2):364–74. doi: 10.1037/0022-3514.71.2.364.
   Web of Science ®Google Scholar
• Bernard, H. 2006. Research methods in anthropology : Qualitative and quantitative approaches. New York: Altamira Press.
   Google Scholar
• Carter, D. 2020. Regulation and ethics in artificial intelligence and machine learning technologies: Where are we now? Who is responsible? Can the information professional play a role? Business Information Review 37 (2):60–8. doi: 10.1177/0266382120923962.
   Google Scholar
• Char, D. S., N. H. Shah, and D. Magnus. 2018. Implementing machine learning in health care—Addressing ethical challenges. The New England Journal of Medicine 378 (11):981–3. doi: 10.1056/NEJMp1714229.
   PubMed Web of Science ®Google Scholar
• Chen, I. Y., E. Pierson, S. Rose, S. Joshi, K. Ferryman, and M. Ghassemi. 2021. Ethical machine learning in healthcare. Annual Review of Biomedical Data Science 4 (1):123–44. doi: 10.1146/annurev-biodatasci-092820-114757.
   PubMedGoogle Scholar
• Gotterbarn, D. 2001. Informatics and professional responsibility. Science and Engineering Ethics 7 (2):221–30. doi: 10.1007/s11948-001-0043-5.
   PubMed Web of Science ®Google Scholar
• Griffin, T. A., B. P. Green, and J. V. M. Welie. 2023. The Ethical agency of AI developers. AI Ethics. doi: 10.1007/s43681-022-00256-3.
   Google Scholar
• Hannah, S. T., and B. J. Avolio. 2010. Moral potency: Building the capacity for character-based leadership. Consulting Psychology Journal: Practice and Research 62 (4):291–310. doi: 10.1037/a0022283.
   Google Scholar
• IBM. 2023. Empathy Map Toolkit Activity – Enterprise Design Thinking. Accessed December 15. https://www.ibm.com/design/thinking/page/toolkit/activity/empathy-map.
   Google Scholar
• Kostick-Quenet, K. M., and S. Gerke. 2022. AI in the hands of imperfect users. NPJ Digital Medicine 5 (1):197. doi: 10.1038/s41746-022-00737-z.
   PubMed Web of Science ®Google Scholar
• London, A. J. 2022. Artificial intelligence in medicine: Overcoming or recapitulating structural challenges to improving patient care? Cell Reports. Medicine 3 (5):100622. doi: 10.1016/j.xcrm.2022.100622.
   PubMedGoogle Scholar
• Manders-Huits, N., and M. Zimmer. 2009. Values and pragmatic action: The challenges of introducing ethical intelligence in technical design communities. The International Review of Information Ethics 10:37–44. doi: 10.29173/irie87.
   Google Scholar
• Martin, K. 2022. Ethics of data and analytics. New York: Taylor & Francis Group.
   Google Scholar
• McDonald, N., and S. Pan. 2020. Intersectional AI: A study of how information science students think about ethics and their impact. Proceedings of the ACM on Human-Computer Interaction 4:1–19. doi: 10.1145/3415218.
   Google Scholar
• Miles, M., A. Huberman, and J. Saldana. 2019. Qualitative data analysis: A methods sourcebook. 4th ed. Los Angeles: SAGE Publications.
   Google Scholar
• Mittelstadt, B. 2019. Principles alone cannot guarantee ethical AI. Nature Machine Intelligence 1 (11):501–7. doi: 10.1038/s42256-019-0114-4.
   Google Scholar
• Narvaez, D., and J. Rest. 1995. The four components of acting morally. Moral behavior and moral development: An introduction. In Handbook of moral and character education, ed. D. L. Nucci, D. Narvaez, and T. Krettenauer, 385–400. Oxfordshire, UK: Routledge.
   Google Scholar
• Nichol, A. A., J. N. Batten, M. C. Halley, J. K. Axelrod, P. L. Sankar, and M. K. Cho. 2021. A typology of existing machine learning – Based predictive analytic tools focused on reducing costs and improving quality in health care: Systematic search and content analysis. Journal of Medical Internet Research 23 (6):e26391. doi: 10.2196/26391.
   PubMed Web of Science ®Google Scholar
• Nichol, A. A.,P. L. Sankar,M. C. Halley,C. A. Federico, andM. K. Cho. 2023. Developer perspectives on potential harms of machine learning predictive analytics in health care: Qualitative analysis. Journal of Medical Internet Research 25:e47609. doi:10.2196/47609.
   PubMed Web of Science ®Google Scholar
• Nissenbaum, H. 1994. Computing and accountability. Communications of the ACM 37 (1):72–80. doi: 10.1145/175222.175228.
   Web of Science ®Google Scholar
• NIST. 2023a. AI risk management framework | NIST. https://www.nist.gov/itl/ai-risk-management-framework.
   Google Scholar
• NIST. 2023b. NIST AIRC – Govern. https://airc.nist.gov/AI_RMF_Knowledge_Base/Playbook/Govern.
   Google Scholar
• OSTP. 2023. Blueprint for an AI bill of rights. https://www.whitehouse.gov/ostp/ai-bill-of-rights/.
   Google Scholar
• Stenmark, C. K., R. A. Redfearn, and C. M. Kreitler. 2021. Self-efficacy and ethical decision-making. Ethics & Behavior 31 (5):301–20. doi: 10.1080/10508422.2020.1776617.
   Web of Science ®Google Scholar
• Strauss, A., and J. Corbin. 1997. Grounded theory in practice. Los Angeles: SAGE Publications.
   Google Scholar
• The White House. 2023. Executive order on the safe, secure, and trustworthy development and use of artificial intelligence | The white house. https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/.
   Google Scholar
• US Food & Drug Administration. 2018. Developing a precertification program: A working model. https://www.fda.gov/media/112680/download.
   Google Scholar
• US Food & Drug Administration. 2019. Proposed regulatory framework for modifications to artificial intelligence/machine learning (AI/ML)-based software as a medical device (SaMD) – Discussion paper and request for feedback. https://www.fda.gov/media/122535/download%0Ao.
   Google Scholar
• US Food & Drug Administration. 2021. Artificial intelligence/machine learning (AI/ML)-based software as a medical device (SaMD) action plan. https://www.fda.gov/media/145022/download.
   Google Scholar
• Vakkuri, V., K.-K. Kemell, M. Jantunen, and P. Abrahamsson. 2020. “This is just a prototype”: How ethics are ignored in software startup-like environments. In Agile processes in software engineering and extreme programming, ed. V. Stray, R. Hoda, M. Paasivaara, and P. Kruchten, vol. 383, 195–210. Springer. doi: 10.1007/978-3-030-49392-9_13.
   Google Scholar
• White, J., A. Bandura, and L. A. Bero. 2009. Moral disengagement in the corporate world. Accountability in Research 16 (1):41–74. doi: 10.1080/08989620802689847.
   PubMed Web of Science ®Google Scholar