Development of consensus on essential virtues for ethics and research integrity training using a modified Delphi approach

References

• ALLEA. 2017. The European Code of Conduct for Research Integrity: Revised Edition. Berlin: ALLEA – All European Academies.
   Google Scholar
• Antes, A. L., S. T. Murphy, E. P. Waples, M. D. Mumford, R. P. Brown, S. Connelly, and L. D. Devenport. 2009. “A meta-analysis of Ethics Instruction Effectiveness in the Sciences.” Ethics & Behavior 19 (5): 379–402. doi:10.1080/10508420903035380.
   PubMed Web of Science ®Google Scholar
• Antes, A. L., X. Wang, M. D. Mumford, R. P. Brown, S. Connelly, and L. D. Devenport. 2010. “Evaluating the Effects that Existing Instruction on Responsible Conduct of Research Has on Ethical Decision Making.” Academic Medicine 85 (3): 519–526. doi:10.1097/ACM.0b013e3181cd1cc5.
   PubMed Web of Science ®Google Scholar
• Aristotle. 2014. Nicomachean Ethics. Cambridge: Cambridge University Press.
   Google Scholar
• Athanassoulis, N. 2014. “Educating for Virtue.” In The Handbook of Virtue Ethics, edited by S. van Hooft, 440–450. Durham: Taylor & Francis.
   Google Scholar
• Baehr, J. 2017. “The Varieties of Character and Some Implications for Character Education.” Journal of Youth and Adolescence 46 (6): 1153–1161. doi:10.1007/s10964-017-0654-z.
   PubMed Web of Science ®Google Scholar
• Berkowitz, M. W., and M. C. Bier. 2004. “Research-Based Character Education.” Annals of the American Academy of Political and Social Science 591 (1): 72–85. doi:10.1177/0002716203260082.
   Web of Science ®Google Scholar
• Berkowitz, M. W., and M. C. Bier. 2007. “What Works in Character Education.” Journal of Research in Character Education 5 (1): 29–48.
   Google Scholar
• Berling, E., C. McLeskey, M. O’Rourke, and R. T. Pennock. 2019. “A New Method for A Virtue-Based Responsible Conduct of Research Curriculum: Pilot Test Results.” Science and Engineering Ethics 25 (3): 899–910. doi:10.1007/s11948-017-9991-2.
   PubMed Web of Science ®Google Scholar
• Braun, V., and V. Clarke. 2006. “Using Thematic Analysis in Psychology.” Qualitative Research in Psychology 3 (2): 77–101. doi:10.1191/1478088706qp063oa.
   Google Scholar
• Braun, V., V. Clarke, N. Hayfield, and G. Terry. 2019. “Thematic Analysis.” In Handbook of Research Methods in Health Social Sciences, edited by P. Liamputtong, 843–860. Singapore: Springer Singapore.
   Google Scholar
• Carr, D., and J. Steutel. 2005. “The Virtue Approach to Moral Education: Pointers, Problems and Prospects.” In Virtue Ethics and Moral Education, edited by D. Carr and J. Steutel, 247–261. London: Taylor & Francis.
   Google Scholar
• Character traits: Scientific virtue. 2016. “Character Traits: Scientific Virtue.” Nature 532 (7597): 139. doi:10.1038/nj7597-139a.
   Google Scholar
• Chen, J.-Y. 2015. “Virtue and the Scientist: Using Virtue Ethics to Examine Science’s Ethical and Moral Challenges.” Science and Engineering Ethics 21 (1): 75–94. doi:10.1007/s11948-014-9522-3.
   PubMed Web of Science ®Google Scholar
• Chen, J.-Y. 2016. “Research as Profession and Practice: Frameworks for Guiding the Responsible Conduct of Research.” Accountability in Research 23 (6): 351–373. doi:10.1080/08989621.2016.1196439.
   PubMed Web of Science ®Google Scholar
• Chubin, D. E. 1985. “Research Malpractice.” BioScience 35 (2): 80–89. doi:10.2307/1309844.
   Web of Science ®Google Scholar
• CORDIS, 2021 ”Virtue based ethics and Integrity of Research: Train-the-Trainer program for Upholding the principles and practices of the European Code of Conduct for Research Integrity.” European Commission Accessed 26 March 2021 https://cordis.europa.eu/project/id/787580
   Google Scholar
• Cox, D., M. La Caze, and M. Levine. 2014. “Integrity.” In The Handbook of Virtue Ethics, edited by S. Van Hooft, 200–209. Durham: Taylor & Francis.
   Google Scholar
• Curren, R. 2005. “Cultivating the Intellectual and Moral Virtues.” In Virtue Ethics and Moral Education, edited by D. Carr and J. Steutel, 69–83. London: Taylor & Francis.
   Google Scholar
• Dalkey, N., and O. Helmer. 1963. “An Experimental Application of the Delphi Method to the Use of Experts.” Management Science 9 (3): 458–467. doi:10.1287/mnsc.9.3.458.
   Web of Science ®Google Scholar
• Diamond, I. R., R. C. Grant, B. M. Feldman, P. B. Pencharz, S. C. Ling, A. M. Moore, and P. W. Wales. 2014. “Defining Consensus: A Systematic Review Recommends Methodologic Criteria for Reporting of Delphi Studies.” Journal of Clinical Epidemiology 67 (4): 401–409. doi:10.1016/j.jclinepi.2013.12.002.
   PubMed Web of Science ®Google Scholar
• Downar, J., and L. Hawryluck. 2010. “What Should We Say When Discussing “Code Status” and Life Support with A Patient? A Delphi Analysis.” Journal of Palliative Medicine 13 (2): 185–195. doi:10.1089/jpm.2009.0269.
   PubMed Web of Science ®Google Scholar
• DuBois, J. M. 2004. “Is Compliance a Professional Virtue of Researchers? Reflections on Promoting the Responsible Conduct of Research.” Ethics & Behavior 14 (4): 383–395. doi:10.1207/s15327019eb1404_8.
   PubMed Web of Science ®Google Scholar
• Falcó-Pegueroles, A., D. Rodríguez-Martín, S. Ramos-Pozón, and E. Zuriguel-Pérez. 2021. “Critical Thinking in Nursing Clinical Practice, Education and Research: From Attitudes to Virtue.” Nursing Philosophy 22 (1): e12332. doi:10.1111/nup.12332.
   PubMed Web of Science ®Google Scholar
• Fink-Hafner, D., T. Dagen, M. Doušak, M. Novak, and M. Hafner-Fink. 2019. “Delphi Method: Strengths and Weaknesses.” Advances in Methodology and Statistics 2: 1–19. doi:10.51936/fcfm6982.
   Google Scholar
• Funk, C. L., K. A. Barrett, and F. L. Macrina. 2007. “Authorship and Publication Practices: Evaluation of the Effect of Responsible Conduct of Research Instruction to Postdoctoral Trainees.” Accountability in Research 14 (4): 269–305. doi:10.1080/08989620701670187.
   PubMedGoogle Scholar
• Goddiksen, M. P., and M. Gjerris. 2022. “Teaching Phronesis in a Research Integrity Course.” FACETS 7: 139–152. doi:10.1139/facets-2021-0064.
   Web of Science ®Google Scholar
• Godecharle, S., B. Nemery, and K. Dierickx. 2014. “Heterogeneity in European Research Integrity Guidance: Relying on Values or Norms?” Journal of Empirical Research on Human Research Ethics 9 (3): 79–90. doi:10.1177/1556264614540594.
   PubMed Web of Science ®Google Scholar
• Goodman, C. M. 1987. “The Delphi Technique: A Critique.” Journal of Advanced Nursing 12 (6): 729–734. doi:10.1111/j.1365-2648.1987.tb01376.x.
   PubMed Web of Science ®Google Scholar
• Harrison, T., E. Burn, and F. Moller. 2020. “Teaching Character; Cultivating Virtue Perception and Virtue Reasoning through the Curriculum.” Educational Review 72 (5): 617–634. doi:10.1080/00131911.2018.1538937.
   Web of Science ®Google Scholar
• Hasson, F., S. Keeney, and H. McKenna. 2000. “Research Guidelines for the Delphi Survey Technique.” Journal of Advanced Nursing 32 (4): 1008–1015. doi:10.1046/j.1365-2648.2000.t01-1-01567.x.
   PubMed Web of Science ®Google Scholar
• Hershberg, R. M., R. O. Rubin, S. K. Johnson, K. S. Callina, and R. M. Lerner. 2016. “Perceptions of Character Development at a Trade College: Triangulating Student, Alumni, Administrator, and Teacher Perspectives.” Research in Human Development 13 (2): 157–173. doi:10.1080/15427609.2016.1164553.
   Web of Science ®Google Scholar
• Horbach, S. P., and W. Halffman. 2017. “Promoting Virtue or Punishing Fraud: Mapping Contrasts in the Language of ‘Scientific Integrity.’” Science and Engineering Ethics 23 (6): 1461–1485. doi:10.1007/s11948-016-9858-y.
   PubMed Web of Science ®Google Scholar
• Hsu, -C.-C., and B. A. Sandford. 2007. “The Delphi Technique: Making Sense of Consensus.” Practical Assessment, Research, and Evaluation 12 (Article): 10. doi:10.7275/pdz9-th90.
   Google Scholar
• Ioannidis, J. P. A., S. Greenland, M. A. Hlatky, M. J. Khoury, M. R. Macleod, D. Moher, K. F. Schulz, and R. Tibshirani. 2014. “Increasing Value and Reducing Waste in Research Design, Conduct, and Analysis.” The Lancet 383 (9912): 166–175. doi:10.1016/s0140-6736(13)62227-8.
   PubMed Web of Science ®Google Scholar
• Jünger, S., S. A. Payne, J. Brine, L. Radbruch, and S. G. Brearley. 2017. “Guidance on Conducting and REporting DElphi Studies (CREDES) in Palliative Care: Recommendations Based on a Methodological Systematic Review.” Palliative Medicine 31 (8): 684–706. doi:10.1177/0269216317690685.
   PubMed Web of Science ®Google Scholar
• Kalichman, M. W. 2007. “Responding to Challenges in Educating for the Responsible Conduct of Research.” Academic Medicine 82 (9): 870–875. doi:10.1097/ACM.0b013e31812f77fe.
   PubMed Web of Science ®Google Scholar
• Kalichman, M. W., and D. K. Plemmons. 2007. “Reported Goals for Responsible Conduct of Research Courses.” Academic Medicine 82 (9): 846–852. doi:10.1097/ACM.0b013e31812f78bf.
   PubMed Web of Science ®Google Scholar
• Keeney, S., F. Hasson, and H. McKenna. 2006. “Consulting the Oracle: Ten Lessons from Using the Delphi Technique in Nursing Research.” Journal of Advanced Nursing 53 (2): 205–212. doi:10.1111/j.1365-2648.2006.03716.x.
   PubMed Web of Science ®Google Scholar
• Kristjánsson, K. 2013. “Ten Myths about Character, Virtue and Virtue Education – Plus Three Well-Founded Misgivings.” British Journal of Educational Studies 61 (3): 269–287. doi:10.1080/00071005.2013.778386.
   Web of Science ®Google Scholar
• Lavery, J. V., and C. Ijsselmuiden. 2018. “The Research Fairness Initiative: Filling a Critical Gap in Global Research Ethics.” Gates Open Research 2: 58. doi:10.12688/gatesopenres.12884.1.
   PubMedGoogle Scholar
• Ludwig, B. 1997. “Predicting the Future: Have You Considered Using the Delphi Methodology?” Journal of Extension 35: 5.
   Google Scholar
• Macfarlane, B. 2009. Researching with Integrity: The Ethics of Academic Enquiry. New York: Routledge.
   Google Scholar
• MacIntyre, A. 2007. After Virtue: A Study in Moral Theory, Third Edition. Notre Dame, Indiana: University of Notre Dame Press.
   Google Scholar
• Macrina, F. L. 2014. Scientific Integrity: Text and Cases in Responsible Conduct of Research. Washington, DC: Wiley.
   Google Scholar
• Marušić, A., Tokalić, R., Tomić, V., Viđak, M., Ščepanović, R. 2019 ”Deliverable 1.2. Scoping review of scientific virtues for training.” Accessed January 22 2021
   Google Scholar
• Marusic, A., E. Wager, A. Utrobicic, H. R. Rothstein, and D. Sambunjak. 2016. “Interventions to Prevent Misconduct and Promote Integrity in Research and Publication.” Cochrane Database of Systematic Reviews 4. doi:10.1002/14651858.MR000038.pub2.
   Web of Science ®Google Scholar
• May, D. R., and M. T. Luth. 2013. “The Effectiveness of Ethics Education: A quasi-experimental Field Study.” Science and Engineering Ethics 19 (2): 545–568. doi:10.1007/s11948-011-9349-0.
   PubMed Web of Science ®Google Scholar
• McGee, R., J. Almquist, J. Keller, and S. Jacobsen. 2008. “Teaching and Learning Responsible Research Conduct: Influences of Prior Experiences on Acceptance of New Ideas.” Accountability in Research 15 (1): 30–62. doi:10.1080/08989620701783758.
   PubMed Web of Science ®Google Scholar
• Mejlgaard, N., M. V. Christensen, R. Strand, I. Buljan, M. Carrió, M. Cayetano i Giralt , E. Griessler, Lang, A., Marušić, A., Revuelta, G., Rodríguez, G., Saladié, N., Wuketich, M., et al. 2019. “Teaching Responsible Research and Innovation: A Phronetic Perspective.” Science and Engineering Ethics 25 (2): 597–615. doi:10.1007/s11948-018-0029-1.
   PubMed Web of Science ®Google Scholar
• Mitchell, V. W. 1991. “The Delphi Technique: An Exposition and Application.” Technology Analysis & Strategic Management 3 (4): 333–358. doi:10.1080/09537329108524065.
   Google Scholar
• Mojon-Azzi, S. M., and D. S. Mojon. 2004. “Scientific Misconduct: From Salami Slicing to Data Fabrication.” Ophthalmologica 218 (1): 1–3. doi:10.1159/000074559.
   PubMed Web of Science ®Google Scholar
• Murphy, M. K., N. A. Black, D. L. Lamping, C. M. McKee, C. F. Sanderson, J. Askham, and T. Marteau. 1998. “Consensus Development Methods, and Their Use in Clinical Guideline Development.” Health Technol Assess 2 (3): 1–88. doi:10.3310/hta2030.
   Google Scholar
• Murry, J. W., Jr., and J. O. Hammons. 1995. “Delphi: A Versatile Methodology for Conducting Qualitative Research.” The Review of Higher Education 18 (4): 423–436. doi:10.1353/rhe.1995.0008.
   Web of Science ®Google Scholar
• National Academies of Sciences, Engineering and Medicine. 2017. Fostering Integrity in Research. Washington, DC: National Academies Press.
   Google Scholar
• Palmer, N., and R. Forrester-Jones. 2018. “Research Ethics Training: Using a Virtue Ethics Approach to Training to Support Development of Researcher Integrity.” In Virtue Ethics in the Conduct and Governance of Social Science Research, edited by N. Emmerich, 65–82, Bingley: Howard House: Emerald Publishing Limited.
   Google Scholar
• Pare, G., A.-F. Cameron, P. Poba-Nzaou, and M. Templier. 2013. “A Systematic Assessment of Rigor in Information Systems ranking-type Delphi Studies.” Information & Management 50 (5): 207–217. doi:10.1016/j.im.2013.03.003.
   Web of Science ®Google Scholar
• Paternotte, C., and M. Ivanova. 2017. “Virtues and Vices in Scientific Practice.” Synthese 194 (5): 1787–1807. doi:10.1007/s11229-016-1023-2.
   Web of Science ®Google Scholar
• Pellegrino, E. D., and D. C. Thomasma. 1993. The Virtues in Medical Practice. New York: Oxford University Press.
   Google Scholar
• Pennock, R. T. 2019. An Instinct for Truth: Curiosity and the Moral Character of Science. Cambridge, MA: MIT Press.
   Google Scholar
• Pennock, R. T., and J. D. Miller. 2019. “What Traits of Character Do Exemplary Scientists Value? Results from the Scientific Virtues Survey”. The 6th World Conference on Research Integrity June 3 Hong Kong, : .
   Google Scholar
• Pennock, R. T., and M. O’Rourke. 2017. “Developing a Scientific Virtue-Based Approach to Science Ethics Training.” Science and Engineering Ethics 23 (1): 243–262. doi:10.1007/s11948-016-9757-2.
   PubMed Web of Science ®Google Scholar
• Pike, M. A., P. Hart, S.-A. S. Paul, T. Lickona, and P. Clarke. 2021. “Character Development through the Curriculum: Teaching and Assessing the Understanding and Practice of Virtue.” Journal of Curriculum Studies 53 (4): 449–466. doi:10.1080/00220272.2020.1755996.
   Web of Science ®Google Scholar
• Pizzolato, D., S. Abdi, and K. Dierickx. 2020. “Collecting and Characterizing Existing and Freely Accessible Research Integrity Educational Resources.” Accountability in Research 27 (4): 195–211. doi:10.1080/08989621.2020.1736571.
   PubMed Web of Science ®Google Scholar
• Plemmons, D. K., S. A. Brody, and M. W. Kalichman. 2006. “Student Perceptions of the Effectiveness of Education in the Responsible Conduct of Research.” Science and Engineering Ethics 12 (3): 571–582. doi:10.1007/s11948-006-0055-2.
   PubMed Web of Science ®Google Scholar
• Powell, C. 2003. “The Delphi Technique: Myths and Realities.” Journal of Advanced Nursing 41 (4): 376–382. doi:10.1046/j.1365-2648.2003.02537.x.
   PubMed Web of Science ®Google Scholar
• Pring, R. 2001. “The Virtues and Vices of an Educational Researcher.” Journal of Philosophy of Education 35 (3): 407–421. doi:10.1111/1467-9752.00235.
   Web of Science ®Google Scholar
• Resnik, D. B. 2012. “Ethical Virtues in Scientific Research.” Accountability in Research 19 (6): 329–343. doi:10.1080/08989621.2012.728908.
   PubMed Web of Science ®Google Scholar
• Sarafis, P., A. Tsounis, M. Malliarou, and E. Lahana. 2014. “Disclosing the Truth: A Dilemma between Instilling Hope and Respecting Patient Autonomy in Everyday Clinical Practice.” Global Journal of Health Science 6 (2): 128. doi:10.5539/gjhs.v6n2p128.
   PubMedGoogle Scholar
• Schweller, M., D. L. Ribeiro, E. V. Celeri, and M. A. de Carvalho-Filho. 2017. “Nurturing Virtues of the Medical Profession: Does It Enhance Medical Students’ Empathy?” International Journal of Medical Education 8: 262–267. doi:10.5116/ijme.5951.6044.
   PubMed Web of Science ®Google Scholar
• Slade, S. C., C. E. Dionne, M. Underwood, and R. Buchbinder. 2014. “Standardised Method for Reporting Exercise Programmes: Protocol for a Modified Delphi Study.” BMJ open 4 (12): e006682. doi:10.1136/bmjopen-2014-006682.
   PubMed Web of Science ®Google Scholar
• Slote, M. 2005. “Self-regarding and other-regarding Virtues.” In Virtue Ethics and Moral Education, edited by D. Carr and J. Steutel. Taylor & Francis: London 99–110 .
   Google Scholar
• Steele, L. M., T. J. Mulhearn, K. E. Medeiros, L. L. Watts, S. Connelly, and M. D. Mumford. 2016. “How Do We Know What Works? A Review and Critique of Current Practices in Ethics Training Evaluation.” Accountability in Research 23 (6): 319–350. doi:10.1080/08989621.2016.1186547.
   PubMed Web of Science ®Google Scholar
• Steneck, N. H. 2006. “Fostering Integrity in Research: Definitions, Current Knowledge, and Future Directions.” Science and Engineering Ethics 12 (1): 53–74. doi:10.1007/pl00022268.
   PubMed Web of Science ®Google Scholar
• Todd, E. M., B. S. Torrence, L. L. Watts, T. J. Mulhearn, S. Connelly, and M. D. Mumford. 2017. “Effective Practices in the Delivery of Research Ethics Education: A Qualitative Review of Instructional Methods.” Accountability in Research 24 (5): 297–321. doi:10.1080/08989621.2017.1301210.
   PubMed Web of Science ®Google Scholar
• Tomić, V., I. Buljan, and A. Marušić. 2022. “Perspectives of Key Stakeholders on Essential Virtues for Good Scientific Practice in Research Areas.” Accountability in Research 29 (2): 77–108. doi:10.1080/08989621.2021.1900739.
   PubMed Web of Science ®Google Scholar
• Van Fossen, M., J. P. Burns, T. Lickona, and L. Schatz. 2021. “Teaching Virtue Virtually: Can the Virtue of Tolerance of Diversity of Conscience Be Taught Online?” Journal of Moral Education 1–19. doi:10.1080/03057240.2021.1964452.
   Web of Science ®Google Scholar
• van Hecke, O., P. R. Kamerman, N. Attal, R. Baron, G. Bjornsdottir, D. L. Bennett, M. I. Bennett, D. Bouhassira, L. Diatchenko, and R. Freeman. 2015. “Neuropathic Pain Phenotyping by International Consensus (Neuroppic) for Genetic Studies: A NeuPSIG Systematic Review, Delphi Survey, and Expert Panel Recommendations.” Pain 156 (11): 2337–2353. doi:10.1097/j.pain.0000000000000335.
   PubMed Web of Science ®Google Scholar
• Vernon, W. 2009. “The Delphi Technique: A Review.” International Journal of Therapy and Rehabilitation 16 (2): 69–76. doi:10.12968/ijtr.2009.16.2.38892.
   Google Scholar
• Vogel, C., S. Zwolinsky, C. Griffiths, M. Hobbs, E. Henderson, and E. Wilkins. 2019. “A Delphi Study to Build Consensus on the Definition and Use of Big Data in Obesity Research.” International Journal of Obesity 43 (12): 2573–2586. doi:10.1038/s41366-018-0313-9.
   PubMed Web of Science ®Google Scholar
• Watts, L. L., K. E. Medeiros, T. J. Mulhearn, L. M. Steele, S. Connelly, and M. D. Mumford. 2017. “Are Ethics Training Programs Improving? A meta-analytic Review of past and Present Ethics Instruction in the Sciences.” Ethics & Behavior 27 (5): 351–384. doi:10.1080/10508422.2016.1182025.
   PubMed Web of Science ®Google Scholar
• Zandvoort, H., T. Børsen, M. Deneke, and S. J. Bird. 2013. “Editors’ Overview Perspectives on Teaching Social Responsibility to Students in Science and Engineering.” Science and Engineering Ethics 19 (4): 1413–1438. doi:10.1007/s11948-013-9495-7.
   PubMed Web of Science ®Google Scholar