Can ChatGPT-4 Diagnose in Turkish: A Comparison of ChatGPT Responses to Health-Related Questions in English and Turkish

Abstract

OpenAI's machine learning-based ChatGPT implementation has become a trending topic in the first quarter of 2023. Comparative assessment of the health information provided by ChatGPT in Turkish with the health information provided in English is the purpose of this study. Comparison between English answer to English question and English translation of Turkish answer to Turkish question is made by five gastroenterology specialists for their comprehensiveness and accuracy. Turkish responses of ChatGPT were assessed as correct as English responses and less comprehensive but not evaluated as “inadequate”. It was found that ChatGPT could be used for online health information purposes in the Turkish language.

Keywords:

• ChatGPT-4
• health information
• language bias

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Mustafa Said Yıldız

Mustafa Said Yıldız, PhD ([email protected]) is an Associate Professor and Internal Auditor, the Internal Audit Department, Turkiye Ministry of Health.

Ayfer Alper

Ayfer Alper, PhD ([email protected]) is a Professor and Head of the Department of Computer Education and Instructional Technologies, Ankara University, Ankara, Turkey.