ChatGPT Provides Good Answers to Patient Questions About Colonoscopy
Douglas K. Rex, MD, MASGE, reviewing Lee TC, et al. Gastroenterology 2023 May 5.
This study examined the quality of answers provided by ChatGPT (OpenAI, San Francisco, Calif) to 8 common questions about colonoscopy, compared with answers to the same questions on the publicly available webpages of 3 randomly selected hospitals from the Top-20 list of hospitals for gastroenterology and GI surgery, published by U.S. News and World Report.
Two attending gastroenterologists and two fellows blindly judged the quality of the answers and were also asked whether they thought artificial intelligence (AI) answered the questions. A plagiarism software detection program assessed the ChatGPT answers.
The blinded scores for the AI answers were higher than or similar to the non-AI answers for ease of understanding, scientific adequacy, and answer satisfaction. There was no evidence of plagiarism in the non-AI web-based material.
Three raters accurately identified less than 50% of AI-generated answers, whereas one GI fellow had 81% accuracy.
COMMENTAI is now capable of providing competent, accurate, easily understood, and empathetic answers to patient questions, which will make the work of physicians easier in many regards. Inevitably, it will also replace a lot of jobs performed by humans.
Note to readers: At the time we reviewed this paper, its publisher noted that it was not in final form and that subsequent changes might be made.
CITATION(S)
Lee TC, Staller K, Botoman V, Pathipati MP, Varma S, Kuo B. ChatGPT answers common patient questions about colonoscopy. Gastroenterology 2023 May 5. (Epub ahead of print)(https://doi.org/10.1053/j.gastro.2023.04.033)
