Utilizing ChatGPT-4 for Providing Information on Periodontal Disease to Patients: A DISCERN Quality Analysis

dc.contributor.authorAlan, Raif
dc.contributor.authorAlan, Betul Melek
dc.date.accessioned2025-01-27T20:34:53Z
dc.date.available2025-01-27T20:34:53Z
dc.date.issued2023
dc.departmentÇanakkale Onsekiz Mart Üniversitesi
dc.description.abstractBackground: Due to their ability to mimic human responses, anthropomorphic entities such as ChatGPT have a higher likelihood of gaining people's trust. This study aimed to evaluate the quality of information generated by ChatGPT-4, as an artificial intelligence (AI) chatbot, on periodontal disease (PD) using the DISCERN instrument. Methods: Using Google Bard, the topics related to PD that had the highest search volume according to Google Trends were identified. An interactive dialogue was created by placing the topics in the standard question pattern. As a patient with PD, detailed information was requested from ChatGPT-4 regarding the relevant topics. The 'regenerate response' feature was not employed, and the initial response generated by ChatGPT-4 was carefully considered for each topic as new prompts in the form of questions were entered. The response to each question was independently assessed and rated by two experienced raters using the DISCERN instrument.Results: Based on the total DISCERN scores, the qualities of the responses generated by ChatGPT-4 were 'good', except for the two responses that rater-2 scored as 'fair'. It was also observed that the 'treatment choices' section of both raters had significantly fewer scores than the other sections. In both weighted kappa and Krippendorff alpha measures, the strength of agreement varied from 'substantial' to 'almost-perfect', and the correlation between values was statistically significant.Conclusion: Despite some limitations in providing complete treatment choice information according to the DISCERN instrument, it is considered valuable for PD patients seeking information, as it consistently offered accurate guidance in the majority of responses.
dc.identifier.doi10.7759/cureus.46213
dc.identifier.issn2168-8184
dc.identifier.issue9
dc.identifier.pmid37908933
dc.identifier.urihttps://doi.org/10.7759/cureus.46213
dc.identifier.urihttps://hdl.handle.net/20.500.12428/23500
dc.identifier.volume15
dc.identifier.wosWOS:001090333700025
dc.identifier.wosqualityN/A
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakPubMed
dc.language.isoen
dc.publisherSpringernature
dc.relation.ispartofCureus Journal of Medical Science
dc.relation.publicationcategoryinfo:eu-repo/semantics/openAccess
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_WoS_20250125
dc.subjectperiodontal disease
dc.subjectoral health
dc.subjecthealth information management
dc.subjectchatbot
dc.subjectartificial intelligence
dc.titleUtilizing ChatGPT-4 for Providing Information on Periodontal Disease to Patients: A DISCERN Quality Analysis
dc.typeArticle

Dosyalar