Publication:
Large Language Models in peri-implant disease: How well do they perform?

dc.contributor.authorKaklamanos, Eleftherios G
dc.date.accessioned2025-10-02T08:55:04Z
dc.date.available2025-10-02T08:55:04Z
dc.date.issued2025-03
dc.description.abstractStatement of problem: Artificial intelligence (AI) has gained significant recent attention and several AI applications, such as the Large Language Models (LLMs) are promising for use in clinical medicine and dentistry. Nevertheless, assessing the performance of LLMs is essential to identify potential inaccuracies or even prevent harmful outcomes. Purpose. Purpose: The purpose of this study was to evaluate and compare the evidence-based potential of answers provided by 4 LLMs to clinical questions in the field of implant dentistry. Material and methods: A total of 10 open-ended questions pertinent to prevention and treatment of peri-implant disease were posed to 4 distinct LLMs including ChatGPT 4.0, Google Gemini, Google Gemini Advanced, and Microsoft Copilot. The answers were evaluated independently by 2 periodontists against scientific evidence for comprehensiveness, scientific accuracy, clarity, and relevance. The LLMs responses received scores ranging from 0 (minimum) to 10 (maximum) points. To assess the intra-evaluator reliability, a re-evaluation of the LLM responses was performed after 2 weeks and Cronbach α and interclass correlation coefficient (ICC) was used (α=.05). Results: The scores assigned by the examiners on the 2 occasions were not statistically different and each LLM received an average score. Google Gemini Advanced ranked higher than the rest of the LLMs, while Google Gemini scored worst. The difference between Google Gemini Advanced and Google Gemini was statistically significantly different (P=.005). Conclusions: Dental professionals need to be cautious when using LLMs to access content related to peri-implant diseases. LLMs cannot currently replace dental professionals and caution should be exercised when used in patient care.
dc.identifier.doi10.1016/j.prosdent.2025.02.008
dc.identifier.issn0022-3913
dc.identifier.urihttps://repository.mbru.ac.ae/handle/1/1825
dc.publisherElsevier BV
dc.relation.ispartofThe Journal of Prosthetic Dentistry
dc.subjectLarge Language Models
dc.subjectArtificial Intelligence
dc.subjectMachine Learning
dc.subjectPeri-Implant Diseases
dc.subjectDental Implants
dc.subjectDiagnosis
dc.subjectClinical Decision Support Systems
dc.subjectPerformance Metrics
dc.subjectAccuracy
dc.titleLarge Language Models in peri-implant disease: How well do they perform?
dc.typejournal-article
dspace.entity.typePublication

Files

Original bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Large Language Models in peri-implant disease How well do they perform.pdf
Size:
432.27 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: