Journal article · 2025 · Open access

Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios

Büşra Karaca, Yunus Emre Çakmak, Damla Erkal

Australian Endodontic Journal, 52(1), 130–138 · Published 21 November 2025 · DOI 10.1111/aej.70040

Open PDFView at the publisherCite this paper

In brief

“Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios” is a 2025 journal article by Büşra Karaca and 2 co-authors, published in Australian Endodontic Journal. OpenAlex counts 13 citations as of 18 November 2026, which puts it in the top 2% of works published in 2025 by citations. It is open access: the full text is free to read at Australian Endodontic Journal.

Citations
13
Most cited in
2026 (13)
Field-weighted impact
2.12
References
30
Authors
3

Abstract

Large language models (LLMs) are increasingly used in healthcare, but their performance in endodontic decision-making remains unclear. This study aimed to compare six LLMs in terms of diagnostic appropriateness for endodontic treatment planning. Fifty clinical scenarios were developed and entered into six LLMs (ChatGPT-4o, ChatGPT-3.5, Claude 4, Copilot, DeepSeek-V3, Gemini 2.5). Two specialists scored responses as appropriate or inappropriate. Repeated measures ANOVA and chi-square tests were used for analysis. Claude showed the highest accuracy (76%), followed by DeepSeek and Gemini. ChatGPT-3.5 had the lowest (40%). Significant differences were found between models (p < 0.05). Performance was better on straightforward cases than on complex scenarios. LLMs vary widely in diagnostic accuracy for endodontic cases. While some models show promise, others may provide confidently incorrect recommendations. Caution and human oversight remain essential until domain-specific, fine-tuned models are developed.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Karaca, B., Çakmak, Y. E., & Erkal, D. (2025). Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios. Australian Endodontic Journal, 52(1), 130–138. https://doi.org/10.1111/aej.70040

MLA 9

Karaca, Büşra, et al. “Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios.” Australian Endodontic Journal, vol. 52, no. 1, 2025, pp. 130–138. https://doi.org/10.1111/aej.70040.

Chicago

Karaca, Büşra, Yunus Emre Çakmak, and Damla Erkal. 2025. “Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios.” Australian Endodontic Journal 52 (1): 130–138. https://doi.org/10.1111/aej.70040.

Harvard

Karaca, B., Çakmak, Y. E. and Erkal, D. (2025) ‘Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios’, Australian Endodontic Journal, 52(1), pp. 130–138. doi:10.1111/aej.70040.

IEEE

B. Karaca, Y. E. Çakmak, and D. Erkal, “Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios,” Australian Endodontic Journal, vol. 52, no. 1, pp. 130–138, 2025, doi: 10.1111/aej.70040.

BibTeX

@article{karaca2025clinical,
  title     = {{Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios}},
  author    = {Karaca, Büşra and Çakmak, Yunus Emre and Erkal, Damla},
  journal   = {Australian Endodontic Journal},
  year      = {2025},
  volume    = {52},
  number    = {1},
  pages     = {130--138},
  doi       = {10.1111/aej.70040},
  url       = {https://doi.org/10.1111/aej.70040}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education

  • large language models
  • endodontics
  • endodontic treatment planning
  • diagnostic appropriateness
  • simulated clinical scenarios
  • LLM comparison
  • ChatGPT
  • Claude

Work with this paper

Most-cited papers in Medicine

All highly cited Medicine papers

Questions about this paper

How do I cite this paper in APA style?

Karaca, B., Çakmak, Y. E., & Erkal, D. (2025). Clinical Relevance of Large Language Models in Endodontics: Diagnostic Appropriateness Based on 50 Simulated Case Scenarios. Australian Endodontic Journal, 52(1), 130–138. https://doi.org/10.1111/aej.70040

How many times has this paper been cited?

13 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Australian Endodontic Journal: sign in and open the PDF from this page.

Who wrote this paper?

Büşra Karaca, Yunus Emre Çakmak, Damla Erkal.

What is the DOI of this paper?

10.1111/aej.70040, permanently at https://doi.org/10.1111/aej.70040. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.