Journal article · 2025 · Open access
A Comprehensive Overview of Large Language Models
ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72 · Published 18 June 2025 · DOI 10.1145/3744746
In brief
“A Comprehensive Overview of Large Language Models” is a 2025 journal article by Humza Naveed and 8 co-authors, published in ACM Transactions on Intelligent Systems and Technology. OpenAlex counts 2,833 citations as of 15 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 2,833
- Most cited in
- 2025 (1,172)
- Field-weighted impact
- 543.75
- References
- 513
- Authors
- 9
Abstract
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works encompass diverse topics such as architectural innovations, better training strategies, context length improvements, fine-tuning, multimodal LLMs, robotics, datasets, benchmarking, efficiency, and more. With the rapid development of techniques and regular breakthroughs in LLM research, it has become considerably challenging to perceive the bigger picture of the advances in this direction. Considering the rapidly emerging plethora of literature on LLMs, it is imperative that the research community is able to benefit from a concise yet comprehensive overview of the recent developments in this field. This article provides an overview of the literature on a broad range of LLM-related concepts. Our self-contained comprehensive overview of LLMs discusses relevant background concepts along with covering the advanced topics at the frontier of research in LLMs. This review article is intended to provide not only a systematic survey but also a quick, comprehensive reference for the researchers and practitioners to draw insights from extensive, informative summaries of the existing works to advance the LLM research.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N. M., & Mian, A. S. (2025). A Comprehensive Overview of Large Language Models. ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72. https://doi.org/10.1145/3744746
MLA 9
Naveed, Humza, et al. “A Comprehensive Overview of Large Language Models.” ACM Transactions on Intelligent Systems and Technology, vol. 16, no. 5, 2025, pp. 1–72. https://doi.org/10.1145/3744746.
Chicago
Naveed, Humza, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick M. Barnes, and Ajmal Saeed Mian. 2025. “A Comprehensive Overview of Large Language Models.” ACM Transactions on Intelligent Systems and Technology 16 (5): 1–72. https://doi.org/10.1145/3744746.
Harvard
Naveed, H. et al. (2025) ‘A Comprehensive Overview of Large Language Models’, ACM Transactions on Intelligent Systems and Technology, 16(5), pp. 1–72. doi:10.1145/3744746.
IEEE
H. Naveed et al., “A Comprehensive Overview of Large Language Models,” ACM Transactions on Intelligent Systems and Technology, vol. 16, no. 5, pp. 1–72, 2025, doi: 10.1145/3744746.
BibTeX
@article{naveed2025comprehensive,
title = {{A Comprehensive Overview of Large Language Models}},
author = {Naveed, Humza and Khan, Asad Ullah and Qiu, Shi and Saqib, Muhammad and Anwar, Saeed and Usman, Muhammad and Akhtar, Naveed and Barnes, Nick M. and Mian, Ajmal Saeed},
journal = {ACM Transactions on Intelligent Systems and Technology},
year = {2025},
volume = {16},
number = {5},
pages = {1--72},
doi = {10.1145/3744746},
url = {https://doi.org/10.1145/3744746}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 37 | |
| 2024 | 576 | |
| 2025 | 1,172 | |
| 2026 | 1,048 |
Its field-weighted citation impact is 543.75: it has been cited 543.75 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- large language models
- LLM architecture
- context length
- fine-tuning
- multimodal large language models
- LLM benchmarking
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N. M., & Mian, A. S. (2025). A Comprehensive Overview of Large Language Models. ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72. https://doi.org/10.1145/3744746
How many times has this paper been cited?
2,833 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick M. Barnes, Ajmal Saeed Mian.
What is the DOI of this paper?
10.1145/3744746. The permanent link is https://doi.org/10.1145/3744746.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.