Journal article · 2025 · Open access

A Comprehensive Overview of Large Language Models

Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick M. Barnes, Ajmal Saeed Mian

ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72 · Published 18 June 2025 · DOI 10.1145/3744746

Free PDFView at the publisherCite this paper

In brief

“A Comprehensive Overview of Large Language Models” is a 2025 journal article by Humza Naveed and 8 co-authors, published in ACM Transactions on Intelligent Systems and Technology. OpenAlex counts 2,833 citations as of 15 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
2,833
Most cited in
2025 (1,172)
Field-weighted impact
543.75
References
513
Authors
9

Abstract

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works encompass diverse topics such as architectural innovations, better training strategies, context length improvements, fine-tuning, multimodal LLMs, robotics, datasets, benchmarking, efficiency, and more. With the rapid development of techniques and regular breakthroughs in LLM research, it has become considerably challenging to perceive the bigger picture of the advances in this direction. Considering the rapidly emerging plethora of literature on LLMs, it is imperative that the research community is able to benefit from a concise yet comprehensive overview of the recent developments in this field. This article provides an overview of the literature on a broad range of LLM-related concepts. Our self-contained comprehensive overview of LLMs discusses relevant background concepts along with covering the advanced topics at the frontier of research in LLMs. This review article is intended to provide not only a systematic survey but also a quick, comprehensive reference for the researchers and practitioners to draw insights from extensive, informative summaries of the existing works to advance the LLM research.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N. M., & Mian, A. S. (2025). A Comprehensive Overview of Large Language Models. ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72. https://doi.org/10.1145/3744746

MLA 9

Naveed, Humza, et al. “A Comprehensive Overview of Large Language Models.” ACM Transactions on Intelligent Systems and Technology, vol. 16, no. 5, 2025, pp. 1–72. https://doi.org/10.1145/3744746.

Chicago

Naveed, Humza, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick M. Barnes, and Ajmal Saeed Mian. 2025. “A Comprehensive Overview of Large Language Models.” ACM Transactions on Intelligent Systems and Technology 16 (5): 1–72. https://doi.org/10.1145/3744746.

Harvard

Naveed, H. et al. (2025) ‘A Comprehensive Overview of Large Language Models’, ACM Transactions on Intelligent Systems and Technology, 16(5), pp. 1–72. doi:10.1145/3744746.

IEEE

H. Naveed et al., “A Comprehensive Overview of Large Language Models,” ACM Transactions on Intelligent Systems and Technology, vol. 16, no. 5, pp. 1–72, 2025, doi: 10.1145/3744746.

BibTeX

@article{naveed2025comprehensive,
  title     = {{A Comprehensive Overview of Large Language Models}},
  author    = {Naveed, Humza and Khan, Asad Ullah and Qiu, Shi and Saqib, Muhammad and Anwar, Saeed and Usman, Muhammad and Akhtar, Naveed and Barnes, Nick M. and Mian, Ajmal Saeed},
  journal   = {ACM Transactions on Intelligent Systems and Technology},
  year      = {2025},
  volume    = {16},
  number    = {5},
  pages     = {1--72},
  doi       = {10.1145/3744746},
  url       = {https://doi.org/10.1145/3744746}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20233737
2024576576
20251,1721172
20261,0481048

Its field-weighted citation impact is 543.75: it has been cited 543.75 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • LLM architecture
  • context length
  • fine-tuning
  • multimodal large language models
  • LLM benchmarking

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N. M., & Mian, A. S. (2025). A Comprehensive Overview of Large Language Models. ACM Transactions on Intelligent Systems and Technology, 16(5), 1–72. https://doi.org/10.1145/3744746

How many times has this paper been cited?

2,833 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at arXiv (Cornell University).

Who wrote this paper?

Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick M. Barnes, Ajmal Saeed Mian.

What is the DOI of this paper?

10.1145/3744746. The permanent link is https://doi.org/10.1145/3744746.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.