Journal article · 2024 · Open access
A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges
IEEE Access, 12, 26839–26874 · Published 1 January 2024 · DOI 10.1109/access.2024.3365742
In brief
“A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges” is a 2024 journal article by Mohaimenul Azam Khan Raiaan and 8 co-authors, published in IEEE Access. OpenAlex counts 1,146 citations as of 15 November 2026. It is open access: the full text is free to read at IEEE Access.
- Citations
- 1,146
- Most cited in
- 2025 (538)
- Field-weighted impact
- 120.17
- References
- 213
- Authors
- 9
Abstract
Large Language Models (LLMs) recently demonstrated extraordinary capability, including natural language processing (NLP), language translation, text generation, question answering, etc. Moreover, LLMs are a new and essential part of computerized language processing, having the ability to understand complex verbal patterns and generate coherent and appropriate replies for the situation. Though this success of LLMs has prompted a substantial increase in research contributions, rapid growth has made it difficult to understand the overall impact of these improvements. Since a lot of new research on LLMs is coming out quickly, it is getting tough to get an overview of all of them in a short note. Consequently, the research community would benefit from a short but thorough review of the recent changes in this area. This article thoroughly overviews LLMs, including their history, architectures, transformers, resources, training methods, applications, impacts, challenges, etc. This paper begins by discussing the fundamental concepts of LLMs with its traditional pipeline of the LLMs training phase. It then provides an overview of the existing works, the history of LLMs, their evolution over time, the architecture of transformers in LLMs, the different resources of LLMs, and the different training methods that have been used to train them. It also demonstrated the datasets utilized in the studies. After that, the paper discusses the wide range of applications of LLMs, including biomedical and healthcare, education, social, business, and agriculture. It also illustrates how LLMs create an impact on society and shape the future of AI and how they can be used to solve real-world problems. Then it also explores open issues and challenges to deploying LLMs in real-world scenario. Our review paper aims to help practitioners, researchers, and experts thoroughly understand the evolution of LLMs, pre-trained architectures, applications, challenges, and future goals.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Raiaan, M. A. K., Mukta, M. S. H., Fatema, K., Fahad, N. M., Sakib, S., Mim, M. M. J., Ahmad, J., Ali, M. E., & Azam, S. (2024). A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access, 12, 26839–26874. https://doi.org/10.1109/access.2024.3365742
MLA 9
Raiaan, Mohaimenul Azam Khan, et al. “A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges.” IEEE Access, vol. 12, 2024, pp. 26839–26874. https://doi.org/10.1109/access.2024.3365742.
Chicago
Raiaan, Mohaimenul Azam Khan, Md. Saddam Hossain Mukta, Kaniz Fatema, Nur Mohammad Fahad, Sadman Sakib, Most. Marufatul Jannat Mim, Jubaer Ahmad, Mohammed Eunus Ali, and Sami Azam. 2024. “A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges.” IEEE Access 12: 26839–26874. https://doi.org/10.1109/access.2024.3365742.
Harvard
Raiaan, M. A. K. et al. (2024) ‘A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges’, IEEE Access, 12, pp. 26839–26874. doi:10.1109/access.2024.3365742.
IEEE
M. A. K. Raiaan et al., “A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges,” IEEE Access, vol. 12, pp. 26839–26874, 2024, doi: 10.1109/access.2024.3365742.
BibTeX
@article{raiaan2024review,
title = {{A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges}},
author = {Raiaan, Mohaimenul Azam Khan and Mukta, Md. Saddam Hossain and Fatema, Kaniz and Fahad, Nur Mohammad and Sakib, Sadman and Mim, Most. Marufatul Jannat and Ahmad, Jubaer and Ali, Mohammed Eunus and Azam, Sami},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {26839--26874},
doi = {10.1109/access.2024.3365742},
url = {https://doi.org/10.1109/access.2024.3365742}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 1 | |
| 2024 | 173 | |
| 2025 | 538 | |
| 2026 | 434 |
Its field-weighted citation impact is 120.17: it has been cited 120.17 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- large language models
- transformer models
- LLM applications
- societal impact of AI
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Raiaan, M. A. K., Mukta, M. S. H., Fatema, K., Fahad, N. M., Sakib, S., Mim, M. M. J., Ahmad, J., Ali, M. E., & Azam, S. (2024). A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access, 12, 26839–26874. https://doi.org/10.1109/access.2024.3365742
How many times has this paper been cited?
1,146 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at IEEE Access.
Who wrote this paper?
Mohaimenul Azam Khan Raiaan, Md. Saddam Hossain Mukta, Kaniz Fatema, Nur Mohammad Fahad, Sadman Sakib, Most. Marufatul Jannat Mim, Jubaer Ahmad, Mohammed Eunus Ali, Sami Azam.
What is the DOI of this paper?
10.1109/access.2024.3365742. The permanent link is https://doi.org/10.1109/access.2024.3365742.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.