Journal article · 2024 · Open access

A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges

Mohaimenul Azam Khan Raiaan, Md. Saddam Hossain Mukta, Kaniz Fatema, Nur Mohammad Fahad, Sadman Sakib, Most. Marufatul Jannat Mim, Jubaer Ahmad, Mohammed Eunus Ali, Sami Azam

IEEE Access, 12, 26839–26874 · Published 1 January 2024 · DOI 10.1109/access.2024.3365742

Free PDFView at the publisherCite this paper

In brief

“A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges” is a 2024 journal article by Mohaimenul Azam Khan Raiaan and 8 co-authors, published in IEEE Access. OpenAlex counts 1,146 citations as of 15 November 2026. It is open access: the full text is free to read at IEEE Access.

Citations
1,146
Most cited in
2025 (538)
Field-weighted impact
120.17
References
213
Authors
9

Abstract

Large Language Models (LLMs) recently demonstrated extraordinary capability, including natural language processing (NLP), language translation, text generation, question answering, etc. Moreover, LLMs are a new and essential part of computerized language processing, having the ability to understand complex verbal patterns and generate coherent and appropriate replies for the situation. Though this success of LLMs has prompted a substantial increase in research contributions, rapid growth has made it difficult to understand the overall impact of these improvements. Since a lot of new research on LLMs is coming out quickly, it is getting tough to get an overview of all of them in a short note. Consequently, the research community would benefit from a short but thorough review of the recent changes in this area. This article thoroughly overviews LLMs, including their history, architectures, transformers, resources, training methods, applications, impacts, challenges, etc. This paper begins by discussing the fundamental concepts of LLMs with its traditional pipeline of the LLMs training phase. It then provides an overview of the existing works, the history of LLMs, their evolution over time, the architecture of transformers in LLMs, the different resources of LLMs, and the different training methods that have been used to train them. It also demonstrated the datasets utilized in the studies. After that, the paper discusses the wide range of applications of LLMs, including biomedical and healthcare, education, social, business, and agriculture. It also illustrates how LLMs create an impact on society and shape the future of AI and how they can be used to solve real-world problems. Then it also explores open issues and challenges to deploying LLMs in real-world scenario. Our review paper aims to help practitioners, researchers, and experts thoroughly understand the evolution of LLMs, pre-trained architectures, applications, challenges, and future goals.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Raiaan, M. A. K., Mukta, M. S. H., Fatema, K., Fahad, N. M., Sakib, S., Mim, M. M. J., Ahmad, J., Ali, M. E., & Azam, S. (2024). A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access, 12, 26839–26874. https://doi.org/10.1109/access.2024.3365742

MLA 9

Raiaan, Mohaimenul Azam Khan, et al. “A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges.” IEEE Access, vol. 12, 2024, pp. 26839–26874. https://doi.org/10.1109/access.2024.3365742.

Chicago

Raiaan, Mohaimenul Azam Khan, Md. Saddam Hossain Mukta, Kaniz Fatema, Nur Mohammad Fahad, Sadman Sakib, Most. Marufatul Jannat Mim, Jubaer Ahmad, Mohammed Eunus Ali, and Sami Azam. 2024. “A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges.” IEEE Access 12: 26839–26874. https://doi.org/10.1109/access.2024.3365742.

Harvard

Raiaan, M. A. K. et al. (2024) ‘A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges’, IEEE Access, 12, pp. 26839–26874. doi:10.1109/access.2024.3365742.

IEEE

M. A. K. Raiaan et al., “A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges,” IEEE Access, vol. 12, pp. 26839–26874, 2024, doi: 10.1109/access.2024.3365742.

BibTeX

@article{raiaan2024review,
  title     = {{A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges}},
  author    = {Raiaan, Mohaimenul Azam Khan and Mukta, Md. Saddam Hossain and Fatema, Kaniz and Fahad, Nur Mohammad and Sakib, Sadman and Mim, Most. Marufatul Jannat and Ahmad, Jubaer and Ali, Mohammed Eunus and Azam, Sami},
  journal   = {IEEE Access},
  year      = {2024},
  volume    = {12},
  pages     = {26839--26874},
  doi       = {10.1109/access.2024.3365742},
  url       = {https://doi.org/10.1109/access.2024.3365742}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202311
2024173173
2025538538
2026434434

Its field-weighted citation impact is 120.17: it has been cited 120.17 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • transformer models
  • LLM applications
  • societal impact of AI

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Raiaan, M. A. K., Mukta, M. S. H., Fatema, K., Fahad, N. M., Sakib, S., Mim, M. M. J., Ahmad, J., Ali, M. E., & Azam, S. (2024). A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges. IEEE Access, 12, 26839–26874. https://doi.org/10.1109/access.2024.3365742

How many times has this paper been cited?

1,146 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at IEEE Access.

Who wrote this paper?

Mohaimenul Azam Khan Raiaan, Md. Saddam Hossain Mukta, Kaniz Fatema, Nur Mohammad Fahad, Sadman Sakib, Most. Marufatul Jannat Mim, Jubaer Ahmad, Mohammed Eunus Ali, Sami Azam.

What is the DOI of this paper?

10.1109/access.2024.3365742. The permanent link is https://doi.org/10.1109/access.2024.3365742.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.