Preprint · 2024 · Open access
Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects
Published 12 August 2024 · DOI 10.36227/techrxiv.23589741.v6
In brief
“Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects” is a 2024 preprint by Muhammad Usman Hadi and 13 co-authors. OpenAlex counts 88 citations as of 16 November 2026. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 88
- Most cited in
- 2025 (52)
- Authors
- 14
Abstract
Within the vast expanse of computerized language processing, a revolutionary entity known as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to comprehend intricate linguistic patterns and conjure coherent and contextually fitting responses. LLMs are a type of artificial intelligence (AI) that have emerged as powerful tools for a wide range of tasks, including natural language processing (NLP), machine translation, vision applications, and question-answering. This survey provides a comprehensive overview of LLMs, including their history, architecture, training methods, applications, and challenges. We begin by discussing the fundamental concepts of generative AI and the architecture of generative pre-trained transformers (GPT). We then provide an overview of the history of LLMs, their evolution over time, and the different training methods that have been used to train them. We then discuss the wide range of tasks where they are used and also discuss applications of LLMs in different domains, including medicine, education, finance, engineering, media, entertainment, politics, and law. We also discuss how LLMs are shaping the future of AI and their increasing role in scientific discovery, and how they can be used to solve real-world problems. Next, we explore the challenges associated with deploying LLMs in real-world scenarios, including ethical considerations, model biases, interpretability, and computational resource requirements. This survey also highlights techniques for enhancing the robustness and controllability of LLMs and addressing bias, fairness, and quality issues in Generative AI. Finally, we conclude by highlighting the future of LLM research and the challenges that need to be addressed in order to make this technology more reliable and useful. This survey is intended to provide researchers, practitioners, and enthusiasts with a comprehensive understanding of LLMs, their evolution, applications, and challenges. By consolidating the state-of-the-art knowledge in the field, this article is anticipated to serve as a valuable resource for learning the current state-of-the-art as well as further advancements in the development and utilization of LLMs for a wide range of real-world applications. The GitHub repo for this project is available at https://github.com/anas-zafar/LLM-Survey
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Hadi, M. U., Al Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M. I., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. A. (2024). Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects. https://doi.org/10.36227/techrxiv.23589741.v6
MLA 9
Hadi, Muhammad Usman, et al. “Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects.” 2024. https://doi.org/10.36227/techrxiv.23589741.v6.
Chicago
Hadi, Muhammad Usman, Qasem Al Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Imran Irfan, Anas Zafar, et al. 2024. “Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects.” https://doi.org/10.36227/techrxiv.23589741.v6.
Harvard
Hadi, M. U. et al. (2024) ‘Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects’. doi:10.36227/techrxiv.23589741.v6.
IEEE
M. U. Hadi et al., “Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects,” 2024, doi: 10.36227/techrxiv.23589741.v6.
BibTeX
@misc{hadi2024large,
title = {{Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects}},
author = {Hadi, Muhammad Usman and Al Tashi, Qasem and Qureshi, Rizwan and Shah, Abbas and Muneer, Amgad and Irfan, Muhammad Imran and Zafar, Anas and Shaikh, Muhammad Bilal and Akhtar, Naveed and Hassan, Syed Zohaib and Shoman, Maged and Wu, Jia and Mirjalili, Seyedali and Shah, Mubarak A.},
year = {2024},
doi = {10.36227/techrxiv.23589741.v6},
url = {https://doi.org/10.36227/techrxiv.23589741.v6}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 12 | |
| 2025 | 52 | |
| 2026 | 24 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- large language models
- generative pre-trained transformer
- GPT
- LLM applications
- ethical considerations
- model bias
- interpretability
- fairness
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Hadi, M. U., Al Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M. I., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. A. (2024). Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects. https://doi.org/10.36227/techrxiv.23589741.v6
How many times has this paper been cited?
88 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text.
Who wrote this paper?
Muhammad Usman Hadi, Qasem Al Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Imran Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan, Maged Shoman, Jia Wu and 2 more.
What is the DOI of this paper?
10.36227/techrxiv.23589741.v6. The permanent link is https://doi.org/10.36227/techrxiv.23589741.v6.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.