Preprint · 2023 · Open access
A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage
Published 10 July 2023 · DOI 10.36227/techrxiv.23589741.v1
In brief
“A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage” is a 2023 preprint by Muhammad Usman Hadi and 13 co-authors. OpenAlex counts 477 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 477
- Most cited in
- 2025 (215)
- References
- 163
- Authors
- 14
Abstract
Within the vast expanse of computerized language processing, a revolutionary entity known as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to comprehend intricate linguistic patterns and conjure coherent and contextually fitting responses. Large language models (LLMs) are a type of artificial intelligence (AI) that have emerged as powerful tools for a wide range of tasks, including natural language processing (NLP), machine translation, and question-answering. This survey paper provides a comprehensive overview of LLMs, including their history, architecture, training methods, applications, and challenges. The paper begins by discussing the fundamental concepts of generative AI and the architecture of generative pre- trained transformers (GPT). It then provides an overview of the history of LLMs, their evolution over time, and the different training methods that have been used to train them. The paper then discusses the wide range of applications of LLMs, including medical, education, finance, and engineering. It also discusses how LLMs are shaping the future of AI and how they can be used to solve real-world problems. The paper then discusses the challenges associated with deploying LLMs in real-world scenarios, including ethical considerations, model biases, interpretability, and computational resource requirements. It also highlights techniques for enhancing the robustness and controllability of LLMs, and addressing bias, fairness, and generation quality issues. Finally, the paper concludes by highlighting the future of LLM research and the challenges that need to be addressed in order to make LLMs more reliable and useful. This survey paper is intended to provide researchers, practitioners, and enthusiasts with a comprehensive understanding of LLMs, their evolution, applications, and challenges. By consolidating the state-of-the-art knowledge in the field, this survey serves as a valuable resource for further advancements in the development and utilization of LLMs for a wide range of real-world applications. The GitHub repo for this project is available at https://github.com/anas-zafar/LLM-Survey
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. (2023). A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage. https://doi.org/10.36227/techrxiv.23589741.v1
MLA 9
Hadi, Muhammad Usman, et al. “A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage.” 2023. https://doi.org/10.36227/techrxiv.23589741.v1.
Chicago
Hadi, Muhammad Usman, Qasem Al-Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Irfan, Anas Zafar, et al. 2023. “A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage.” https://doi.org/10.36227/techrxiv.23589741.v1.
Harvard
Hadi, M. U. et al. (2023) ‘A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage’. doi:10.36227/techrxiv.23589741.v1.
IEEE
M. U. Hadi et al., “A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage,” 2023, doi: 10.36227/techrxiv.23589741.v1.
BibTeX
@misc{hadi2023survey,
title = {{A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage}},
author = {Hadi, Muhammad Usman and Al-Tashi, Qasem and Qureshi, Rizwan and Shah, Abbas and Muneer, Amgad and Irfan, Muhammad and Zafar, Anas and Shaikh, Muhammad Bilal and Akhtar, Naveed and Hassan, Syed Zohaib and Shoman, Maged and Wu, Jia and Mirjalili, Seyedali and Shah, Mubarak},
year = {2023},
doi = {10.36227/techrxiv.23589741.v1},
url = {https://doi.org/10.36227/techrxiv.23589741.v1}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 9 | |
| 2024 | 176 | |
| 2025 | 215 | |
| 2026 | 77 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- large language models
- generative pre-trained transformer
- LLM applications
- model bias
- interpretability
- ethical considerations
- fairness
- generation quality
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. (2023). A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage. https://doi.org/10.36227/techrxiv.23589741.v1
How many times has this paper been cited?
477 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text.
Who wrote this paper?
Muhammad Usman Hadi, Qasem Al-Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan, Maged Shoman, Jia Wu and 2 more.
What is the DOI of this paper?
10.36227/techrxiv.23589741.v1. The permanent link is https://doi.org/10.36227/techrxiv.23589741.v1.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.