Preprint · 2023 · Open access

A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage

Muhammad Usman Hadi, Qasem Al-Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan, Maged Shoman, Jia Wu and 2 more

Published 10 July 2023 · DOI 10.36227/techrxiv.23589741.v1

Free PDFView at the publisherCite this paper

In brief

“A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage” is a 2023 preprint by Muhammad Usman Hadi and 13 co-authors. OpenAlex counts 477 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
477
Most cited in
2025 (215)
References
163
Authors
14

Abstract

Within the vast expanse of computerized language processing, a revolutionary entity known as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to comprehend intricate linguistic patterns and conjure coherent and contextually fitting responses. Large language models (LLMs) are a type of artificial intelligence (AI) that have emerged as powerful tools for a wide range of tasks, including natural language processing (NLP), machine translation, and question-answering. This survey paper provides a comprehensive overview of LLMs, including their history, architecture, training methods, applications, and challenges. The paper begins by discussing the fundamental concepts of generative AI and the architecture of generative pre- trained transformers (GPT). It then provides an overview of the history of LLMs, their evolution over time, and the different training methods that have been used to train them. The paper then discusses the wide range of applications of LLMs, including medical, education, finance, and engineering. It also discusses how LLMs are shaping the future of AI and how they can be used to solve real-world problems. The paper then discusses the challenges associated with deploying LLMs in real-world scenarios, including ethical considerations, model biases, interpretability, and computational resource requirements. It also highlights techniques for enhancing the robustness and controllability of LLMs, and addressing bias, fairness, and generation quality issues. Finally, the paper concludes by highlighting the future of LLM research and the challenges that need to be addressed in order to make LLMs more reliable and useful. This survey paper is intended to provide researchers, practitioners, and enthusiasts with a comprehensive understanding of LLMs, their evolution, applications, and challenges. By consolidating the state-of-the-art knowledge in the field, this survey serves as a valuable resource for further advancements in the development and utilization of LLMs for a wide range of real-world applications. The GitHub repo for this project is available at https://github.com/anas-zafar/LLM-Survey

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. (2023). A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage. https://doi.org/10.36227/techrxiv.23589741.v1

MLA 9

Hadi, Muhammad Usman, et al. “A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage.” 2023. https://doi.org/10.36227/techrxiv.23589741.v1.

Chicago

Hadi, Muhammad Usman, Qasem Al-Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Irfan, Anas Zafar, et al. 2023. “A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage.” https://doi.org/10.36227/techrxiv.23589741.v1.

Harvard

Hadi, M. U. et al. (2023) ‘A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage’. doi:10.36227/techrxiv.23589741.v1.

IEEE

M. U. Hadi et al., “A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage,” 2023, doi: 10.36227/techrxiv.23589741.v1.

BibTeX

@misc{hadi2023survey,
  title     = {{A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage}},
  author    = {Hadi, Muhammad Usman and Al-Tashi, Qasem and Qureshi, Rizwan and Shah, Abbas and Muneer, Amgad and Irfan, Muhammad and Zafar, Anas and Shaikh, Muhammad Bilal and Akhtar, Naveed and Hassan, Syed Zohaib and Shoman, Maged and Wu, Jia and Mirjalili, Seyedali and Shah, Mubarak},
  year      = {2023},
  doi       = {10.36227/techrxiv.23589741.v1},
  url       = {https://doi.org/10.36227/techrxiv.23589741.v1}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202399
2024176176
2025215215
20267777

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • generative pre-trained transformer
  • LLM applications
  • model bias
  • interpretability
  • ethical considerations
  • fairness
  • generation quality

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. (2023). A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage. https://doi.org/10.36227/techrxiv.23589741.v1

How many times has this paper been cited?

477 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text.

Who wrote this paper?

Muhammad Usman Hadi, Qasem Al-Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan, Maged Shoman, Jia Wu and 2 more.

What is the DOI of this paper?

10.36227/techrxiv.23589741.v1. The permanent link is https://doi.org/10.36227/techrxiv.23589741.v1.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.