Preprint · 2024 · Open access

Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects

Muhammad Usman Hadi, Qasem Al Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Imran Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan, Maged Shoman, Jia Wu and 2 more

Published 12 August 2024 · DOI 10.36227/techrxiv.23589741.v6

Read the free full textCite this paper

In brief

“Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects” is a 2024 preprint by Muhammad Usman Hadi and 13 co-authors. OpenAlex counts 88 citations as of 16 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
88
Most cited in
2025 (52)
Authors
14

Abstract

Within the vast expanse of computerized language processing, a revolutionary entity known as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to comprehend intricate linguistic patterns and conjure coherent and contextually fitting responses. LLMs are a type of artificial intelligence (AI) that have emerged as powerful tools for a wide range of tasks, including natural language processing (NLP), machine translation, vision applications, and question-answering. This survey provides a comprehensive overview of LLMs, including their history, architecture, training methods, applications, and challenges. We begin by discussing the fundamental concepts of generative AI and the architecture of generative pre-trained transformers (GPT). We then provide an overview of the history of LLMs, their evolution over time, and the different training methods that have been used to train them. We then discuss the wide range of tasks where they are used and also discuss applications of LLMs in different domains, including medicine, education, finance, engineering, media, entertainment, politics, and law. We also discuss how LLMs are shaping the future of AI and their increasing role in scientific discovery, and how they can be used to solve real-world problems. Next, we explore the challenges associated with deploying LLMs in real-world scenarios, including ethical considerations, model biases, interpretability, and computational resource requirements. This survey also highlights techniques for enhancing the robustness and controllability of LLMs and addressing bias, fairness, and quality issues in Generative AI. Finally, we conclude by highlighting the future of LLM research and the challenges that need to be addressed in order to make this technology more reliable and useful. This survey is intended to provide researchers, practitioners, and enthusiasts with a comprehensive understanding of LLMs, their evolution, applications, and challenges. By consolidating the state-of-the-art knowledge in the field, this article is anticipated to serve as a valuable resource for learning the current state-of-the-art as well as further advancements in the development and utilization of LLMs for a wide range of real-world applications. The GitHub repo for this project is available at https://github.com/anas-zafar/LLM-Survey

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hadi, M. U., Al Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M. I., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. A. (2024). Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects. https://doi.org/10.36227/techrxiv.23589741.v6

MLA 9

Hadi, Muhammad Usman, et al. “Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects.” 2024. https://doi.org/10.36227/techrxiv.23589741.v6.

Chicago

Hadi, Muhammad Usman, Qasem Al Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Imran Irfan, Anas Zafar, et al. 2024. “Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects.” https://doi.org/10.36227/techrxiv.23589741.v6.

Harvard

Hadi, M. U. et al. (2024) ‘Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects’. doi:10.36227/techrxiv.23589741.v6.

IEEE

M. U. Hadi et al., “Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects,” 2024, doi: 10.36227/techrxiv.23589741.v6.

BibTeX

@misc{hadi2024large,
  title     = {{Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects}},
  author    = {Hadi, Muhammad Usman and Al Tashi, Qasem and Qureshi, Rizwan and Shah, Abbas and Muneer, Amgad and Irfan, Muhammad Imran and Zafar, Anas and Shaikh, Muhammad Bilal and Akhtar, Naveed and Hassan, Syed Zohaib and Shoman, Maged and Wu, Jia and Mirjalili, Seyedali and Shah, Mubarak A.},
  year      = {2024},
  doi       = {10.36227/techrxiv.23589741.v6},
  url       = {https://doi.org/10.36227/techrxiv.23589741.v6}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20241212
20255252
20262424

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • generative pre-trained transformer
  • GPT
  • LLM applications
  • ethical considerations
  • model bias
  • interpretability
  • fairness

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Hadi, M. U., Al Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M. I., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., Shoman, M., Wu, J., Mirjalili, S., & Shah, M. A. (2024). Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects. https://doi.org/10.36227/techrxiv.23589741.v6

How many times has this paper been cited?

88 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text.

Who wrote this paper?

Muhammad Usman Hadi, Qasem Al Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Imran Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan, Maged Shoman, Jia Wu and 2 more.

What is the DOI of this paper?

10.36227/techrxiv.23589741.v6. The permanent link is https://doi.org/10.36227/techrxiv.23589741.v6.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.