Journal article · 2026 · Open access

Large language models in NLP: evolution, architectural trends, and open challenges

Haseeb Javed, Babar Shah, Farman Ali, Daehan Kwak

Journal Of Big Data, 13(1) · Published 21 April 2026 · DOI 10.1186/s40537-026-01429-1

Read the free full textCite this paper

In brief

“Large language models in NLP: evolution, architectural trends, and open challenges” is a 2026 journal article by Haseeb Javed and 3 co-authors, published in Journal Of Big Data. OpenAlex counts 1 citations as of 15 November 2026, which puts it in the top 9% of works published in 2026 by citations. It is open access under a CC BY-NC-ND licence: the full text is free to read at Journal Of Big Data.

Citations
1
Most cited in
2026 (1)
Field-weighted impact
1.40
References
133
Authors
4

Abstract

The rise of Large Language Models (LLMs) has transformed how Natural Language Processing (NLP) and its subdomains are approached. Recent technological advancements have driven this transformation. This study offers researchers a detailed overview of LLMs, comparing them with traditional rule-based systems, statistical techniques, machine learning, neural networks, and the rise of transformer-based architectures. From a wider perspective, language models such as GPT, BERT, T5, PaLM, and LLaMA have facilitated the transformation of entire sectors, including healthcare and business, due to their highly scalable nature. Despite their wide range of applications, LLMs face numerous challenges, such as output biases, limited interpretability, high computational requirements, low granularity, and, most importantly, limited accessibility. This paper highlights modern adaptive learning processes, domain-specific applications, and multimodal learning, along with critical issues such as fairness, ethical deployment, and sustainability. There is a growing need for more effective regulation, the development of multilingual capabilities, and, above all, the creation of general-purpose AI systems to enhance inclusion. This research emphasizes ethical accountability by examining the social implications of advanced AI systems. It further promotes interdisciplinary collaboration to develop AI systems that are ethical, effective, and socially responsible within a clearly defined decision-making framework for research and application.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Javed, H., Shah, B., Ali, F., & Kwak, D. (2026). Large language models in NLP: evolution, architectural trends, and open challenges. Journal Of Big Data, 13(1). https://doi.org/10.1186/s40537-026-01429-1

MLA 9

Javed, Haseeb, et al. “Large language models in NLP: evolution, architectural trends, and open challenges.” Journal Of Big Data, vol. 13, no. 1, 2026. https://doi.org/10.1186/s40537-026-01429-1.

Chicago

Javed, Haseeb, Babar Shah, Farman Ali, and Daehan Kwak. 2026. “Large language models in NLP: evolution, architectural trends, and open challenges.” Journal Of Big Data 13 (1). https://doi.org/10.1186/s40537-026-01429-1.

Harvard

Javed, H. et al. (2026) ‘Large language models in NLP: evolution, architectural trends, and open challenges’, Journal Of Big Data, 13(1). doi:10.1186/s40537-026-01429-1.

IEEE

H. Javed, B. Shah, F. Ali, and D. Kwak, “Large language models in NLP: evolution, architectural trends, and open challenges,” Journal Of Big Data, vol. 13, no. 1, 2026, doi: 10.1186/s40537-026-01429-1.

BibTeX

@article{javed2026large,
  title     = {{Large language models in NLP: evolution, architectural trends, and open challenges}},
  author    = {Javed, Haseeb and Shah, Babar and Ali, Farman and Kwak, Daehan},
  journal   = {Journal Of Big Data},
  year      = {2026},
  volume    = {13},
  number    = {1},
  doi       = {10.1186/s40537-026-01429-1},
  url       = {https://doi.org/10.1186/s40537-026-01429-1}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • transformer models
  • GPT
  • BERT
  • T5
  • Arecaceae
  • llamas
  • rule-based systems

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Javed, H., Shah, B., Ali, F., & Kwak, D. (2026). Large language models in NLP: evolution, architectural trends, and open challenges. Journal Of Big Data, 13(1). https://doi.org/10.1186/s40537-026-01429-1

How many times has this paper been cited?

1 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Journal Of Big Data.

Who wrote this paper?

Haseeb Javed, Babar Shah, Farman Ali, Daehan Kwak.

What is the DOI of this paper?

10.1186/s40537-026-01429-1. The permanent link is https://doi.org/10.1186/s40537-026-01429-1.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.