Journal article · 2025 · Open access

Large Language Models and Their Evolution

Zihan Zhou

Applied and Computational Engineering, 173(1), 83–87 · Published 30 July 2025 · DOI 10.54254/2755-2721/2025.25586

Free PDFView at the publisherCite this paper

In brief

“Large Language Models and Their Evolution” is a 2025 journal article by Zihan Zhou, published in Applied and Computational Engineering. OpenAlex counts 3 citations as of 15 November 2026, which puts it in the top 4% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at Applied and Computational Engineering.

Citations
3
Most cited in
2026 (3)
Field-weighted impact
0.73
References
7
Authors
1

Abstract

With the rapid advancement of artificial intelligence (AI), large language models (LLMs) have become the foundational infrastructure for natural language processing (NLP) research and industrial applications. By leveraging massive parameters and vast pre-training data, LLMs have significantly enhanced text understanding, generation, and cross-modal reasoning capabilities. This paper systematically reviews the technical evolution of LLMs from n-gram statistical models to the Transformer architecture, based on five key review papers. It analyzes training and alignment paradigms such as “pre-training & fine-tuning” and “RLHF/RLAIF”, as well as the exponential parameter expansion driven by the Scaling Law. Furthermore, we summarize the latest application progress of LLMs in code generation, intelligent customer service, medical and legal assistance, and other fields, and analyze the challenges they face in terms of data privacy, model bias, hallucination phenomena, and energy consumption. Finally, this paper proposes four research priorities for the future: first, leveraging explainable mechanisms to enhance model transparency; second, strengthening value alignment and security controls; third, exploring green and efficient model compression and inference schemes; and fourth, leveraging interdisciplinary collaboration to build the next generation of general-purpose intelligent systems that are both fair and sustainable.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhou, Z. (2025). Large Language Models and Their Evolution. Applied and Computational Engineering, 173(1), 83–87. https://doi.org/10.54254/2755-2721/2025.25586

MLA 9

Zhou, Zihan. “Large Language Models and Their Evolution.” Applied and Computational Engineering, vol. 173, no. 1, 2025, pp. 83–87. https://doi.org/10.54254/2755-2721/2025.25586.

Chicago

Zhou, Zihan. 2025. “Large Language Models and Their Evolution.” Applied and Computational Engineering 173 (1): 83–87. https://doi.org/10.54254/2755-2721/2025.25586.

Harvard

Zhou, Z. (2025) ‘Large Language Models and Their Evolution’, Applied and Computational Engineering, 173(1), pp. 83–87. doi:10.54254/2755-2721/2025.25586.

IEEE

Z. Zhou, “Large Language Models and Their Evolution,” Applied and Computational Engineering, vol. 173, no. 1, pp. 83–87, 2025, doi: 10.54254/2755-2721/2025.25586.

BibTeX

@article{zhou2025large,
  title     = {{Large Language Models and Their Evolution}},
  author    = {Zhou, Zihan},
  journal   = {Applied and Computational Engineering},
  year      = {2025},
  volume    = {173},
  number    = {1},
  pages     = {83--87},
  doi       = {10.54254/2755-2721/2025.25586},
  url       = {https://doi.org/10.54254/2755-2721/2025.25586}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • transformer models
  • pre-training and fine-tuning
  • reinforcement learning from human feedback
  • scaling laws
  • code generation
  • intelligent customer service
  • data privacy

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Zhou, Z. (2025). Large Language Models and Their Evolution. Applied and Computational Engineering, 173(1), 83–87. https://doi.org/10.54254/2755-2721/2025.25586

How many times has this paper been cited?

3 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Applied and Computational Engineering.

Who wrote this paper?

Zihan Zhou.

What is the DOI of this paper?

10.54254/2755-2721/2025.25586. The permanent link is https://doi.org/10.54254/2755-2721/2025.25586.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.