Journal article · 2025 · Open access
Large Language Models and Their Evolution
Applied and Computational Engineering, 173(1), 83–87 · Published 30 July 2025 · DOI 10.54254/2755-2721/2025.25586
In brief
“Large Language Models and Their Evolution” is a 2025 journal article by Zihan Zhou, published in Applied and Computational Engineering. OpenAlex counts 3 citations as of 15 November 2026, which puts it in the top 4% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at Applied and Computational Engineering.
- Citations
- 3
- Most cited in
- 2026 (3)
- Field-weighted impact
- 0.73
- References
- 7
- Authors
- 1
Abstract
With the rapid advancement of artificial intelligence (AI), large language models (LLMs) have become the foundational infrastructure for natural language processing (NLP) research and industrial applications. By leveraging massive parameters and vast pre-training data, LLMs have significantly enhanced text understanding, generation, and cross-modal reasoning capabilities. This paper systematically reviews the technical evolution of LLMs from n-gram statistical models to the Transformer architecture, based on five key review papers. It analyzes training and alignment paradigms such as “pre-training & fine-tuning” and “RLHF/RLAIF”, as well as the exponential parameter expansion driven by the Scaling Law. Furthermore, we summarize the latest application progress of LLMs in code generation, intelligent customer service, medical and legal assistance, and other fields, and analyze the challenges they face in terms of data privacy, model bias, hallucination phenomena, and energy consumption. Finally, this paper proposes four research priorities for the future: first, leveraging explainable mechanisms to enhance model transparency; second, strengthening value alignment and security controls; third, exploring green and efficient model compression and inference schemes; and fourth, leveraging interdisciplinary collaboration to build the next generation of general-purpose intelligent systems that are both fair and sustainable.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zhou, Z. (2025). Large Language Models and Their Evolution. Applied and Computational Engineering, 173(1), 83–87. https://doi.org/10.54254/2755-2721/2025.25586
MLA 9
Zhou, Zihan. “Large Language Models and Their Evolution.” Applied and Computational Engineering, vol. 173, no. 1, 2025, pp. 83–87. https://doi.org/10.54254/2755-2721/2025.25586.
Chicago
Zhou, Zihan. 2025. “Large Language Models and Their Evolution.” Applied and Computational Engineering 173 (1): 83–87. https://doi.org/10.54254/2755-2721/2025.25586.
Harvard
Zhou, Z. (2025) ‘Large Language Models and Their Evolution’, Applied and Computational Engineering, 173(1), pp. 83–87. doi:10.54254/2755-2721/2025.25586.
IEEE
Z. Zhou, “Large Language Models and Their Evolution,” Applied and Computational Engineering, vol. 173, no. 1, pp. 83–87, 2025, doi: 10.54254/2755-2721/2025.25586.
BibTeX
@article{zhou2025large,
title = {{Large Language Models and Their Evolution}},
author = {Zhou, Zihan},
journal = {Applied and Computational Engineering},
year = {2025},
volume = {173},
number = {1},
pages = {83--87},
doi = {10.54254/2755-2721/2025.25586},
url = {https://doi.org/10.54254/2755-2721/2025.25586}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- large language models
- transformer models
- pre-training and fine-tuning
- reinforcement learning from human feedback
- scaling laws
- code generation
- intelligent customer service
- data privacy
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Zhou, Z. (2025). Large Language Models and Their Evolution. Applied and Computational Engineering, 173(1), 83–87. https://doi.org/10.54254/2755-2721/2025.25586
How many times has this paper been cited?
3 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Applied and Computational Engineering.
Who wrote this paper?
Zihan Zhou.
What is the DOI of this paper?
10.54254/2755-2721/2025.25586. The permanent link is https://doi.org/10.54254/2755-2721/2025.25586.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.