Preprint · 2025 · Open access
Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications
Preprints.org · Published 24 December 2025 · DOI 10.20944/preprints202512.2119.v1
In brief
“Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications” is a 2025 preprint by Yiming Lei and 7 co-authors, published in Preprints.org. OpenAlex counts 6 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at Preprints.org.
- Citations
- 6
- Most cited in
- 2026 (6)
- References
- 38
- Authors
- 8
Abstract
Large Language Model (LLM) agents represent a paradigm shift in artificial intelligence, combining the remarkable reasoning capabilities of foundation models with the ability to perceive environments, make decisions, and take actions autonomously. This comprehensive survey provides an in-depth examination of LLM-based agents across multiple dimensions. We first establish a formal definition of LLM agents and trace their evolution from early language models to today's sophisticated autonomous systems. We then present a novel taxonomy that organizes the field into four fundamental categories: reasoning-enhanced agents that leverage chain-of-thought and tree-structured deliberation; tool-augmented agents that extend LLM capabilities through external APIs and knowledge bases; multi-agent systems that enable collaborative problem-solving through inter-agent communication; and memory-augmented agents that maintain persistent context across interactions. For each category, we analyze representative architectures, discuss key innovations, and evaluate their relative strengths and limitations. We further examine diverse applications spanning software engineering, scientific research, embodied robotics, and web automation, supported by systematic comparisons on established benchmarks including SWE-bench, WebArena, and AgentBench. Our analysis reveals that while current agents achieve impressive performance on structured tasks, significant challenges remain in areas such as long-horizon planning, hallucination mitigation, and safe deployment. We conclude by identifying promising research directions, including neuro-symbolic integration, multi-modal perception, and human-agent collaboration frameworks, providing a roadmap for advancing this rapidly evolving field.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Lei, Y., Xu, J., Liang, C. X., Bi, Z., Li, X., Zhang, D., Song, J., & Yu, Z. (2025). Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications. Preprints.org. https://doi.org/10.20944/preprints202512.2119.v1
MLA 9
Lei, Yiming, et al. “Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications.” Preprints.org, 2025. https://doi.org/10.20944/preprints202512.2119.v1.
Chicago
Lei, Yiming, Jiawei Xu, Chia Xin Liang, Ziqian Bi, Xiaoming Li, Danyang Zhang, Junhao Song, and Zhenyu Yu. 2025. “Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications.” Preprints.org. https://doi.org/10.20944/preprints202512.2119.v1.
Harvard
Lei, Y. et al. (2025) ‘Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications’, Preprints.org. doi:10.20944/preprints202512.2119.v1.
IEEE
Y. Lei et al., “Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications,” Preprints.org, 2025, doi: 10.20944/preprints202512.2119.v1.
BibTeX
@misc{lei2025large,
title = {{Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications}},
author = {Lei, Yiming and Xu, Jiawei and Liang, Chia Xin and Bi, Ziqian and Li, Xiaoming and Zhang, Danyang and Song, Junhao and Yu, Zhenyu},
howpublished = {Preprints.org},
year = {2025},
doi = {10.20944/preprints202512.2119.v1},
url = {https://doi.org/10.20944/preprints202512.2119.v1}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- LLM agents
- autonomous agents
- chain-of-thought reasoning
- tool-augmented agents
- multi-agent systems
- memory-augmented agents
- software engineering agents
- embodied robotics
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Lei, Y., Xu, J., Liang, C. X., Bi, Z., Li, X., Zhang, D., Song, J., & Yu, Z. (2025). Large Language Model Agents: A Comprehensive Survey on Architectures, Capabilities, and Applications. Preprints.org. https://doi.org/10.20944/preprints202512.2119.v1
How many times has this paper been cited?
6 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Preprints.org.
Who wrote this paper?
Yiming Lei, Jiawei Xu, Chia Xin Liang, Ziqian Bi, Xiaoming Li, Danyang Zhang, Junhao Song, Zhenyu Yu.
What is the DOI of this paper?
10.20944/preprints202512.2119.v1. The permanent link is https://doi.org/10.20944/preprints202512.2119.v1.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.