Preprint · 2025 · Open access

A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents

Jiawei Xu, Chia Xin Liang, Ziqian Bi, Xiaoming Li, Danyang Zhang, Zhenyu Yu

SSRN Electronic Journal · Published 1 January 2025 · DOI 10.2139/ssrn.5978094

Read the free full textCite this paper

In brief

“A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents” is a 2025 preprint by Jiawei Xu and 5 co-authors, published in SSRN Electronic Journal. OpenAlex counts 0 citations as of 15 November 2026. It is open access: the full text is free to read at SSRN Electronic Journal.

Citations
0
Authors
6

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Xu, J., Liang, C. X., Bi, Z., Li, X., Zhang, D., & Yu, Z. (2025). A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.5978094

MLA 9

Xu, Jiawei, et al. “A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents.” SSRN Electronic Journal, 2025. https://doi.org/10.2139/ssrn.5978094.

Chicago

Xu, Jiawei, Chia Xin Liang, Ziqian Bi, Xiaoming Li, Danyang Zhang, and Zhenyu Yu. 2025. “A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents.” SSRN Electronic Journal. https://doi.org/10.2139/ssrn.5978094.

Harvard

Xu, J. et al. (2025) ‘A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents’, SSRN Electronic Journal. doi:10.2139/ssrn.5978094.

IEEE

J. Xu, C. X. Liang, Z. Bi, X. Li, D. Zhang, and Z. Yu, “A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents,” SSRN Electronic Journal, 2025, doi: 10.2139/ssrn.5978094.

BibTeX

@misc{xu2025comprehensive,
  title     = {{A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents}},
  author    = {Xu, Jiawei and Liang, Chia Xin and Bi, Ziqian and Li, Xiaoming and Zhang, Danyang and Yu, Zhenyu},
  howpublished = {SSRN Electronic Journal},
  year      = {2025},
  doi       = {10.2139/ssrn.5978094},
  url       = {https://doi.org/10.2139/ssrn.5978094}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • large language models
  • transformer models
  • state-space model
  • Mamba
  • RWKV
  • mixture of experts
  • pre-training
  • scaling laws

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Xu, J., Liang, C. X., Bi, Z., Li, X., Zhang, D., & Yu, Z. (2025). A Comprehensive Survey on Large Language Models: From Pre-training to Autonomous Agents. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.5978094

How many times has this paper been cited?

0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at SSRN Electronic Journal.

Who wrote this paper?

Jiawei Xu, Chia Xin Liang, Ziqian Bi, Xiaoming Li, Danyang Zhang, Zhenyu Yu.

What is the DOI of this paper?

10.2139/ssrn.5978094. The permanent link is https://doi.org/10.2139/ssrn.5978094.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.