Preprint · 2024 · Open access
Transformer: A Survey and Application
OSF Preprints (OSF Preprints) · Published 9 December 2024 · DOI 10.31219/osf.io/5p2hu
In brief
“Transformer: A Survey and Application” is a 2024 preprint by Xinyuan Song and 17 co-authors, published in OSF Preprints (OSF Preprints). OpenAlex counts 25 citations as of 16 November 2026. It is open access under a public domain licence: the full text is free to read at OSF Preprints (OSF Preprints).
- Citations
- 25
- Most cited in
- 2022 (9)
- References
- 46
- Authors
- 18
Abstract
Deep learning is a subset of machine learning that models data using artificial neural networks with multiple layers. Each layer in the neural network processes the input data, extracts relevant features, and passes it to the next layer. Deep learning techniques have led to significant advancements in areas such as image recognition, natural language processing, and speech recognition.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Song, X., Niu, Q., Liu, J., Peng, B., Zhang, S., Liu, M., Li, M., Wang, T., Pan, X., Xu, J., Jiang, C., Wang, J., Feng, P., Zhang, Y., Chen, K., Bi, Z., Zhang, J., & Yuan, Z. (2024). Transformer: A Survey and Application. OSF Preprints (OSF Preprints). https://doi.org/10.31219/osf.io/5p2hu
MLA 9
Song, Xinyuan, et al. “Transformer: A Survey and Application.” OSF Preprints (OSF Preprints), 2024. https://doi.org/10.31219/osf.io/5p2hu.
Chicago
Song, Xinyuan, Qian Niu, Junyu Liu, Benji Peng, Sen Zhang, Ming Liu, Ming Li, et al. 2024. “Transformer: A Survey and Application.” OSF Preprints (OSF Preprints). https://doi.org/10.31219/osf.io/5p2hu.
Harvard
Song, X. et al. (2024) ‘Transformer: A Survey and Application’, OSF Preprints (OSF Preprints). doi:10.31219/osf.io/5p2hu.
IEEE
X. Song et al., “Transformer: A Survey and Application,” OSF Preprints (OSF Preprints), 2024, doi: 10.31219/osf.io/5p2hu.
BibTeX
@misc{song2024transformer,
title = {{Transformer: A Survey and Application}},
author = {Song, Xinyuan and Niu, Qian and Liu, Junyu and Peng, Benji and Zhang, Sen and Liu, Ming and Li, Ming and Wang, Tianyang and Pan, Xuanhe and Xu, Jiawei and Jiang, Chuanqi and Wang, Jinlang and Feng, Pohsun and Zhang, Yichao and Chen, Keyu and Bi, Ziqian and Zhang, Juan and Yuan, Zichen},
howpublished = {OSF Preprints (OSF Preprints)},
year = {2024},
doi = {10.31219/osf.io/5p2hu},
url = {https://doi.org/10.31219/osf.io/5p2hu}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 1 | |
| 2021 | 2 | |
| 2022 | 9 | |
| 2023 | 6 | |
| 2024 | 2 | |
| 2025 | 4 | |
| 2026 | 1 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- transformer models
- deep learning
- artificial neural networks
- feature extraction
- natural language processing
- image recognition
- speech recognition
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Song, X., Niu, Q., Liu, J., Peng, B., Zhang, S., Liu, M., Li, M., Wang, T., Pan, X., Xu, J., Jiang, C., Wang, J., Feng, P., Zhang, Y., Chen, K., Bi, Z., Zhang, J., & Yuan, Z. (2024). Transformer: A Survey and Application. OSF Preprints (OSF Preprints). https://doi.org/10.31219/osf.io/5p2hu
How many times has this paper been cited?
25 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at OSF Preprints (OSF Preprints).
Who wrote this paper?
Xinyuan Song, Qian Niu, Junyu Liu, Benji Peng, Sen Zhang, Ming Liu, Ming Li, Tianyang Wang, Xuanhe Pan, Jiawei Xu, Chuanqi Jiang, Jinlang Wang and 6 more.
What is the DOI of this paper?
10.31219/osf.io/5p2hu. The permanent link is https://doi.org/10.31219/osf.io/5p2hu.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.