Preprint · 2024 · Open access

Transformer: A Survey and Application

Xinyuan Song, Qian Niu, Junyu Liu, Benji Peng, Sen Zhang, Ming Liu, Ming Li, Tianyang Wang, Xuanhe Pan, Jiawei Xu, Chuanqi Jiang, Jinlang Wang and 6 more

OSF Preprints (OSF Preprints) · Published 9 December 2024 · DOI 10.31219/osf.io/5p2hu

Free PDFView at the publisherCite this paper

In brief

“Transformer: A Survey and Application” is a 2024 preprint by Xinyuan Song and 17 co-authors, published in OSF Preprints (OSF Preprints). OpenAlex counts 25 citations as of 16 November 2026. It is open access under a public domain licence: the full text is free to read at OSF Preprints (OSF Preprints).

Citations
25
Most cited in
2022 (9)
References
46
Authors
18

Abstract

Deep learning is a subset of machine learning that models data using artificial neural networks with multiple layers. Each layer in the neural network processes the input data, extracts relevant features, and passes it to the next layer. Deep learning techniques have led to significant advancements in areas such as image recognition, natural language processing, and speech recognition.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Song, X., Niu, Q., Liu, J., Peng, B., Zhang, S., Liu, M., Li, M., Wang, T., Pan, X., Xu, J., Jiang, C., Wang, J., Feng, P., Zhang, Y., Chen, K., Bi, Z., Zhang, J., & Yuan, Z. (2024). Transformer: A Survey and Application. OSF Preprints (OSF Preprints). https://doi.org/10.31219/osf.io/5p2hu

MLA 9

Song, Xinyuan, et al. “Transformer: A Survey and Application.” OSF Preprints (OSF Preprints), 2024. https://doi.org/10.31219/osf.io/5p2hu.

Chicago

Song, Xinyuan, Qian Niu, Junyu Liu, Benji Peng, Sen Zhang, Ming Liu, Ming Li, et al. 2024. “Transformer: A Survey and Application.” OSF Preprints (OSF Preprints). https://doi.org/10.31219/osf.io/5p2hu.

Harvard

Song, X. et al. (2024) ‘Transformer: A Survey and Application’, OSF Preprints (OSF Preprints). doi:10.31219/osf.io/5p2hu.

IEEE

X. Song et al., “Transformer: A Survey and Application,” OSF Preprints (OSF Preprints), 2024, doi: 10.31219/osf.io/5p2hu.

BibTeX

@misc{song2024transformer,
  title     = {{Transformer: A Survey and Application}},
  author    = {Song, Xinyuan and Niu, Qian and Liu, Junyu and Peng, Benji and Zhang, Sen and Liu, Ming and Li, Ming and Wang, Tianyang and Pan, Xuanhe and Xu, Jiawei and Jiang, Chuanqi and Wang, Jinlang and Feng, Pohsun and Zhang, Yichao and Chen, Keyu and Bi, Ziqian and Zhang, Juan and Yuan, Zichen},
  howpublished = {OSF Preprints (OSF Preprints)},
  year      = {2024},
  doi       = {10.31219/osf.io/5p2hu},
  url       = {https://doi.org/10.31219/osf.io/5p2hu}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202011
202122
202299
202366
202422
202544
202611

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • transformer models
  • deep learning
  • artificial neural networks
  • feature extraction
  • natural language processing
  • image recognition
  • speech recognition

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Song, X., Niu, Q., Liu, J., Peng, B., Zhang, S., Liu, M., Li, M., Wang, T., Pan, X., Xu, J., Jiang, C., Wang, J., Feng, P., Zhang, Y., Chen, K., Bi, Z., Zhang, J., & Yuan, Z. (2024). Transformer: A Survey and Application. OSF Preprints (OSF Preprints). https://doi.org/10.31219/osf.io/5p2hu

How many times has this paper been cited?

25 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at OSF Preprints (OSF Preprints).

Who wrote this paper?

Xinyuan Song, Qian Niu, Junyu Liu, Benji Peng, Sen Zhang, Ming Liu, Ming Li, Tianyang Wang, Xuanhe Pan, Jiawei Xu, Chuanqi Jiang, Jinlang Wang and 6 more.

What is the DOI of this paper?

10.31219/osf.io/5p2hu. The permanent link is https://doi.org/10.31219/osf.io/5p2hu.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.