Journal article · 2023 · Open access
Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review
Applied Sciences, 13(9), 5521 · Published 28 April 2023 · DOI 10.3390/app13095521
In brief
“Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review” is a 2023 journal article by José Maurício and 2 co-authors, published in Applied Sciences. OpenAlex counts 772 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at Applied Sciences.
- Citations
- 772
- Most cited in
- 2025 (345)
- Field-weighted impact
- 48.09
- References
- 26
- Authors
- 3
Abstract
Transformers are models that implement a mechanism of self-attention, individually weighting the importance of each part of the input data. Their use in image classification tasks is still somewhat limited since researchers have so far chosen Convolutional Neural Networks for image classification and transformers were more targeted to Natural Language Processing (NLP) tasks. Therefore, this paper presents a literature review that shows the differences between Vision Transformers (ViT) and Convolutional Neural Networks. The state of the art that used the two architectures for image classification was reviewed and an attempt was made to understand what factors may influence the performance of the two deep learning architectures based on the datasets used, image size, number of target classes (for the classification problems), hardware, and evaluated architectures and top results. The objective of this work is to identify which of the architectures is the best for image classification and under what conditions. This paper also describes the importance of the Multi-Head Attention mechanism for improving the performance of ViT in image classification.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Maurício, J., Domingues, I., & Bernardino, J. (2023). Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review. Applied Sciences, 13(9), 5521. https://doi.org/10.3390/app13095521
MLA 9
Maurício, José, et al. “Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review.” Applied Sciences, vol. 13, no. 9, 2023, p. 5521. https://doi.org/10.3390/app13095521.
Chicago
Maurício, José, Inês Domingues, and Jorge Bernardino. 2023. “Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review.” Applied Sciences 13 (9): 5521. https://doi.org/10.3390/app13095521.
Harvard
Maurício, J., Domingues, I. and Bernardino, J. (2023) ‘Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review’, Applied Sciences, 13(9), p. 5521. doi:10.3390/app13095521.
IEEE
J. Maurício, I. Domingues, and J. Bernardino, “Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review,” Applied Sciences, vol. 13, no. 9, p. 5521, 2023, doi: 10.3390/app13095521.
BibTeX
@article{mauricio2023comparing,
title = {{Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review}},
author = {Maurício, José and Domingues, Inês and Bernardino, Jorge},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {9},
pages = {5521},
doi = {10.3390/app13095521},
url = {https://doi.org/10.3390/app13095521}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 21 | |
| 2024 | 190 | |
| 2025 | 345 | |
| 2026 | 215 |
Its field-weighted citation impact is 48.09: it has been cited 48.09 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- vision transformer
- convolutional neural networks
- image classification
- self-attention
- multi-head attention
- model comparison
- dataset size
- number of classes
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Maurício, J., Domingues, I., & Bernardino, J. (2023). Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review. Applied Sciences, 13(9), 5521. https://doi.org/10.3390/app13095521
How many times has this paper been cited?
772 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Applied Sciences: sign in and open the PDF from this page.
Who wrote this paper?
José Maurício, Inês Domingues, Jorge Bernardino.
What is the DOI of this paper?
10.3390/app13095521, permanently at https://doi.org/10.3390/app13095521. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.