Journal article · 2023 · Open access

Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review

José Maurício, Inês Domingues, Jorge Bernardino

Applied Sciences, 13(9), 5521 · Published 28 April 2023 · DOI 10.3390/app13095521

Open PDFView at the publisherCite this paper

In brief

“Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review” is a 2023 journal article by José Maurício and 2 co-authors, published in Applied Sciences. OpenAlex counts 772 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at Applied Sciences.

Citations
772
Most cited in
2025 (345)
Field-weighted impact
48.09
References
26
Authors
3

Abstract

Transformers are models that implement a mechanism of self-attention, individually weighting the importance of each part of the input data. Their use in image classification tasks is still somewhat limited since researchers have so far chosen Convolutional Neural Networks for image classification and transformers were more targeted to Natural Language Processing (NLP) tasks. Therefore, this paper presents a literature review that shows the differences between Vision Transformers (ViT) and Convolutional Neural Networks. The state of the art that used the two architectures for image classification was reviewed and an attempt was made to understand what factors may influence the performance of the two deep learning architectures based on the datasets used, image size, number of target classes (for the classification problems), hardware, and evaluated architectures and top results. The objective of this work is to identify which of the architectures is the best for image classification and under what conditions. This paper also describes the importance of the Multi-Head Attention mechanism for improving the performance of ViT in image classification.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Maurício, J., Domingues, I., & Bernardino, J. (2023). Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review. Applied Sciences, 13(9), 5521. https://doi.org/10.3390/app13095521

MLA 9

Maurício, José, et al. “Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review.” Applied Sciences, vol. 13, no. 9, 2023, p. 5521. https://doi.org/10.3390/app13095521.

Chicago

Maurício, José, Inês Domingues, and Jorge Bernardino. 2023. “Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review.” Applied Sciences 13 (9): 5521. https://doi.org/10.3390/app13095521.

Harvard

Maurício, J., Domingues, I. and Bernardino, J. (2023) ‘Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review’, Applied Sciences, 13(9), p. 5521. doi:10.3390/app13095521.

IEEE

J. Maurício, I. Domingues, and J. Bernardino, “Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review,” Applied Sciences, vol. 13, no. 9, p. 5521, 2023, doi: 10.3390/app13095521.

BibTeX

@article{mauricio2023comparing,
  title     = {{Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review}},
  author    = {Maurício, José and Domingues, Inês and Bernardino, Jorge},
  journal   = {Applied Sciences},
  year      = {2023},
  volume    = {13},
  number    = {9},
  pages     = {5521},
  doi       = {10.3390/app13095521},
  url       = {https://doi.org/10.3390/app13095521}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
20232121
2024190190
2025345345
2026215215

Its field-weighted citation impact is 48.09: it has been cited 48.09 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications

  • vision transformer
  • convolutional neural networks
  • image classification
  • self-attention
  • multi-head attention
  • model comparison
  • dataset size
  • number of classes

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Maurício, J., Domingues, I., & Bernardino, J. (2023). Comparing Vision Transformers and Convolutional Neural Networks for Image Classification: A Literature Review. Applied Sciences, 13(9), 5521. https://doi.org/10.3390/app13095521

How many times has this paper been cited?

772 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Applied Sciences: sign in and open the PDF from this page.

Who wrote this paper?

José Maurício, Inês Domingues, Jorge Bernardino.

What is the DOI of this paper?

10.3390/app13095521, permanently at https://doi.org/10.3390/app13095521. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.