Journal article · 1998 · Open access

Gradient-based learning applied to document recognition

Yann LeCun, Léon Bottou, Yoshua Bengio, Patrick Haffner

Proceedings of the IEEE, 86(11), 2278–2324 · Published 1 January 1998 · DOI 10.1109/5.726791

Free PDFView at the publisherCite this paper

In brief

“Gradient-based learning applied to document recognition” is a 1998 journal article by Yann LeCun and 3 co-authors, published in Proceedings of the IEEE. OpenAlex counts 61,822 citations as of 15 November 2026, which puts it in the top 1% of works published in 1998 by citations. It is open access: the full text is free to read at HAL.

Citations
61,822
Most cited in
2021 (6,800)
Field-weighted impact
9.78
References
126
Authors
4

Abstract

Multilayer neural networks trained with the back-propagation algorithm constitute the best example of a successful gradient based learning technique. Given an appropriate network architecture, gradient-based learning algorithms can be used to synthesize a complex decision surface that can classify high-dimensional patterns, such as handwritten characters, with minimal preprocessing. This paper reviews various methods applied to handwritten character recognition and compares them on a standard handwritten digit recognition task. Convolutional neural networks, which are specifically designed to deal with the variability of 2D shapes, are shown to outperform all other techniques. Real-life document recognition systems are composed of multiple modules including field extraction, segmentation recognition, and language modeling. A new learning paradigm, called graph transformer networks (GTN), allows such multimodule systems to be trained globally using gradient-based methods so as to minimize an overall performance measure. Two systems for online handwriting recognition are described. Experiments demonstrate the advantage of global training, and the flexibility of graph transformer networks. A graph transformer network for reading a bank cheque is also described. It uses convolutional neural network character recognizers combined with global training techniques to provide record accuracy on business and personal cheques. It is deployed commercially and reads several million cheques per day.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324. https://doi.org/10.1109/5.726791

MLA 9

LeCun, Yann, et al. “Gradient-based learning applied to document recognition.” Proceedings of the IEEE, vol. 86, no. 11, 1998, pp. 2278–2324. https://doi.org/10.1109/5.726791.

Chicago

LeCun, Yann, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. “Gradient-based learning applied to document recognition.” Proceedings of the IEEE 86 (11): 2278–2324. https://doi.org/10.1109/5.726791.

Harvard

LeCun, Y. et al. (1998) ‘Gradient-based learning applied to document recognition’, Proceedings of the IEEE, 86(11), pp. 2278–2324. doi:10.1109/5.726791.

IEEE

Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, 1998, doi: 10.1109/5.726791.

BibTeX

@article{lecun1998gradient,
  title     = {{Gradient-based learning applied to document recognition}},
  author    = {LeCun, Yann and Bottou, Léon and Bengio, Yoshua and Haffner, Patrick},
  journal   = {Proceedings of the IEEE},
  year      = {1998},
  volume    = {86},
  number    = {11},
  pages     = {2278--2324},
  doi       = {10.1109/5.726791},
  url       = {https://doi.org/10.1109/5.726791}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20172,7952795
20184,2214221
20195,7335733
20206,3936393
20216,8006800
20225,9495949
20236,2426242
20246,2696269
20256,6636663
20265,2005200

Its field-weighted citation impact is 9.78: it has been cited 9.78 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques

  • document recognition
  • handwritten character recognition
  • handwritten digit recognition
  • convolutional neural networks
  • graph transformer networks
  • global training
  • backpropagation
  • online handwriting recognition

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324. https://doi.org/10.1109/5.726791

How many times has this paper been cited?

61,822 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at HAL.

Who wrote this paper?

Yann LeCun, Léon Bottou, Yoshua Bengio, Patrick Haffner.

What is the DOI of this paper?

10.1109/5.726791. The permanent link is https://doi.org/10.1109/5.726791.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.