Journal article · 2014 · Open access

A tutorial survey of architectures, algorithms, and applications for deep learning

Li Deng

APSIPA Transactions on Signal and Information Processing, 3(1) · Published 1 January 2014 · DOI 10.1017/atsip.2013.9

Free PDFView at the publisherCite this paper

In brief

“A tutorial survey of architectures, algorithms, and applications for deep learning” is a 2014 journal article by Li Deng, published in APSIPA Transactions on Signal and Information Processing. OpenAlex counts 748 citations as of 16 November 2026, which puts it in the top 1% of works published in 2014 by citations. It is open access under a CC BY licence: the full text is free to read at APSIPA Transactions on Signal and Information Processing.

Citations
748
Most cited in
2020 (133)
Field-weighted impact
30.13
References
234
Authors
1

Abstract

In this invited paper, my overview material on the same topic as presented in the plenary overview session of APSIPA-2011 and the tutorial material presented in the same conference [1] are expanded and updated to include more recent developments in deep learning. The previous and the updated materials cover both theory and applications, and analyze its future directions. The goal of this tutorial survey is to introduce the emerging area of deep learning or hierarchical learning to the APSIPA community. Deep learning refers to a class of machine learning techniques, developed largely since 2006, where many stages of non-linear information processing in hierarchical architectures are exploited for pattern classification and for feature learning. In the more recent literature, it is also connected to representation learning, which involves a hierarchy of features or concepts where higher-level concepts are defined from lower-level ones and where the same lower-level concepts help to define higher-level ones. In this tutorial survey, a brief history of deep learning research is discussed first. Then, a classificatory scheme is developed to analyze and summarize major work reported in the recent deep learning literature. Using this scheme, I provide a taxonomy-oriented survey on the existing deep architectures and algorithms in the literature, and categorize them into three classes: generative, discriminative, and hybrid. Three representative deep architectures – deep autoencoders, deep stacking networks with their generalization to the temporal domain (recurrent networks), and deep neural networks (pretrained with deep belief networks) – one in each of the three classes, are presented in more detail. Next, selected applications of deep learning are reviewed in broad areas of signal and information processing including audio/speech, image/vision, multimodality, language modeling, natural language processing, and information retrieval. Finally, future directions of deep learning are discussed and analyzed.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Deng, L. (2014). A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Transactions on Signal and Information Processing, 3(1). https://doi.org/10.1017/atsip.2013.9

MLA 9

Deng, Li. “A tutorial survey of architectures, algorithms, and applications for deep learning.” APSIPA Transactions on Signal and Information Processing, vol. 3, no. 1, 2014. https://doi.org/10.1017/atsip.2013.9.

Chicago

Deng, Li. 2014. “A tutorial survey of architectures, algorithms, and applications for deep learning.” APSIPA Transactions on Signal and Information Processing 3 (1). https://doi.org/10.1017/atsip.2013.9.

Harvard

Deng, L. (2014) ‘A tutorial survey of architectures, algorithms, and applications for deep learning’, APSIPA Transactions on Signal and Information Processing, 3(1). doi:10.1017/atsip.2013.9.

IEEE

L. Deng, “A tutorial survey of architectures, algorithms, and applications for deep learning,” APSIPA Transactions on Signal and Information Processing, vol. 3, no. 1, 2014, doi: 10.1017/atsip.2013.9.

BibTeX

@article{deng2014tutorial,
  title     = {{A tutorial survey of architectures, algorithms, and applications for deep learning}},
  author    = {Deng, Li},
  journal   = {APSIPA Transactions on Signal and Information Processing},
  year      = {2014},
  volume    = {3},
  number    = {1},
  doi       = {10.1017/atsip.2013.9},
  url       = {https://doi.org/10.1017/atsip.2013.9}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20176262
20188181
20198585
2020133133
20219393
20228080
20235757
20244040
20254242
20261414

Its field-weighted citation impact is 30.13: it has been cited 30.13 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications

  • deep learning
  • hierarchical learning
  • deep learning architectures
  • deep belief network
  • deep autoencoder
  • recurrent neural networks
  • generative models
  • discriminative models

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Deng, L. (2014). A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Transactions on Signal and Information Processing, 3(1). https://doi.org/10.1017/atsip.2013.9

How many times has this paper been cited?

748 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at APSIPA Transactions on Signal and Information Processing.

Who wrote this paper?

Li Deng.

What is the DOI of this paper?

10.1017/atsip.2013.9. The permanent link is https://doi.org/10.1017/atsip.2013.9.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.