Preprint · 2018 · Open access

Progressive Weight Pruning of Deep Neural Networks using ADMM

Shaokai Ye, Tianyun Zhang, Kaiqi Zhang, Li, Jiayu, Kaidi Xu, Yang, Yunfei, Fuxun Yu, Jian Tang, Makan Fardad, Sijia Liu, Xiang Chen, Xue Lin and 1 more

arXiv (Cornell University) · Published 17 October 2018 · DOI 10.48550/arxiv.1810.07378

Open PDFView at the publisherCite this paper

In brief

“Progressive Weight Pruning of Deep Neural Networks using ADMM” is a 2018 preprint by Shaokai Ye and 12 co-authors, published in arXiv (Cornell University). OpenAlex counts 54 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
54
Most cited in
2020 (11)
References
35
Authors
13

Abstract

Deep neural networks (DNNs) although achieving human-level performance in many domains, have very large model size that hinders their broader applications on edge computing devices. Extensive research work have been conducted on DNN model compression or pruning. However, most of the previous work took heuristic approaches. This work proposes a progressive weight pruning approach based on ADMM (Alternating Direction Method of Multipliers), a powerful technique to deal with non-convex optimization problems with potentially combinatorial constraints. Motivated by dynamic programming, the proposed method reaches extremely high pruning rate by using partial prunings with moderate pruning rates. Therefore, it resolves the accuracy degradation and long convergence time problems when pursuing extremely high pruning ratios. It achieves up to 34 times pruning rate for ImageNet dataset and 167 times pruning rate for MNIST dataset, significantly higher than those reached by the literature work. Under the same number of epochs, the proposed method also achieves faster convergence and higher compression rates. The codes and pruned DNN models are released in the link bit.ly/2zxdlss

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Ye, S., Zhang, T., Zhang, K., Jiayu, L., Xu, K., Yunfei, Y., Yu, F., Tang, J., Fardad, M., Liu, S., Chen, X., Lin, X., & Wang, Y. (2018). Progressive Weight Pruning of Deep Neural Networks using ADMM. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.07378

MLA 9

Ye, Shaokai, et al. “Progressive Weight Pruning of Deep Neural Networks using ADMM.” arXiv (Cornell University), 2018. https://doi.org/10.48550/arxiv.1810.07378.

Chicago

Ye, Shaokai, Tianyun Zhang, Kaiqi Zhang, Li, Jiayu, Kaidi Xu, Yang, Yunfei, Fuxun Yu, et al. 2018. “Progressive Weight Pruning of Deep Neural Networks using ADMM.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.07378.

Harvard

Ye, S. et al. (2018) ‘Progressive Weight Pruning of Deep Neural Networks using ADMM’, arXiv (Cornell University). doi:10.48550/arxiv.1810.07378.

IEEE

S. Ye et al., “Progressive Weight Pruning of Deep Neural Networks using ADMM,” arXiv (Cornell University), 2018, doi: 10.48550/arxiv.1810.07378.

BibTeX

@misc{ye2018progressive,
  title     = {{Progressive Weight Pruning of Deep Neural Networks using ADMM}},
  author    = {Ye, Shaokai and Zhang, Tianyun and Zhang, Kaiqi and Jiayu, Li, and Xu, Kaidi and Yunfei, Yang, and Yu, Fuxun and Tang, Jian and Fardad, Makan and Liu, Sijia and Chen, Xiang and Lin, Xue and Wang, Yanzhi},
  howpublished = {arXiv (Cornell University)},
  year      = {2018},
  doi       = {10.48550/arxiv.1810.07378},
  url       = {https://doi.org/10.48550/arxiv.1810.07378}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201822
201955
20201111
20211111
202288
20231111
202422
202533
202611

Topic and keywords

Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications

  • weight pruning
  • deep neural network compression
  • alternating direction method of multipliers
  • progressive pruning
  • dynamic programming
  • non-convex optimization
  • edge computing
  • ImageNet

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Ye, S., Zhang, T., Zhang, K., Jiayu, L., Xu, K., Yunfei, Y., Yu, F., Tang, J., Fardad, M., Liu, S., Chen, X., Lin, X., & Wang, Y. (2018). Progressive Weight Pruning of Deep Neural Networks using ADMM. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.07378

How many times has this paper been cited?

54 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Shaokai Ye, Tianyun Zhang, Kaiqi Zhang, Li, Jiayu, Kaidi Xu, Yang, Yunfei, Fuxun Yu, Jian Tang, Makan Fardad, Sijia Liu, Xiang Chen, Xue Lin and 1 more.

What is the DOI of this paper?

10.48550/arxiv.1810.07378, permanently at https://doi.org/10.48550/arxiv.1810.07378. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.