Preprint · 2018 · Open access
Progressive Weight Pruning of Deep Neural Networks using ADMM
arXiv (Cornell University) · Published 17 October 2018 · DOI 10.48550/arxiv.1810.07378
In brief
“Progressive Weight Pruning of Deep Neural Networks using ADMM” is a 2018 preprint by Shaokai Ye and 12 co-authors, published in arXiv (Cornell University). OpenAlex counts 54 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 54
- Most cited in
- 2020 (11)
- References
- 35
- Authors
- 13
Abstract
Deep neural networks (DNNs) although achieving human-level performance in many domains, have very large model size that hinders their broader applications on edge computing devices. Extensive research work have been conducted on DNN model compression or pruning. However, most of the previous work took heuristic approaches. This work proposes a progressive weight pruning approach based on ADMM (Alternating Direction Method of Multipliers), a powerful technique to deal with non-convex optimization problems with potentially combinatorial constraints. Motivated by dynamic programming, the proposed method reaches extremely high pruning rate by using partial prunings with moderate pruning rates. Therefore, it resolves the accuracy degradation and long convergence time problems when pursuing extremely high pruning ratios. It achieves up to 34 times pruning rate for ImageNet dataset and 167 times pruning rate for MNIST dataset, significantly higher than those reached by the literature work. Under the same number of epochs, the proposed method also achieves faster convergence and higher compression rates. The codes and pruned DNN models are released in the link bit.ly/2zxdlss
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Ye, S., Zhang, T., Zhang, K., Jiayu, L., Xu, K., Yunfei, Y., Yu, F., Tang, J., Fardad, M., Liu, S., Chen, X., Lin, X., & Wang, Y. (2018). Progressive Weight Pruning of Deep Neural Networks using ADMM. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.07378
MLA 9
Ye, Shaokai, et al. “Progressive Weight Pruning of Deep Neural Networks using ADMM.” arXiv (Cornell University), 2018. https://doi.org/10.48550/arxiv.1810.07378.
Chicago
Ye, Shaokai, Tianyun Zhang, Kaiqi Zhang, Li, Jiayu, Kaidi Xu, Yang, Yunfei, Fuxun Yu, et al. 2018. “Progressive Weight Pruning of Deep Neural Networks using ADMM.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.07378.
Harvard
Ye, S. et al. (2018) ‘Progressive Weight Pruning of Deep Neural Networks using ADMM’, arXiv (Cornell University). doi:10.48550/arxiv.1810.07378.
IEEE
S. Ye et al., “Progressive Weight Pruning of Deep Neural Networks using ADMM,” arXiv (Cornell University), 2018, doi: 10.48550/arxiv.1810.07378.
BibTeX
@misc{ye2018progressive,
title = {{Progressive Weight Pruning of Deep Neural Networks using ADMM}},
author = {Ye, Shaokai and Zhang, Tianyun and Zhang, Kaiqi and Jiayu, Li, and Xu, Kaidi and Yunfei, Yang, and Yu, Fuxun and Tang, Jian and Fardad, Makan and Liu, Sijia and Chen, Xiang and Lin, Xue and Wang, Yanzhi},
howpublished = {arXiv (Cornell University)},
year = {2018},
doi = {10.48550/arxiv.1810.07378},
url = {https://doi.org/10.48550/arxiv.1810.07378}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2018 | 2 | |
| 2019 | 5 | |
| 2020 | 11 | |
| 2021 | 11 | |
| 2022 | 8 | |
| 2023 | 11 | |
| 2024 | 2 | |
| 2025 | 3 | |
| 2026 | 1 |
Topic and keywords
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- weight pruning
- deep neural network compression
- alternating direction method of multipliers
- progressive pruning
- dynamic programming
- non-convex optimization
- edge computing
- ImageNet
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Ye, S., Zhang, T., Zhang, K., Jiayu, L., Xu, K., Yunfei, Y., Yu, F., Tang, J., Fardad, M., Liu, S., Chen, X., Lin, X., & Wang, Y. (2018). Progressive Weight Pruning of Deep Neural Networks using ADMM. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.07378
How many times has this paper been cited?
54 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Shaokai Ye, Tianyun Zhang, Kaiqi Zhang, Li, Jiayu, Kaidi Xu, Yang, Yunfei, Fuxun Yu, Jian Tang, Makan Fardad, Sijia Liu, Xiang Chen, Xue Lin and 1 more.
What is the DOI of this paper?
10.48550/arxiv.1810.07378, permanently at https://doi.org/10.48550/arxiv.1810.07378. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.