Journal article · 2026 · Open access
Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization
Discover Applied Sciences, 8(9) · Published 23 June 2026 · DOI 10.1007/s42452-026-08975-6
In brief
“Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization” is a 2026 journal article by Jie Tan and Jie Zhang, published in Discover Applied Sciences. OpenAlex counts 0 citations as of 16 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Discover Applied Sciences.
- Citations
- 0
- References
- 23
- Authors
- 2
Abstract
Large-scale sparse optimization with feature dimensions exceeding 10 5 and sparsity above 90% poses significant challenges for traditional gradient-based methods due to long training periods and heavy communication burdens. This paper proposes a distributed random coordinate descent algorithm integrating gradient-aware coordinate sampling and sparse communication compression. On the Criteo dataset (1.2M samples, 10 6 dimensions, 95% sparsity), the proposed method reduces the loss from 1.25 to 0.41 within the first 200 iterations, reaching stability at 0.349 after 900 iterations. Total training time under 32 nodes is 210 s, compared to 980 s for single-machine coordinate descent (4.7 × speedup). Communication load ranges from 0.9 MB (4 nodes) to 2.3 MB (32 nodes), significantly lower than distributed SGD (6.8 MB at 32 nodes). This work provides a scalable distributed optimization framework that maintains stable convergence while reducing communication overhead by approximately 70% compared to conventional distributed SGD in high-dimensional sparse scenarios.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Tan, J., & Zhang, J. (2026). Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization. Discover Applied Sciences, 8(9). https://doi.org/10.1007/s42452-026-08975-6
MLA 9
Tan, Jie, and Jie Zhang. “Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization.” Discover Applied Sciences, vol. 8, no. 9, 2026. https://doi.org/10.1007/s42452-026-08975-6.
Chicago
Tan, Jie and Jie Zhang. 2026. “Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization.” Discover Applied Sciences 8 (9). https://doi.org/10.1007/s42452-026-08975-6.
Harvard
Tan, J. and Zhang, J. (2026) ‘Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization’, Discover Applied Sciences, 8(9). doi:10.1007/s42452-026-08975-6.
IEEE
J. Tan and J. Zhang, “Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization,” Discover Applied Sciences, vol. 8, no. 9, 2026, doi: 10.1007/s42452-026-08975-6.
BibTeX
@article{tan2026distributed,
title = {{Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization}},
author = {Tan, Jie and Zhang, Jie},
journal = {Discover Applied Sciences},
year = {2026},
volume = {8},
number = {9},
doi = {10.1007/s42452-026-08975-6},
url = {https://doi.org/10.1007/s42452-026-08975-6}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- sparse optimization
- large-scale optimization
- high-dimensional sparse data
- communication efficiency
- convergence stability
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Tan, J., & Zhang, J. (2026). Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization. Discover Applied Sciences, 8(9). https://doi.org/10.1007/s42452-026-08975-6
How many times has this paper been cited?
0 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Discover Applied Sciences.
Who wrote this paper?
Jie Tan, Jie Zhang.
What is the DOI of this paper?
10.1007/s42452-026-08975-6. The permanent link is https://doi.org/10.1007/s42452-026-08975-6.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.