Journal article · 2026 · Open access

Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization

Jie Tan, Jie Zhang

Discover Applied Sciences, 8(9) · Published 23 June 2026 · DOI 10.1007/s42452-026-08975-6

Read the free full textCite this paper

In brief

“Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization” is a 2026 journal article by Jie Tan and Jie Zhang, published in Discover Applied Sciences. OpenAlex counts 0 citations as of 16 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Discover Applied Sciences.

Citations
0
References
23
Authors
2

Abstract

Large-scale sparse optimization with feature dimensions exceeding 10 5 and sparsity above 90% poses significant challenges for traditional gradient-based methods due to long training periods and heavy communication burdens. This paper proposes a distributed random coordinate descent algorithm integrating gradient-aware coordinate sampling and sparse communication compression. On the Criteo dataset (1.2M samples, 10 6 dimensions, 95% sparsity), the proposed method reduces the loss from 1.25 to 0.41 within the first 200 iterations, reaching stability at 0.349 after 900 iterations. Total training time under 32 nodes is 210 s, compared to 980 s for single-machine coordinate descent (4.7 × speedup). Communication load ranges from 0.9 MB (4 nodes) to 2.3 MB (32 nodes), significantly lower than distributed SGD (6.8 MB at 32 nodes). This work provides a scalable distributed optimization framework that maintains stable convergence while reducing communication overhead by approximately 70% compared to conventional distributed SGD in high-dimensional sparse scenarios.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Tan, J., & Zhang, J. (2026). Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization. Discover Applied Sciences, 8(9). https://doi.org/10.1007/s42452-026-08975-6

MLA 9

Tan, Jie, and Jie Zhang. “Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization.” Discover Applied Sciences, vol. 8, no. 9, 2026. https://doi.org/10.1007/s42452-026-08975-6.

Chicago

Tan, Jie and Jie Zhang. 2026. “Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization.” Discover Applied Sciences 8 (9). https://doi.org/10.1007/s42452-026-08975-6.

Harvard

Tan, J. and Zhang, J. (2026) ‘Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization’, Discover Applied Sciences, 8(9). doi:10.1007/s42452-026-08975-6.

IEEE

J. Tan and J. Zhang, “Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization,” Discover Applied Sciences, vol. 8, no. 9, 2026, doi: 10.1007/s42452-026-08975-6.

BibTeX

@article{tan2026distributed,
  title     = {{Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization}},
  author    = {Tan, Jie and Zhang, Jie},
  journal   = {Discover Applied Sciences},
  year      = {2026},
  volume    = {8},
  number    = {9},
  doi       = {10.1007/s42452-026-08975-6},
  url       = {https://doi.org/10.1007/s42452-026-08975-6}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques

  • sparse optimization
  • large-scale optimization
  • high-dimensional sparse data
  • communication efficiency
  • convergence stability

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Tan, J., & Zhang, J. (2026). Distributed random coordinate descent with gradient-aware sampling and sparse communication for large-scale sparse optimization. Discover Applied Sciences, 8(9). https://doi.org/10.1007/s42452-026-08975-6

How many times has this paper been cited?

0 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Discover Applied Sciences.

Who wrote this paper?

Jie Tan, Jie Zhang.

What is the DOI of this paper?

10.1007/s42452-026-08975-6. The permanent link is https://doi.org/10.1007/s42452-026-08975-6.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.