Preprint · 2017 · Open access
DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization
arXiv (Cornell University), 20(43), 1–58 · Published 13 October 2017 · DOI 10.48550/arxiv.1710.05080
In brief
“DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization” is a 2017 preprint by Lin Xiao and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 51 citations as of 16 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 51
- Most cited in
- 2021 (17)
- References
- 10
- Authors
- 4
Abstract
Machine learning with big data often involves large optimization models. For distributed optimization over a cluster of machines, frequent communication and synchronization of all model parameters (optimization variables) can be very costly. A promising solution is to use parameter servers to store different subsets of the model parameters, and update them asynchronously at different machines using local datasets. In this paper, we focus on distributed optimization of large linear models with convex loss functions, and propose a family of randomized primal-dual block coordinate algorithms that are especially suitable for asynchronous distributed implementation with parameter servers. In particular, we work with the saddle-point formulation of such problems which allows simultaneous data and model partitioning, and exploit its structure by doubly stochastic coordinate optimization with variance reduction (DSCOVR). Compared with other first-order distributed algorithms, we show that DSCOVR may require less amount of overall computation and communication, and less or no synchronization. We discuss the implementation details of the DSCOVR algorithms, and present numerical experiments on an industrial distributed computing system.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Xiao, L., Yu, A. W., Lin, Q., & Chen, W. (2017). DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization. arXiv (Cornell University), 20(43), 1–58. https://doi.org/10.48550/arxiv.1710.05080
MLA 9
Xiao, Lin, et al. “DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization.” arXiv (Cornell University), vol. 20, no. 43, 2017, pp. 1–58. https://doi.org/10.48550/arxiv.1710.05080.
Chicago
Xiao, Lin, Adams Wei Yu, Qihang Lin, and Weizhu Chen. 2017. “DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization.” arXiv (Cornell University) 20 (43): 1–58. https://doi.org/10.48550/arxiv.1710.05080.
Harvard
Xiao, L. et al. (2017) ‘DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization’, arXiv (Cornell University), 20(43), pp. 1–58. doi:10.48550/arxiv.1710.05080.
IEEE
L. Xiao, A. W. Yu, Q. Lin, and W. Chen, “DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization,” arXiv (Cornell University), vol. 20, no. 43, pp. 1–58, 2017, doi: 10.48550/arxiv.1710.05080.
BibTeX
@misc{xiao2017dscovr,
title = {{DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization}},
author = {Xiao, Lin and Yu, Adams Wei and Lin, Qihang and Chen, Weizhu},
howpublished = {arXiv (Cornell University)},
year = {2017},
volume = {20},
number = {43},
pages = {1--58},
doi = {10.48550/arxiv.1710.05080},
url = {https://doi.org/10.48550/arxiv.1710.05080}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2018 | 3 | |
| 2019 | 14 | |
| 2020 | 13 | |
| 2021 | 17 | |
| 2022 | 1 | |
| 2023 | 1 | |
| 2025 | 2 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- distributed optimization
- asynchronous optimization
- parameter server
- randomized block coordinate descent
- primal-dual algorithm
- saddle-point formulation
- variance reduction
- linear models
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Xiao, L., Yu, A. W., Lin, Q., & Chen, W. (2017). DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization. arXiv (Cornell University), 20(43), 1–58. https://doi.org/10.48550/arxiv.1710.05080
How many times has this paper been cited?
51 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Lin Xiao, Adams Wei Yu, Qihang Lin, Weizhu Chen.
What is the DOI of this paper?
10.48550/arxiv.1710.05080. The permanent link is https://doi.org/10.48550/arxiv.1710.05080.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.