Preprint · 2017 · Open access

DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization

Lin Xiao, Adams Wei Yu, Qihang Lin, Weizhu Chen

arXiv (Cornell University), 20(43), 1–58 · Published 13 October 2017 · DOI 10.48550/arxiv.1710.05080

Free PDFView at the publisherCite this paper

In brief

“DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization” is a 2017 preprint by Lin Xiao and 3 co-authors, published in arXiv (Cornell University). OpenAlex counts 51 citations as of 16 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
51
Most cited in
2021 (17)
References
10
Authors
4

Abstract

Machine learning with big data often involves large optimization models. For distributed optimization over a cluster of machines, frequent communication and synchronization of all model parameters (optimization variables) can be very costly. A promising solution is to use parameter servers to store different subsets of the model parameters, and update them asynchronously at different machines using local datasets. In this paper, we focus on distributed optimization of large linear models with convex loss functions, and propose a family of randomized primal-dual block coordinate algorithms that are especially suitable for asynchronous distributed implementation with parameter servers. In particular, we work with the saddle-point formulation of such problems which allows simultaneous data and model partitioning, and exploit its structure by doubly stochastic coordinate optimization with variance reduction (DSCOVR). Compared with other first-order distributed algorithms, we show that DSCOVR may require less amount of overall computation and communication, and less or no synchronization. We discuss the implementation details of the DSCOVR algorithms, and present numerical experiments on an industrial distributed computing system.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Xiao, L., Yu, A. W., Lin, Q., & Chen, W. (2017). DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization. arXiv (Cornell University), 20(43), 1–58. https://doi.org/10.48550/arxiv.1710.05080

MLA 9

Xiao, Lin, et al. “DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization.” arXiv (Cornell University), vol. 20, no. 43, 2017, pp. 1–58. https://doi.org/10.48550/arxiv.1710.05080.

Chicago

Xiao, Lin, Adams Wei Yu, Qihang Lin, and Weizhu Chen. 2017. “DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization.” arXiv (Cornell University) 20 (43): 1–58. https://doi.org/10.48550/arxiv.1710.05080.

Harvard

Xiao, L. et al. (2017) ‘DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization’, arXiv (Cornell University), 20(43), pp. 1–58. doi:10.48550/arxiv.1710.05080.

IEEE

L. Xiao, A. W. Yu, Q. Lin, and W. Chen, “DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization,” arXiv (Cornell University), vol. 20, no. 43, pp. 1–58, 2017, doi: 10.48550/arxiv.1710.05080.

BibTeX

@misc{xiao2017dscovr,
  title     = {{DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization}},
  author    = {Xiao, Lin and Yu, Adams Wei and Lin, Qihang and Chen, Weizhu},
  howpublished = {arXiv (Cornell University)},
  year      = {2017},
  volume    = {20},
  number    = {43},
  pages     = {1--58},
  doi       = {10.48550/arxiv.1710.05080},
  url       = {https://doi.org/10.48550/arxiv.1710.05080}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201833
20191414
20201313
20211717
202211
202311
202522

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques

  • distributed optimization
  • asynchronous optimization
  • parameter server
  • randomized block coordinate descent
  • primal-dual algorithm
  • saddle-point formulation
  • variance reduction
  • linear models

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Xiao, L., Yu, A. W., Lin, Q., & Chen, W. (2017). DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization. arXiv (Cornell University), 20(43), 1–58. https://doi.org/10.48550/arxiv.1710.05080

How many times has this paper been cited?

51 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at arXiv (Cornell University).

Who wrote this paper?

Lin Xiao, Adams Wei Yu, Qihang Lin, Weizhu Chen.

What is the DOI of this paper?

10.48550/arxiv.1710.05080. The permanent link is https://doi.org/10.48550/arxiv.1710.05080.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.