Preprint · 2016 · Open access

Communication-Efficient Parallel Block Minimization for Kernel Machines

Cho‐Jui Hsieh, Si, Si, Inderjit S. Dhillon

arXiv (Cornell University) · Published 5 August 2016 · DOI 10.48550/arxiv.1608.02010

Free PDFView at the publisherCite this paper

In brief

“Communication-Efficient Parallel Block Minimization for Kernel Machines” is a 2016 preprint by Cho‐Jui Hsieh and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 0 citations as of 15 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
0
References
20
Authors
3

Abstract

Kernel machines often yield superior predictive performance on various tasks; however, they suffer from severe computational challenges. In this paper, we show how to overcome the important challenge of speeding up kernel machines. In particular, we develop a parallel block minimization framework for solving kernel machines, including kernel SVM and kernel logistic regression. Our framework proceeds by dividing the problem into smaller subproblems by forming a block-diagonal approximation of the Hessian matrix. The subproblems are then solved approximately in parallel. After that, a communication efficient line search procedure is developed to ensure sufficient reduction of the objective function value at each iteration. We prove global linear convergence rate of the proposed method with a wide class of subproblem solvers, and our analysis covers strongly convex and some non-strongly convex functions. We apply our algorithm to solve large-scale kernel SVM problems on distributed systems, and show a significant improvement over existing parallel solvers. As an example, on the covtype dataset with half-a-million samples, our algorithm can obtain an approximate solution with 96% accuracy in 20 seconds using 32 machines, while all the other parallel kernel SVM solvers require more than 2000 seconds to achieve a solution with 95% accuracy. Moreover, our algorithm can scale to very large data sets, such as the kdd algebra dataset with 8 million samples and 20 million features.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hsieh, C., Si, S., & Dhillon, I. S. (2016). Communication-Efficient Parallel Block Minimization for Kernel Machines. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1608.02010

MLA 9

Hsieh, Cho‐Jui, et al. “Communication-Efficient Parallel Block Minimization for Kernel Machines.” arXiv (Cornell University), 2016. https://doi.org/10.48550/arxiv.1608.02010.

Chicago

Hsieh, Cho‐Jui, Si, Si, and Inderjit S. Dhillon. 2016. “Communication-Efficient Parallel Block Minimization for Kernel Machines.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.1608.02010.

Harvard

Hsieh, C., Si, S. and Dhillon, I. S. (2016) ‘Communication-Efficient Parallel Block Minimization for Kernel Machines’, arXiv (Cornell University). doi:10.48550/arxiv.1608.02010.

IEEE

C. Hsieh, S. Si, and I. S. Dhillon, “Communication-Efficient Parallel Block Minimization for Kernel Machines,” arXiv (Cornell University), 2016, doi: 10.48550/arxiv.1608.02010.

BibTeX

@misc{hsieh2016communication,
  title     = {{Communication-Efficient Parallel Block Minimization for Kernel Machines}},
  author    = {Hsieh, Cho‐Jui and Si, Si, and Dhillon, Inderjit S.},
  howpublished = {arXiv (Cornell University)},
  year      = {2016},
  doi       = {10.48550/arxiv.1608.02010},
  url       = {https://doi.org/10.48550/arxiv.1608.02010}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques

  • kernel methods
  • kernel SVM
  • kernel logistic regression
  • global linear convergence
  • distributed optimization
  • large-scale machine learning

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Hsieh, C., Si, S., & Dhillon, I. S. (2016). Communication-Efficient Parallel Block Minimization for Kernel Machines. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1608.02010

How many times has this paper been cited?

0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at arXiv (Cornell University).

Who wrote this paper?

Cho‐Jui Hsieh, Si, Si, Inderjit S. Dhillon.

What is the DOI of this paper?

10.48550/arxiv.1608.02010. The permanent link is https://doi.org/10.48550/arxiv.1608.02010.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.